Talk About Network

Google


Register and Login
Nick
Password
Register create new account Sign up is FREE and you can post replies, new topics, bookmark posts and more!
Recover lost password


Programming > Java Programmer > Re: Data Storag...
Latest [ Topics | Posts ] Archive Post A New Topic Post a Reply
<< Topic < Post Post 22 of 24 Topic 52608 of 54812
Post > Topic >>

Re: Data Storage Issue (Basic Issue)

by John W Kennedy <jwkenne@[EMAIL PROTECTED] > May 14, 2008 at 11:45 AM

Lew wrote:
> Tom Anderson wrote:
>> If someone (credible) told me that there was a five-to-one difference 
>> in times for an ArrayList.get and an array[], then, if we were in a 
>> context where performance was im****tant, i certainly would take that 
>> as kind of damning for collections. I think that's perfectly
reasonable.
> 
> Eric is correct that you should not generalize from a single data point,

> especially when full details are not available for that one case.  I 
> presented the anecdote not to prove anything but to provide evidence, at

> least that the matter is worth pursuing more objectively.
> 
> My comment that I lack credibility was not about personality but about 
> evidence and what makes it valid.  I provided no hard data, nor enough 
> information about the anecdote to make it something on which you can 
> base conclusions.  By hard standards, I indeed do lack credibility to 
> assert that direct-to-disk is five times faster.  OTOH, it is enough to 
> share one experience that indicates that the claim is potentially 
> sup****table, just maybe.

It depends on how much effort you're willing to put in. A major reason 
for databases running faster when off the file system, for example, is 
doing things like putting SQL tables into a continuous range of 
cylinders, and putting the lowest level of the primary index on track 
zero of those same cylinders. Then, to find a given record, you go 
through the high-level parts of the index tree, which are probably 
cached, anyway; move the access arm to the correct cylinder; read the 
low-level index record from track zero (perhaps it is replicated as many 
times as it will fit on the track, so that it comes up as fast as 
possible); and then read the data without moving the access arm again. 
That gives you indexed access only imperceptibly slower than hashed.

Much-larger-than-RAM sorts can use similar tricks, such as merging 
RAM-sorted strings from the top half of the disk to the bottom half and 
then back again, until the final merge to the target.

IBM mainframes have used methods like this since the mid 1960s.

If, on the other hand, you're just doing the equivalent of reading a 
FileInputStream or writing a FileOutputStream, stick with the file 
system. Moving it off will accomplish almost nothing.

-- 
John W. Kennedy
  "Give up vows and dogmas, and fixed things, and you may grow like 
That. ...you may come to think a blow bad, because it hurts, and not 
because it humiliates.  You may come to think murder wrong, because it 
is violent, and not because it is unjust."
   -- G. K. Chesterton.  "The Ball and the Cross"
 




 24 Posts in Topic:
Data Storage Issue (Basic Issue)
Srini <Srinihello@[EMA  2008-05-09 07:37:29 
Re: Data Storage Issue (Basic Issue)
Tom Anderson <twic@[EM  2008-05-09 18:19:34 
Re: Data Storage Issue (Basic Issue)
Lew <lew@[EMAIL PROTEC  2008-05-09 23:01:21 
Re: Data Storage Issue (Basic Issue)
Wayne <nospam@[EMAIL P  2008-05-11 14:56:24 
Re: Data Storage Issue (Basic Issue)
Lew <lew@[EMAIL PROTEC  2008-05-11 15:38:41 
Re: Data Storage Issue (Basic Issue)
=?UTF-8?B?QXJuZSBWYWpow7h  2008-05-11 22:59:14 
Re: Data Storage Issue (Basic Issue)
Lew <lew@[EMAIL PROTEC  2008-05-11 23:07:41 
Re: Data Storage Issue (Basic Issue)
=?UTF-8?B?QXJuZSBWYWpow7h  2008-05-11 23:03:03 
Re: Data Storage Issue (Basic Issue)
Rex Mottram <rexm@[EMA  2008-05-09 23:14:01 
Re: Data Storage Issue (Basic Issue)
Tom Anderson <twic@[EM  2008-05-10 14:17:04 
Re: Data Storage Issue (Basic Issue)
Eric Sosman <esosman@[  2008-05-10 09:45:18 
Re: Data Storage Issue (Basic Issue)
Lew <lew@[EMAIL PROTEC  2008-05-10 10:02:02 
Re: Data Storage Issue (Basic Issue)
Eric Sosman <esosman@[  2008-05-10 13:33:34 
Re: Data Storage Issue (Basic Issue)
Lew <lew@[EMAIL PROTEC  2008-05-10 18:04:49 
Re: Data Storage Issue (Basic Issue)
Patricia Shanahan <pat  2008-05-10 15:30:32 
Re: Data Storage Issue (Basic Issue)
Eric Sosman <esosman@[  2008-05-11 09:20:52 
Re: Data Storage Issue (Basic Issue)
Mark Space <markspace@  2008-05-14 19:30:01 
Re: Data Storage Issue (Basic Issue)
=?UTF-8?B?QXJuZSBWYWpow7h  2008-05-31 21:17:31 
Re: Data Storage Issue (Basic Issue)
Roedy Green <see_websi  2008-05-11 03:51:09 
Re: Data Storage Issue (Basic Issue)
Tom Anderson <twic@[EM  2008-05-11 15:37:34 
Re: Data Storage Issue (Basic Issue)
Lew <lew@[EMAIL PROTEC  2008-05-11 11:20:21 
Re: Data Storage Issue (Basic Issue)
John W Kennedy <jwkenn  2008-05-14 11:45:49 
Re: Data Storage Issue (Basic Issue)
Lew <lew@[EMAIL PROTEC  2008-05-14 23:46:05 
Re: Data Storage Issue (Basic Issue)
=?ISO-8859-1?Q?Arne_Vajh=  2008-05-11 23:08:03 

Post A Reply:
  Go here to Signup

AddThis Feed Button


About - Advertising - Contact - Frequently Asked Questions - Privacy Policy - Terms of Use - Signup

Contact
tan12V112 Mon Oct 6 10:39:58 CDT 2008.