Talk About Network

Google


Register and Login
Nick
Password
Register create new account Sign up is FREE and you can post replies, new topics, bookmark posts and more!
Recover lost password


Programming > Java Programmer > Re: Data Storag...
Latest [ Topics | Posts ] Archive Post A New Topic Post a Reply
<< Topic < Post Post 12 of 24 Topic 52608 of 55513
Post > Topic >>

Re: Data Storage Issue (Basic Issue)

by Lew <lew@[EMAIL PROTECTED] > May 10, 2008 at 10:02 AM

Eric Sosman wrote:
>     It might be a good idea to learn more about the
> anecdote before drawing too many conclusions ...  Just
> a few quick observations:
> 
>     1) The anecdote does not reveal what was measured.  This
>        five-to-one difference might have been in latency,
>        throughput, capacity, license price, or debugging time.

Transactions per minute in a Java Enterprise application hitting an Oracle

back end.  It was a saturation test, so exact boundaries aren't available
and 
I don't have access to the hard data anyway.


>     2) The anecdote does not reveal which configuration had
>        the better result on the measured quantity, only that
>        a difference existed.  The final score may have been
>        ten to two, but which team won?

Oracle with its direct disk management vs. Oracle working with the file 
system.  Direct disk management sped up the database throughput by a
factor 
that they could tell was above five to one, but not by how much.

>     3) The anecdote tells us only that the test was "large-
>        scale," but nothing else.  A few weeks ago near where
>        I live, a "large-scale" test called the Boston Marathon
>        demonstrated conclusively that wheelchairs are faster
>        than motorcycles (even though the motorcycles had a
>        head start, the wheelchairs were first to the finish).

Terabyte-order data, on the order of hundreds of thousands of do***ents
per 
hour processed through an enterprise application with relevant data
extracted 
and stored in the database.

>     4) The fact (if we assume its existence) that some database
>        performed better without a file system than with one does
>        not prove that the file system performs poorly.  It might
>        well be that the database in question does things dumbly
>        and forces the file system to do a lot of needless work.

In this case, no.  If you read up on Oracle's direct-disk management it is
not 
dumb, nor is its file-system interaction.  None of the big players are
stupid 
with file-system access, be they Oracle, DB2, Postgres or whomever.  You
can 
pose it as a theoretical risk, but if you pick a reputable product it
won't be 
an issue at all in real life.  No need to panic.

>     I'd suggest that you not dismiss Lew's anecdote, but that
> you examine its actual information content before forming firm
> opinions about file systems vs. raw devices.

Which is exactly why I presented it as an anecdote.  Still, seeing it work

like that even in one case is very indicative, wouldn't you agree?

-- 
Lew
 




 24 Posts in Topic:
Data Storage Issue (Basic Issue)
Srini <Srinihello@[EMA  2008-05-09 07:37:29 
Re: Data Storage Issue (Basic Issue)
Tom Anderson <twic@[EM  2008-05-09 18:19:34 
Re: Data Storage Issue (Basic Issue)
Lew <lew@[EMAIL PROTEC  2008-05-09 23:01:21 
Re: Data Storage Issue (Basic Issue)
Wayne <nospam@[EMAIL P  2008-05-11 14:56:24 
Re: Data Storage Issue (Basic Issue)
Lew <lew@[EMAIL PROTEC  2008-05-11 15:38:41 
Re: Data Storage Issue (Basic Issue)
=?UTF-8?B?QXJuZSBWYWpow7h  2008-05-11 22:59:14 
Re: Data Storage Issue (Basic Issue)
Lew <lew@[EMAIL PROTEC  2008-05-11 23:07:41 
Re: Data Storage Issue (Basic Issue)
=?UTF-8?B?QXJuZSBWYWpow7h  2008-05-11 23:03:03 
Re: Data Storage Issue (Basic Issue)
Rex Mottram <rexm@[EMA  2008-05-09 23:14:01 
Re: Data Storage Issue (Basic Issue)
Tom Anderson <twic@[EM  2008-05-10 14:17:04 
Re: Data Storage Issue (Basic Issue)
Eric Sosman <esosman@[  2008-05-10 09:45:18 
Re: Data Storage Issue (Basic Issue)
Lew <lew@[EMAIL PROTEC  2008-05-10 10:02:02 
Re: Data Storage Issue (Basic Issue)
Eric Sosman <esosman@[  2008-05-10 13:33:34 
Re: Data Storage Issue (Basic Issue)
Lew <lew@[EMAIL PROTEC  2008-05-10 18:04:49 
Re: Data Storage Issue (Basic Issue)
Patricia Shanahan <pat  2008-05-10 15:30:32 
Re: Data Storage Issue (Basic Issue)
Eric Sosman <esosman@[  2008-05-11 09:20:52 
Re: Data Storage Issue (Basic Issue)
Mark Space <markspace@  2008-05-14 19:30:01 
Re: Data Storage Issue (Basic Issue)
=?UTF-8?B?QXJuZSBWYWpow7h  2008-05-31 21:17:31 
Re: Data Storage Issue (Basic Issue)
Roedy Green <see_websi  2008-05-11 03:51:09 
Re: Data Storage Issue (Basic Issue)
Tom Anderson <twic@[EM  2008-05-11 15:37:34 
Re: Data Storage Issue (Basic Issue)
Lew <lew@[EMAIL PROTEC  2008-05-11 11:20:21 
Re: Data Storage Issue (Basic Issue)
John W Kennedy <jwkenn  2008-05-14 11:45:49 
Re: Data Storage Issue (Basic Issue)
Lew <lew@[EMAIL PROTEC  2008-05-14 23:46:05 
Re: Data Storage Issue (Basic Issue)
=?ISO-8859-1?Q?Arne_Vajh=  2008-05-11 23:08:03 

Post A Reply:
  Go here to Signup

AddThis Feed Button


About - Advertising - Contact - Frequently Asked Questions - Privacy Policy - Terms of Use - Signup

Contact
tan12V112 Wed Dec 3 19:26:09 CST 2008.