Proof-Positive: Memory is Faster Than Disk. Don’t Need No Book Learnin’ to Cipher That One.

I’ve been reading a lot of blogosphere content about Data Warehousing these days. I’ve taken a lot of interest in such technology as Netezza, GreenPlum, DATAllegro and others and blog reading proves to be an interesting way to augment one’s knowledge. Who’d have thought I’d learn so much about OLTP through this reading.

Memory is Faster than Disk, So Let’s Do a Complete Rewrite
Why, just today I found out that it is time for a total rewrite of commercial RDBMS products. Uh huh. More interestingly, though, I learned:

  • Memory is faster than disk. Really, truely, it is!
  • A dual-core (2.8GHz) server with 4GB memory and 4 250GB SATA drives can perform 51,000 TpmC
  • Disabling transaction logging entirely in a commercial RDBMS will increase throughput (TpmC) about three-fold

I found these pearls of wisdom while reading a Stonebraker paper referred to on this blog post. Yes, I know that blog is basically a store-front for Vertica, but I like to learn about different things that are going on in database technology. Unfortunately this time I was wasting my time. The URL in that blog post points to the VLDB front page, but a little sleuthing found the paper posted here: The End of an Architectural Era (It’s Time for a Complete Rewrite).

Recite after me:

If you get two orders of magnitude performance gain, you are either not doing it or you’ve moved it closer to the processor.

Dang, and I ain’t even got no too pretty good pedigree. Pshaw, I dasn’t fidget ‘mungst the quality!

Central versus De-centralized versus Shared-Nothing
No, it isn’t time for a re-write, especially one that requires a complete shared-nothing database approach. Now don’t get me wrong, I’m all for de-coupling and grid architecture-most particularly where storage is concerned. If I hear of another poor production site that is head-saturated on a $500,000 storage array when driving a measly 15 or so 15K RPM drives, I’ll BAARF. Please see the following post for what I’m talking about:

Hard Drives Are Arcane Technology. So Why Can’t I Realize Their Full Bandwidth Potential?

1 Response to “Proof-Positive: Memory is Faster Than Disk. Don’t Need No Book Learnin’ to Cipher That One.”


  1. 1 Paul February 21, 2008 at 11:57 pm

    Hey Kevin,

    Now, this isn’t directly relevant to this quite funny post of yours but your crack about disabling transaction logging made me wonder for some reason, how Oracle’s compression option effects logging performance. Does compression even touch the logs or just the data (tables)? Any chance you have some logs from benchmark runs (maybe TPC-C) that you could share with me for some random experiments I’d like to try? I know that is a large request, maybe zipped up and put up on gigasize or divshare….if not are there any in the wild (I’m really trying to avoid installing the beast of Oracle just to get some logs to play with–if not obvious I’m not an Oracle expert)

    an aside…what gives with the Oracle website, not that you can do anything about it, but it has been unreachable for about an hour this afternoon.


Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s




DISCLAIMER

I work for Amazon Web Services. The opinions I share in this blog are my own. I'm *not* communicating as a spokesperson for Amazon. In other words, I work at Amazon, but this is my own opinion.

Enter your email address to follow this blog and receive notifications of new posts by email.

Join 2,944 other followers

Oracle ACE Program Status

Click It

website metrics

Fond Memories

Copyright

All content is © Kevin Closson and "Kevin Closson's Blog: Platforms, Databases, and Storage", 2006-2015. Unauthorized use and/or duplication of this material without express and written permission from this blog’s author and/or owner is strictly prohibited. Excerpts and links may be used, provided that full and clear credit is given to Kevin Closson and Kevin Closson's Blog: Platforms, Databases, and Storage with appropriate and specific direction to the original content.

%d bloggers like this: