Exadata Memory Expansion Kit

Posted in: Technical Track

I was just looking at an Exadata X2-2 ordering document and noticed that it included 144GB of RAM. The sales rep pointed at the Exadata X2-2 datasheet and showed the 96GB to 144GB memory expansion option. Based on my reading of Intel Xeon (Nehalam) memory configurations, as long as each channel has a single dual-ranked module, all the memory can run at full 1333MHz speed. (Update: as noted in the comments, this is unfortunately not the case in Exadata; with the expansion unit memory runs at 800MHz). It populates the normally-empty third socket for each memory bank with an additional memory module.

It isn’t particularly cheap: $6250 per database node at US list price, but is a performance booster that doesn’t have ongoing support costs either. For OLTP environments, I like to say cache is still king, and even for those of you with pure data warehouses, 50% more PGA space can help out your sorts too.

And yes, I realize this isn’t particularly new; according to Kerry Osborne’s blog it came out (but wasn’t officially announced per se) at the same time as the storage expansion racks in the summer

email
Want to talk with an expert? Schedule a call with our team to get the conversation started.

About the Author

Marc is a passionate and creative problem solver, drawing on deep understanding of the full enterprise application stack to identify the root cause of problems and to deploy sustainable solutions. Marc has a strong background in performance tuning and high availability, developing many of the tools and processes used to monitor and manage critical production databases at Pythian. He is proud to be the very first DataStax Platinum Certified Administrator for Apache Cassandra.

4 Comments. Leave new

If you use the expansion kit and fully populate all the slots, the frequency of the memory DIMMs drops to 800 MHz from 1333 MHz. This is mentioned in the blog post you site as well.

Reply

Confirming Greg is correct…

Since cache is king :-) we have used the memory expansion kit

[[email protected]:PJT5]/dbfs/fs52/prod_dba => cat /proc/meminfo | head -1
MemTotal: 148294940 kB

Handle 0x0055, DMI type 17, 28 bytes
Memory Device
Array Handle: 0x0048
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 8192 MB
Form Factor: DIMM
Set: None
Locator: D3
Bank Locator: /SYS/MB/P1
Type: DDR3
Type Detail: Other
Speed: 800 MHz
Manufacturer: Samsung
Serial Number: 829FC09B
Asset Tag: AssetTagNum5
Part Number: M393B1K70CH0-YH9
Rank: 2

On machines on which we have not used the memory expansion kits the frequency is 1333 MHz

Reply
Marc Fielding
December 5, 2011 3:44 am

Thanks guys – I’ve run into this memory-speed limitation in non-Exadata Xeon-based systems, and was wondering if Exadata had the same restriction, but couldn’t find clear docs either way. Even at 800MHz though, I’d take the 50% additional RAM :-)

Reply

Marc,

I think you mentioned Kerry Osborne’s blog, but gave the link to Andy Colvin’s blog.

Thanks to Greg for pointing out about the drop in memory speed. I certainly did not know about it.

Reply

Leave a Reply

Your email address will not be published. Required fields are marked *