MemVerge and Micron Boost NVIDIA GPU Utilization with CXL® Memory

Key Facts

MemVerge®, a leader in AI-first Big Memory Software, has joined forces with Micron to unveil a groundbreaking solution that leverages intelligent tiering of CXL memory, boosting the performance of large language models (LLMs) by offloading from GPU HBM to CXL memory.
Simultaneously, GPU utilization soared from 51.8% to 91.8%, thanks to the transparent management of data tiering across DIMMs and CXL modules facilitated by MemVerge Memory Machine X software.
"Through our collaboration with MemVerge, Micron is able to demonstrate the substantial benefits of CXL memory modules to improve effective GPU throughput for AI applications resulting in faster time to insights for customers.
For more information about MemVerge, Micron, and Supermicro's collaborative efforts and the transformative potential of CXL memory for AI workloads, please visit www.memverge.com/gtc2024 About MemVerge MemVerge is a pioneering developer of Big Memory Computing software.