Skip to content

Engineering Tomorrow with Samsung’s Latest Memory and Storage Solutions at SC24

  • mail
Samsung’s booth at SC24 November 17-22 at the Georgia World Congress Center in Atlanta
Samsung’s booth at SC24 November 17-22 at the Georgia World Congress Center in Atlanta
Samsung’s booth at SC24 November 17-22 at the Georgia World Congress Center in Atlanta
Samsung’s booth at SC24 November 17-22 at the Georgia World Congress Center in Atlanta

Samsung's presence at SC24, the leading high-performance computing event, underscored its commitment to innovation in memory and storage. The company showcased a range of groundbreaking technologies, highlighting the transformative CMM-D memory expander built on revolutionary CXL technology. Subject matter experts further illuminated Samsung's vision for the future of HPC with in-booth theater sessions, detailing solutions for diverse applications from AI to complex data analytics.

A presenter explaining Samsung’s CMM-D solution with diagrams showing how data offloading reduces GPU memory usage.
One of the many in-booth theater sessions held during the event
A presenter explaining Samsung’s CMM-D solution with diagrams showing how data offloading reduces GPU memory usage.
One of the many in-booth theater sessions held during the event

CMM-D: Revolutionizing Memory Expansion for HPC

CMM-D is not just a memory expansion solution; it's a paradigm shift for high-performance computing. Its key advantages include seamless integration and significant performance improvements. CMM-D requires no system modifications, offering a cost-effective and efficient way to boost memory capacity. With 32GB mono-based DRAM components and a maximum bandwidth of 36GB/s, it delivers substantial performance gains, addressing capacity, bandwidth, and total cost of ownership (TCO) challenges inherent in AI computing.

 

CMM-D Use Cases: Real-World Impact Across Industries

CMM-D's impact is evident across various applications:

  • High-Performance Analytics (Intel/SAP HANA): Optimizes memory tiering and data management for faster real-time data processing.
  • In-Memory Databases (Redis): Improves system performance through dynamic data placement and migration, enabling more efficient resource utilization.
  • Deep Learning Recommendation Models (DLRM): Offloads embedding tables from the GPU, freeing up valuable GPU memory for improved efficiency and speed.
  • Graph Databases (GraphDB): Expands bandwidth while ensuring stable execution times, even during peak workloads.
A few examples of CMM-D use cases for enterprise
A few examples of CMM-D use cases for enterprise
A few examples of CMM-D use cases for enterprise
A few examples of CMM-D use cases for enterprise

CMM-D: Empowering Next-Generation Applications

CMM-D’s capabilities extend to enhance cutting-edge applications:

  • Retrieval-Augmented Generation (RAG): Addresses challenges with ever-growing VectorDBs by seamlessly integrating with CXL memory to handle large-scale data requirements for higher-quality responses in language models.

CMM-D leverages the power of Samsung's CXL hotness monitoring unit (CHMU), a device-driven approach for tracking and prioritizing frequently accessed data. This intelligent optimization of memory resource management enhances the speed and efficiency of memory-intensive processes.

A display showcasing Samsung’s CMM-D technology for memory expansion and hot page identification
CMM-D applications such as the CXL hotness monitoring unit
A display showcasing Samsung’s CMM-D technology for memory expansion and hot page identification
CMM-D applications such as the CXL hotness monitoring unit

System Architecture Innovations: Samsung's Holistic Approach

Samsung's commitment to HPC extends beyond CMM-D. Innovative CXL memory module products like CMM-B (the industry's first rack-level memory solution), CMM-H PM/TM (CXL DRAM-NAND hybrid offering), and the Samsung High Performance Storage Platform (SHiPS) provide flexible memory and storage solutions to meet the evolving demands of today's data-centric applications. SHiPS stands out as a scale-out file storage solution employing a key-value store backend, designed to drive efficiency in AI/ML, enable multi-cloud strategies, and empower greater control over data.

Discussing Samsung’s offerings in the system architecture innovations section of the booth
Discussing Samsung’s offerings in the system architecture innovations section of the booth
Discussing Samsung’s offerings in the system architecture innovations section of the booth
Discussing Samsung’s offerings in the system architecture innovations section of the booth

High-Performance Memory Solutions: A Broad Portfolio for HPC

Samsung's HPC memory portfolio includes DDR5 (industry-leading capacity for Gen AI servers), HBM3E (high-performance memory for AI and HPC platforms), GDDR7 (high-speed graphics memory), BM1743 (high-capacity QLC SSD), and PM1753 (fastest 16ch PCIe Gen5 SSD). These solutions are optimized to enhance performance and efficiency, meeting the diverse demands of modern high-performance applications.

Booth interactions in the HPC Memory Solutions area
Booth interactions in the HPC Memory Solutions area
Booth interactions in the HPC Memory Solutions area
Booth interactions in the HPC Memory Solutions area

Engineering the Future of HPC

Samsung, through continuous collaboration and cutting-edge innovation as exemplified by CMM-D, empowers users to tackle the most demanding workloads with ease. The company is engineering tomorrow with innovative memory and storage solutions, fueling advancement in AI, HPC, and other leading technologies.

Related contents
Related Contents