Skip to content

HBM-PIM: Cutting-edge memory technology to accelerate next-generation AI

  • mail
Hyperscale AIs like ChatGPT have taken the world by storm with their human-like ability to answer questions, hold conversations, and even compose music and computer programs. But behind that miraculous facade, a huge amount of memory-intensive data calculations are needed. To solve the exponentially increasing demands that Hyperscale AIs make on traditional memory solutions, Samsung Electronics has integrated an AI-dedicated semiconductor into its high-bandwidth memory (HBM). Called Processing-in-Memory (PIM), our technology allows us to implement processors right into the DRAM, reducing data movement and improving the energy and data efficiency of AI accelerator systems by offloading some of the data calculation work from the processor onto the memory itself. One graphics processing unit (GPU) boasting Samsung HBM-PIM memory is a testing variant of the Instinct MI100 card made by @AMD. By applying our HBM-PIM technology to large-scale AI and HPC applications, Samsung has seen the potential for doubling the performance of the GPU accelerator while reducing energy consumption. AMD talked about this the ISSCC 2023 conference in February where they said, “From a systems standpoint, we want to be as efficient as possible and with our partner Samsung and their PIM technology, we have seen up to an 85% savings in data movement energy within memory processing, and this is a promising technology for optimization in future systems.” ISSCC: Because we know the importance of Hyperscale AIs like ChatGPT will only grow through the 21st century, #SamsungSemiconductor is dedicated to continuing to develop next-gen technologies for them, including HBM-PIM, as well as releasing the necessary software and simulators to support them.

Would you like to
leave this page?
If you leave this page, the content you are creating
will not be saved.

Registration Are you sure you want to submit this?

Thank you! Please confirm your registration

Your subscription is not active yet!
An email with an activation link
has just been sent to your email address.
Please activate your subscription by clicking on
the activation link inside the email.

Thank you! Please confirm

your existing registration

You have already registered, but before we can send you the
information about upcoming events, we need your confirmation.

If you missed our previous email, please use the button below to resend it.
To activate your subscription, please click on the link included in the email.


To proceed, please click on the "check" button located in the email section.