Generative AI is a revolutionary technology that not only needs a powerful NPU to work, but it can also consume a lot of memory, and memory bandwidth can make a noticeable difference in performance. LPDDR6 memory appears as the answer from giants in the sector to the inflection point we are at and could be a reality in early 2025.

In order for generative AI models to offer a good user experience, they must be supported by hardware capable of moving several billion parameters. In the case of Snapdragon 8 Gen 3, this chip is able to work with generative AI models up to 1 billion parameters. As a reference, I remind you that it works with Llama2 13B INT4 13 billion parameters.

A generative AI model with more parameters will be able to offer a better user experience because it will have a much broader “knowledge” base and you’ll be able to do more things and respond to more user needs. With the launch of the Snapdragon 8 Gen 4 SoC, there will be an important advance in this regard, as it will be a much more powerful chip in every way and its NPU will be able to perform more operations per second.

This new SoC will be supported by LPDDR6 memory, a component that will the key to further progress on the path of generative artificial intelligence on mobile devices as it will offer a significant improvement in terms of bandwidth. We still don’t have concrete data, but we can take as a reference the progress that LPDDR5 memory represented compared to LPDDR4. At the time of the first doubled the bandwidth of the otherso we can expect a similar improvement from LPDDR6 over LPDDR5.

Samsung is one of the companies that has bet on AI in mobile devices most significantly with the launch of the Galaxy S24, so it is not surprising that it is also one of the ones that is working the hardest to start producing LPDDR6. memory in matter. It is not confirmed, but most likely this new standard is ready debuting alongside the Samsung Galaxy S25which will hit the market between January and February next year.

AI generated cover image.