Overcoming memory Hurdles in AI - Performance and choice at scale

As AI models, particularly large language models, increase in size and complexity, effectively managing memory bottlenecks becomes imperative. This presentation will delve into the technical architecture and packaging innovations of AMD GPUs, which boast high memory capacity to cater to demanding generative AI workloads. Additionally, this talk covers practical strategies for optimizing performance and highlight the role of open-source tools and collaborations with ecosystem partners in accelerating AI development.