This week, we dig into why the AI infrastructure conversation is shifting from compute scarcity to the memory wall. As large language models get bigger and enterprises move from training to high-volume inference, memory, storage, networking and GPU utilization are becoming critical to AI performance and economics.

Featuring insights from Jason Hardy of NVIDIA and Val Bercovici of WEKA, this episode breaks down why inference workloads are fundamentally different from training, how agentic AI increases pressure on memory systems, and why idle GPUs can turn into a costly problem for enterprises building AI factories.

This week, we dig into why the AI infrastructure conversation is shifting from compute scarcity to the memory wall. As large language models get bigger and enterprises move from training to high-volume inference, memory, storage, networking and GPU utilization are becoming critical to AI performance and economics.
Featuring insights from Jason Hardy of NVIDIA and Val Bercovici of WEKA, this episode breaks down why inference workloads are fundamentally different from training, how agentic AI increases pressure on memory systems, and why idle GPUs can turn into a costly problem for enterprises building AI factories.

Join host Diana Goovaerts and other Fierce Network editors as they explore the stories behind some of the hottest topics in tech and telecom. Want the inside scoop on broadband, wireless, artificial intelligence and cloud? You'll find it here.

Join host Diana Goovaerts and other Fierce Network editors as they explore the stories behind some of the hottest topics in tech and telecom. Want the inside scoop on broadband, wireless, artificial intelligence and cloud? You'll find it here.

Host Alejandro Piñero leads in-depth discussions on 5G connectivity, AI, networking and more.

The Five Nine

Join host Diana Goovaerts and other Fierce Network editors as they explore the stories behind some of the hottest topics in tech and telecom. Want the inside scoop on broadband, wireless, artificial intelligence and cloud? You'll find it here.