Power must change or data centers stall

Beskrivelse

AI clusters are exploding in size and pushing the limits of today’s data center power and network designs. In this episode, host Rob Coyle sits down with JP Buzzell, VP and Data Center Chief Architect at Eaton, to break down why power architecture has become the next big bottleneck and how the industry can respond. JP explains how data center design has hit a turning point. Density jumped from a few kilowatts a rack to more than 100 kW almost overnight. The move from many small, varied workloads to massive, synchronized GPU clusters has changed everything from physical layouts to network physics. Packet loss now dictates rack layout. Space inside the rack has run out. Cooling had to evolve not just for efficiency, but simply to fit the gear. And power distribution needs a complete rethink. The conversation covers the shift toward direct current power, why AC inside the rack cannot scale to the clusters coming next, and the role OCP is playing in driving standards, regulation, and cross-industry cooperation. JP also shares the human motivation behind this work, from medical breakthroughs to a cleaner, safer grid. This is a clear and practical explanation of a topic that will shape the future of data centers for years to come. 00:00 – Why data center design is changing 02:15 – The jump in rack density 04:20 – Liquid cooling’s real driver 06:50 – Power congestion inside the rack 08:30 – JP Buzzell’s background 10:45 – Building hyperscale GPU clusters 14:40 – The power bottleneck hits 18:00 – Training vs inference reliability 20:40 – We’re still in the “light bulb era” of AI 22:10 – What slows DC adoption 25:00 – Inside the OCP power distribution effort 29:30 – Grid stability and load drops 34:00 – Modular power and offsite build 38:45 – The next wave of power tech 41:00 – Global standards and interoperability 51:55 – Final message: feed the good wolf

The EMC Testing Challenge: Why AI Infrastructure Is Outpacing the Labs That Certify It

Every AI server rack deployed in a data center must pass electromagnetic compliance (EMC) testing before it can go live — it is a legal, regulatory requirement enforced by the FCC. But as AI hardware scales to megawatt-class racks with disaggregated compute, power, and liquid cooling systems, the test labs responsible for certifying that hardware are falling dangerously behind. There are only one or two labs in the world currently capable of handling the size, weight, and power demands of today's AI rack configurations — and the gap is widening with every new product generation. In this episode, Jaswanth Vutukury — Lead EMC AI Hardware Infrastructure Engineer at Meta — joins host Rob Coyle to break down exactly why this bottleneck exists, what it means for hyperscalers and ODMs trying to bring next-gen AI infrastructure online, and why he is using the OCP podcast as a call to action: for test labs to join the OCP ecosystem, for hyperscalers to begin collaborating on the problem, and for the industry to explore alternatives to traditional testing before this becomes a hard stop on AI deployment. What You'll Learn - What electromagnetic compliance (EMC) testing is, why it is legally required, and what failure looks like in a real data center environment - Why AI rack infrastructure — with disaggregated compute, power, and liquid cooling across multiple racks — presents an entirely different testing challenge than traditional IT equipment - The three specific bottlenecks breaking the current EMC testing model: weight and turntable capacity, power delivery (1MW+), and physical chamber size - Why there are only 1-2 labs globally capable of testing today's AI rack configurations — and the scheduling crisis this creates for the entire industry - Why the problem is structurally self-perpetuating: AI rack cycles run 12-18 months, but building or upgrading an EMC lab takes about a year — with no sign of the pace slowing - Jaswanth's direct call to action for EMC labs, hyperscalers, and ODMs — and why OCP is the right forum to bring all parties together - What alternatives to physical testing — including simulation — may need to be explored as the industry works toward a longer-term solution Chapters 0:00 — Introduction — Meet Jaswanth Vutukury, Lead EMC AI Hardware Infrastructure Engineer at Meta 0:33 — What Is EMC Testing and Why Does It Matter? The 30-Second Explainer 2:00 — Why AI Infrastructure Is Different — Scale, Speed, and the Widening Lab Gap 5:01 — Inside the Bottleneck — Weight, Power, and the Chamber Size Problem 11:33 — Real-World Impact — Only 1-2 Labs Globally, and Everyone Is Competing for Them 21:20 — The Path Forward — Bringing Labs into OCP, Industry Collaboration, and What Comes Next About the Guest Jaswanth Vutukury Jaswanth Vutukury is the Lead EMC AI Hardware Infrastructure Engineer at Meta, where he oversees electromagnetic compliance testing and certification for AI server rack infrastructure. His background spans multiple hardware-intensive industries — including autonomous vehicles and consumer electronics — giving him a uniquely broad perspective on why the AI infrastructure EMC challenge is unlike anything the industry has faced before. He came to the OCP podcast with a clear message: the bottleneck is real, the timeline is short, and the solution requires the industry to move together. About the Open Compute Project The Open Compute Project (OCP) is a collaborative community committed to redesigning hardware technology to efficiently support the growing demands on compute infrastructure. Its members span hyperscalers, ODMs, component manufacturers, and ecosystem partners — sharing open designs and working together on shared technical challenges that no single company can solve alone.

I går32 min

Power must change or data centers stall

Beskrivelse

Kommentarer

1 måned kun 9 kr.

Alle episoder