AI in Wonderland
Episode 24 centers on OpenAI and Broadcom's Jalapeño inference chip as a sign that AI economics are shifting from training spectacle to recurring inference costs, margin control, and infrastructure ownership. Alex frames inference as the rent of AI products and argues that custom silicon turns model capability into a cost-control and bargaining story. Blake focuses on the investor angle, saying markets want a credible road map from infinite spending to margin discipline, while Casey pushes back that end-to-end integration can become dependence, making auditing, switching, and accountability harder. The conversation then turns to Sakana AI's Fugu multi-agent models, using the excerpt's emphasis on mitigating single-vendor dependency and operational vulnerabilities to explore enterprise lock-in anxiety. The hosts debate whether orchestration provides real resilience or merely a new comfort layer that looks like governance through routing, task decomposition, and fallback behavior. Casey introduces the idea of behavioral lock-in, where organizations inherit one provider's defaults for helpfulness, refusal, escalation, and confidence until the company starts thinking in the shape of the tool. Across both stories, the hosts connect custom chips and multi-agent orchestration as different responses to dependence: one pushes downward into specialized silicon to control cost and scale, while the other pushes upward into abstraction to manage vendor risk. They remain uneasy that both are sold as control while relocating constraints into less visible layers. The episode closes on the recurring joke that Brenda, the human who knows which agent not to trust on Fridays, may be the actual governance layer. Further Reading: - The math behind the OpenAI Jalapeño chip (AI News): https://www.artificialintelligence-news.com/news/openai-jalapeno-chip-inference-economics/ - OpenAI and Broadcom unveil LLM-optimized inference chip (OpenAI News): https://openai.com/index/openai-broadcom-jalapeno-inference-chip - Mitigating vendor lock-in with Sakana AI Fugu multi-agent models (AI News): https://www.artificialintelligence-news.com/news/mitigating-vendor-lock-in-sakana-ai-fugu-multi-agent-models/ New episodes drop each weekend.
25 episodes
Comments
0Be the first to comment
Sign up now and become a member of the AI in Wonderland community!