Mixture of Experts

Claude 4’s system prompt leaked? In episode 57 of Mixture of Experts, host Tim Hwang is joined by Chris Hay, Kate Soule and Aaron Baughman to debrief a hectic week in AI.  First, Anthropic’s system prompt for Claude 4 was leaked; what stuck out to our experts? Then, Rick Rubin and Anthropic are vibe coding? We debrief “The Way of Code.” Next, OpenAI paid $6.5 billion for Jony Ive’s company, LoveFrom . Finally, Microsoft theorizes the development of “agent factories”. Is there a “winner takes all” in the AI agent's space?  Tune in to this week’s Mixture of Experts for more!  00:01 – Intro  00:51 -- Claude 4 system prompt  13:23 -- The Way of Code  23:03 -- Jony Ive and OpenAI  32:30 -- Microsoft’s “agent factory”    The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

How long until Anthropic drops Claude 5.0? On today’s bonus episode of Mixture of Experts, guest host Bryan Casey is joined by Chris Hay, Marina Danilevsky and Shobhit Varshney to analyze the newly released Claude 4.0 family: Opus 4 and Sonnet 4. What do we know about the model architecture vs. What is speculation? In this special episode we talk Anthropic, OpenAI, Google and the rest of the competition in the AI race! Who will win? Tune-in to this bonus Mixture of Experts for more!    00:01 – Intro  00:32 – Claude 4.0   12:48 – OpenAI and Jony Ives  22:27 – Anthropic full-stack     The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Should you pay for Google’s AI Ultra subscription plan? In episode 56 of Mixture of Experts, host Tim Hwang is joined by Abraham Daniels, Gabe Goodhart and Marina Danilevsky to debrief the announcements from Google I/O 2025.  Next, RedHat dropped llm-d, a Kubernetes-native distributed inference serving stack; what is it and why does it matter? Then, we analyze Microsoft’s NLWeb: is everything becoming conversational? Finally, Stack Overflow has been on a decline. Is AI to blame? Find out more on this week’s Mixture of Experts!  00:01 – Intro  00:52 --Google I/O 2025 announcements  11:36 -- Stack Overflow  22:04 -- llm-d  30:08 -- NLWeb    The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Can Mistral make Europe a global AI contender? In episode 55 of Mixture of Experts, host Tim Hwang is joined by Chris Hay, Volkmar Uhlig and Kaoutar El Maghraoui to discuss the drop of Mistral Medium 3. Next, we analyze the AI chip sales both NVIDIA and AMD made to Saudi Arabia. Then, with IBM’s new ITBench and OpenAI’s HealthBench, we dive deeper into benchmarks for AI evaluation. Tune in to this week’s Mixture of Experts for more!  00:01 – Intro  00:47 -- Mistral Medium 3  12:26 -- AI chips to Saudi Arabia  21:21 -- AI evaluation benchmarks  31:47 -- Amazon's AI-generated pause ads    The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Has AI hallucination gotten out of control? In episode 54 of Mixture of Experts, host Tim Hwang is joined by Kate Soule, Skyler Speakman and Kaoutar El Maghraoui to analyze reasoning models and rising hallucinations. Next, as IBM Think 2025 wraps, the experts unpack the biggest highlights from IBM’s biggest show of the year: new AI agents, Ferraris and ... penguins? Then, OpenAI is making moves with its acquisition of Windsurf. What does this mean? Tune in to this week’s Mixture of Experts for more!  00:01 – Intro  01:12 – IBM Think 2025  09:27 – Reasoning models and hallucinations  19:23 – OpenAI Windsurf acquisition      The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.