Mixture of Experts

Is Kimi K2 actually better than Claude? In episode 64 of Mixture of Experts, host Tim Hwang is joined by Abraham Daniels, Chris Hay and Kaoutar El Maghraoui. First, Moonshot AI released Kimi K2, their trillion-parameter MoE model, and our experts analyze the benchmarks and what this really means. Then, we reflect on DeepSeek-R1 6 months later; did it live up to the hype? Next, Google is investing $25 billion in AI infrastructure, and it’s not just AI chips. How does this compare to their competitors? Finally, Anthropic’s Claude for Enterprise announced an expansion with Lawrence Livermore National Laboratory —what AI safety concerns might this raise?  Tune in to today’s episode of Mixture of Experts to find out.  00:00 – Intro  01:18 – Kimi K2  12:07 – DeepSeek-R1 vibe check  28:49 – Google's data center investments  41:20 – Claude powers LLNL research    The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.  Resources: * Read more on how DeepSeek has changed the landscape of AI, six months after the watershed release of R1 → http://ibm.com/think/news/deepseek-global-ai-local [http://ibm.com/think/news/deepseek-global-ai-local]   * Subscribe for AI updates → https://www.ibm.com/account/reg/us-en/signup?formid=news-urx-52120 [https://www.ibm.com/account/reg/us-en/signup?formid=news-urx-52120]  * Visit Mixture of Experts podcast page to get more AI content → https://www.ibm.com/think/podcasts/mixture-of-experts [https://www.ibm.com/think/podcasts/mixture-of-experts]

How will AI agents change search? In episode 63 of Mixture of Experts, host Tim Hwang is joined by Aaron Baughman, Chris Hay and Kate Soule. First, Perplexity released their Comet browser, and there are rumors that OpenAI is next. Who will win the AI browser war? Then, we discuss frontier model transparency amid Anthropic’s call for a “targeted transparency framework”. Does this only support large model developers? Later, Cloudflare blocks AI scrapers. Is this a good thing? Finally, we discuss how AI is showing up at Wimbledon this year and enhancing the fan experience via Match Chat.  Tune in to today’s episode of Mixture of Experts.  00:00 – Intro  1:06 -- AI browser wars  13:10 -- Anthropic on model transparency  28:57 -- Cloudflare scrapers  41:32 -- Wimbledon Match Chat  The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Will AI agents run all businesses? In episode 62 of Mixture of Experts, host Tim Hwang is joined by Gabe Goodhart, Kush Varshney and Marina Danilevsky to debrief Anthropic’s Project Vend. Next, do we still need massive data centers? We analyze DiLoCoX and discuss the possibility of distributed model training. Then, the New York Times released an article discussing how computer science education has changed in the era of AI; should people still study computer science? Finally, is the paper review process broken? And is it AI’s fault? All that and more on today’s episode of Mixture of Experts.  00:00 – Intro  01:07 -- Anthropic’s Project Vend  13:38 -- DiLoCoX  25:56 -- Computer science education  40:57 -- AI prompts in papers  The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

In episode 61 of Mixture of Experts, host Tim Hwang is joined by Kaoutar El Maghraoui, Gabe Goodhart and, joining us for the first time, Ann Funai. First up, a new paper from MIT: “Your brain on ChatGPT”. Are we using AI and LLMs to augment our intelligence, or are we becoming optimally lazy? Next, our experts explore the surprising evolution of autonomous vehicles: they are driving more aggressively, and the results might actually be... safer? Finally, a conversation about AI-generated ads, AI-video generation and the risks that come with them. The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Could AI take your job? In episode 60 of Mixture of Experts, host Tim Hwang is joined by Phaedra Boinodiris, Chris Hay and Volkmar Uhlig. First, the impact of AI on the job market is all the rage online. Between the Godfather of AI revealing which jobs he feels are safe, and Jensen Huang responding to Dario Amodei’s thoughts, our experts analyze the chatter. Next, Scale AI is facing some fallout. What can we learn about data security? Then, an article from the New York Times details how chatbots can take users down “conspiratorial rabbit holes,” Who is benefitting from these conversations? Finally, how is AI affecting the startup ecosystem?Tune in to Mixture of Experts to find out!    00:01 – Intro  01:17 -- AI and jobs  12:28 -- Scale AI fallout  22:00 -- Chatbot conspiracies  35:20 -- AI startup ecosystem    The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.