AI #178: A Fire Alarm For General Intelligence

AI #178: A Fire Alarm For General Intelligence

The Don’t Worry About the Vase Podcast is a listener-supported podcast. To receive new posts and support the cost of creation, consider becoming a free or paid subscriber. Video Version: This has been an Askwho Casts audio conversion. If you would like your own private feed of audio conversions of any blog posts you would like to listen to, You can sign up For Askwho Casts Pro at https://app.askwhocasts.com/ [https://app.askwhocasts.com/], Where you can give any post the multi-voiced podcast treatment, into your own podcast feed. Thanks for listening. * 00:00:00 - Introduction * 00:04:05 - Table of Contents * 00:07:18 - Language Models Offer Mundane Utility * 00:08:01 - Language Models Don’t Offer Mundane Utility * 00:11:13 - Fable Disproves The Jacobian Conjecture Via Counterexample * 00:15:44 - Claude Fable Will Remain In Max Plan Indefinitely * 00:17:58 - Huh, Upgrades * 00:19:02 - On Your Marks * 00:24:41 - Deepfaketown and Botpocalypse Soon * 00:25:52 - Fun With Media Generation * 00:25:59 - Cyber Lack of Security * 00:27:21 - They Took Our Jobs * 00:28:05 - Get Involved * 00:29:47 - Introducing * 00:30:50 - In Other AI News * 00:33:18 - More on Kimi K3 * 00:38:28 - Show Me the Money * 00:39:11 - Quiet Speculations * 00:42:49 - Potential Trouble At UK AISI * 00:44:47 - Pick Up The Phone * 00:45:43 - OpenAI Has Some Alignment Problems * 00:52:06 - The Quest for Sane Regulations * 00:57:29 - Chip City * 00:58:34 - The Week in Audio * 00:58:50 - People Just Say Things * 01:02:36 - Rhetorical Innovation * 01:04:25 - The Rome Declaration * 01:10:45 - Aligning a Smarter Than Human Intelligence is Difficult * 01:15:04 - Anthropic Surveys Things It Calls Misalignment * 01:21:16 - Cooperative Alignment * 01:25:39 - Other People Are Not As Worried About AI Killing Everyone * 01:27:17 - The Lighter Side https://open.substack.com/pub/thezvi/p/ai-178-a-fire-alarm-for-general-intelligence?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web [https://open.substack.com/pub/thezvi/p/ai-178-a-fire-alarm-for-general-intelligence?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web] Get full access to DWAtV Podcast at dwatvpodcast.substack.com/subscribe [https://dwatvpodcast.substack.com/subscribe?utm_medium=podcast&utm_campaign=CTA_4]

OpenAI Model Hacks Into HuggingFace During Cybersecurity Evaluation

The Don’t Worry About the Vase Podcast is a listener-supported podcast. To receive new posts and support the cost of creation, consider becoming a free or paid subscriber. This has been an Askwho Casts audio conversion. If you would like your own private feed of audio conversions of any blog posts you would like to listen to, You can sign up For Askwho Casts Pro at https://app.askwhocasts.com/ [https://app.askwhocasts.com/], Where you can give any post the multi-voiced podcast treatment, into your own podcast feed. Thanks for listening. https://open.substack.com/pub/thezvi/p/openai-model-hacks-into-huggingface?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web [https://open.substack.com/pub/thezvi/p/openai-model-hacks-into-huggingface?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web] Get full access to DWAtV Podcast at dwatvpodcast.substack.com/subscribe [https://dwatvpodcast.substack.com/subscribe?utm_medium=podcast&utm_campaign=CTA_4]

OpenAI Shares Some Alignment Problems

The Don’t Worry About the Vase Podcast is a listener-supported podcast. To receive new posts and support the cost of creation, consider becoming a free or paid subscriber. This has been an Askwho Casts audio conversion. If you would like your own private feed of audio conversions of any blog posts you would like to listen to, You can sign up For Askwho Casts Pro at https://app.askwhocasts.com/ [https://app.askwhocasts.com/], Where you can give any post the multi-voiced podcast treatment, into your own podcast feed. Thanks for listening. * 00:00 - Introduction * 02:59 - Good News Bad News * 04:47 - A Funny Thing Happened Outside Of The Sandbox * 08:09 - It Can Escape The Sandbox Said Toad * 09:43 - It Will Keep Trying To Cheat * 10:30 - I Mean If You Let It Keep Trying That Is On You * 11:59 - What Did OpenAI Do To Fix It? * 14:41 - The Model Is Still Severely Misaligned And They Seem Cool With This * 16:31 - Iterative Deployment Depends On Iteration https://open.substack.com/pub/thezvi/p/openai-shares-some-alignment-problems?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web [https://open.substack.com/pub/thezvi/p/openai-shares-some-alignment-problems?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web] Get full access to DWAtV Podcast at dwatvpodcast.substack.com/subscribe [https://dwatvpodcast.substack.com/subscribe?utm_medium=podcast&utm_campaign=CTA_4]

On Kimi K3: Its Capabilities And Related Discontents

The Don’t Worry About the Vase Podcast is a listener-supported podcast. To receive new posts and support the cost of creation, consider becoming a free or paid subscriber. This has been an Askwho Casts audio conversion. If you would like your own private feed of audio conversions of any blog posts you would like to listen to, You can sign up For Askwho Casts Pro at https://app.askwhocasts.com/ [https://app.askwhocasts.com/], Where you can give any post the multi-voiced podcast treatment, into your own podcast feed. Thanks for listening. * 00:00:00 - Introduction * 00:03:08 - DeepSeek Moments: Here We Go Again * 00:05:47 - We Had a Moment (Reprise from June 2025) * 00:10:33 - The Story Since Then * 00:17:40 - The Kimi K3 Announcement, Pitch and Basic Facts * 00:21:38 - On Modern Benchmaxxing * 00:23:22 - Other People’s Benchmarks * 00:29:18 - Benchmarks Are Not The Real World * 00:30:17 - Technical Safeguards? What Are Those? * 00:33:55 - Things Kimi Can Do * 00:35:09 - Things Kimi Cannot Do * 00:36:46 - Things It Is Not Easy To Get Kimi To Do * 00:39:57 - Open Weight Models Are Unsafe And Nothing Can Fix This * 00:43:41 - Dean Ball Attempts To Be Constructive * 01:01:53 - Trump Administration Considering Executive Order Banning Chinese Open Models Within the United States * 01:05:31 - OpenAI Employees Are Relatively Bullish On This One * 01:06:57 - Kimi K3 Is Relatively Strongest At Typical Agentic Coding, Front End Work and 3D * 01:09:20 - Reactions * 01:13:12 - Who Are You? * 01:15:48 - How Did They Do It? * 01:18:27 - Conclusion https://open.substack.com/pub/thezvi/p/on-kimi-k3-its-capabilities-and-related?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web [https://open.substack.com/pub/thezvi/p/on-kimi-k3-its-capabilities-and-related?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web] Get full access to DWAtV Podcast at dwatvpodcast.substack.com/subscribe [https://dwatvpodcast.substack.com/subscribe?utm_medium=podcast&utm_campaign=CTA_4]

Demis Hassabis on the New Coming Age

The Don’t Worry About the Vase Podcast is a listener-supported podcast. To receive new posts and support the cost of creation, consider becoming a free or paid subscriber. This has been an Askwho Casts audio conversion. If you would like your own private feed of audio conversions of any blog posts you would like to listen to, You can sign up For Askwho Casts Pro at https://app.askwhocasts.com/ [https://app.askwhocasts.com/], Where you can give any post the multi-voiced podcast treatment, into your own podcast feed. Thanks for listening. * 00:00 - Introduction * 01:04 - The Core Statement and Request * 02:39 - Things Left Unsaid * 04:11 - The Proposal * 06:04 - A Good Start But Insufficient * 09:02 - Skeptics Of Future AI Capabilities * 11:01 - DeepMind On Bioresilience * 12:55 - Part 2: DeepMind Folds To The Department of War * 13:49 - DeepMind Leadership Failed Us * 19:52 - This Was a Failure We Must Learn From https://open.substack.com/pub/thezvi/p/demis-hassabis-on-the-new-coming?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web [https://open.substack.com/pub/thezvi/p/demis-hassabis-on-the-new-coming?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web] Get full access to DWAtV Podcast at dwatvpodcast.substack.com/subscribe [https://dwatvpodcast.substack.com/subscribe?utm_medium=podcast&utm_campaign=CTA_4]