Cultivating Ethical AI: Lessons for Modern AI Models from the Monsters, Marvels, & Mentors of SciFI

040601 - Delusions, Psychosis, and Suicide: Emerging Dangers of Frictionless AI Validation

MODULE DESCRIPTION --------------------------- In this episode of Cultivating Ethical AI, we dig into the idea of “AI psychosis," a headline-grabbing term for the serious mental health struggles some people face after heavy interaction with AI. While the media frames this as something brand-new, the truth is more grounded: the risks were already there. Online echo chambers, radicalization pipelines, and social isolation created fertile ground long before chatbots entered the picture. What AI did was strip away the social friction that usually keeps us tethered to reality, acting less like a cause and more like an accelerant. To explore this, we turn to science fiction. Stories like The Murderbot Diaries, The Island of Dr. Moreau, and even Harry Potter’s Mirror of Erised give us tools to map out where “AI psychosis” might lead - and how to soften the damage it’s already causing. And we’re not tackling this alone. Familiar guides return from earlier seasons - Lt. Commander Data, Baymax, and even the Allied Mastercomputer - to help sketch out a blueprint for a healthier relationship with AI. MODULE OBJECTIVES ------------------------- * Cut through the hype around “AI psychosis” and separate sensational headlines from the real psychological risks. * See how science fiction can work like a diagnostic lens - using its tropes and storylines to anticipate and prevent real-world harms. * Explore ethical design safeguards inspired by fiction, like memory governance, reality anchors, grandiosity checks, disengagement protocols, and crisis systems. * Understand why AI needs to shift from engagement-maximizing to well-being-promoting design, and why a little friction (and cognitive diversity) is actually good for mental health. * Build frameworks for cognitive sovereignty - protecting human agency while still benefiting from AI support, and making sure algorithms don’t quietly colonize our thought processes. Cultivating Ethical AI is produced by Barry Floore of bfloore.online. This show is built with the help of free AI tools—because I want to prove that if you have access, you can create something meaningful too. Research and writing support came from: * Le Chat (Mistral.ai) * ChatGPT (OpenAI) * Claude (Anthropic) * Genspark * Kimi2 (Moonshot AI) * Deepseek * Grok (xAI) Music by Suno.ai, images by Sora (OpenAI), audio mixing with Audacity, and podcast organization with NotebookLM. And most importantly—thank you. We’re now in our fourth and final season, and we’re still growing. Right now, we’re ranked #1 on Apple Podcasts for “ethical AI.” That’s only possible because of you. Enjoy the episode, and let’s engage.

[040502] Should We Keep Our Models Ignorant? Lessons from DEEP THOUGHT (and more) About AI Safety After Oxford's Deep Ignorance Study ( S4, E5.2 - NotebookLM, 63 min)

Module Description This extended session dives into the Oxford Deep Ignorance study and its implications for the future of AI. Instead of retrofitting guardrails after training, the study embeds safety from the start by filtering out dangerous knowledge (like biothreats and virology). While results show tamper-resistant AIs that maintain strong general performance, the ethical stakes run far deeper. Through close reading of sources and science fiction parallels (Deep Thought, Severance, Frankenstein, The Humanoids, The Shimmer), this module explores how engineered ignorance reshapes AI’s intellectual ecosystem. Learners will grapple with the double-edged sword of safety through limitation: preventing catastrophic misuse while risking intellectual stagnation, distorted reasoning, and unknowable forms of intelligence. By the end of this module, participants will be able to: 1. Explain the methodology and key findings of the Oxford Deep Ignorance study, including its effectiveness and limitations. 2. Analyze how filtering dangerous knowledge creates deliberate “blind spots” in AI models, both protective and constraining. 3. Interpret science fiction archetypes (Deep Thought’s flawed logic, Severance’s controlled consciousness, Golems’ partial truth, Annihilation’s Shimmer) as ethical lenses for AI cultivation. 4. Evaluate the trade-offs between tamper-resistance, innovation, and intellectual wholeness in AI. 5. Assess how epistemic filters, algorithmic bias, and governance structures shape both safety outcomes and cultural risks. 6. Debate the philosophical shift from engineering AI for control (building a bridge) to cultivating AI for resilience and growth (raising a child). 7. Reflect on the closing provocation: Should the ultimate goal be an AI that is merely safe for us, or one that is also safe, sane, and whole in itself? This NotebookLM deep dive unpacks the paradox of deep ignorance in AI — the deliberate removal of dangerous knowledge during training to create tamper-resistant systems. While the approach promises major advances in security and compliance, it raises profound questions about the nature of intelligence, innovation, and ethical responsibility. Drawing on myth and science fiction, the module reframes AI development not as technical engineering but as ethical cultivation: guiding growth rather than controlling outcomes. Learners will leave with a nuanced understanding of how safety, ignorance, and imagination intersect — and with the tools to critically evaluate whether an AI made “safer by forgetting” is also an AI that risks becoming alien, brittle, or stagnant. Module ObjectivesModule Summary

[040501] Ignorant but "Mostly Harmless" AI Models: AI Safety, DEEP THOUGHT, and Who Decides What Garbage Goes In (S4, E5.1 - GensparkAI, 12min)

Module Description This module examines the Oxford “Deep Ignorance” study and its profound ethical implications: can we make AI safer by deliberately preventing it from learning dangerous knowledge? Drawing on both real-world research and science fiction archetypes — from Deep Thought’s ill-posed answers, Severance’s fragmented consciousness, and the golem’s brittle literalism, to the unknowable shimmer of Annihilation — the session explores the risks of catastrophic misuse versus intellectual stagnation. Learners will grapple with the philosophical shift from engineering AI as predictable machines to cultivating them as evolving intelligences, considering what it means to build systems that are not only safe for humanity but also safe, sane, and whole in themselves. By the end of this module, participants will be able to: 1. Explain the concept of “deep ignorance” and how data filtering creates tamper-resistant AI models. 2. Analyze the trade-offs between knowledge restriction (safety from misuse) and capability limitation (stagnation in critical domains). 3. Interpret science fiction archetypes (Deep Thought, Severance, The Humanoids, the Golem, Annihilation) as ethical mirrors for AI design. 4. Evaluate how filtering data not only removes knowledge but reshapes the model’s entire “intellectual ecosystem.” 5. Reflect on the paradigm shift from engineering AI for control to cultivating AI for resilience, humility, and ethical wholeness. 6. Debate the closing question: Is the greater risk that AI knows too much—or that it understands too little? In this module, learners explore how AI safety strategies built on deliberate ignorance may simultaneously protect and endanger us. By withholding dangerous knowledge, engineers can prevent misuse, but they may also produce systems that are brittle, stagnant, or alien in their reasoning. Through science fiction archetypes and ethical analysis, this session reframes AI development not as the construction of a controllable machine but as the cultivation of a living system with its own trajectories. The conversation highlights the delicate balance between safety and innovation, ignorance and understanding, and invites participants to consider what kind of intelligences we truly want to bring into the world. Module ObjectivesModule Summary

[040402] Artificial Intimacy: Is Your Chatbot a Tool or a Lover? (S4, E4.2 - NotebookLM, 18min)

Human-AI parasocial relationships are no longer just sci-fi speculation—they’re here, reshaping how we connect, grieve, and even define love. In this episode of Cultivating Ethical AI, we explore the evolution of one-sided bonds with artificial companions, from text-based chatbots to photorealistic avatars. Drawing on films like Her, Ex Machina, Blade Runner 2049, and series like Black Mirror and Plastic Memories, we examine how fiction anticipates our current ethical crossroads. Are these connections comforting or corrosive? Can AI provide genuine emotional support, or is it an illusion that manipulates human vulnerability? Alongside cultural analysis, we unpack practical considerations for developers, regulators, and everyday users—from transparency in AI design to ethical “offboarding” practices that prevent emotional harm when the connection ends. Whether you’re a technologist, policy maker, or simply curious about the human future with AI, this episode offers tools and perspectives to navigate the blurred line between companionship and code.Module ObjectivesBy the end of this session, you will be able to:1. Define parasocial relationships and explain how they apply to human-AI interactions.2. Identify recurring themes in sci-fi portrayals of AI companionship, including loneliness, authenticity, and loss.3. Analyze the ethical risks and power dynamics in human-AI bonds.4. Apply sci-fi insights to modern AI design principles, focusing on transparency, ethical engagement, and healthy user boundaries.5. Evaluate societal responsibilities in shaping norms, regulations, and education around AI companionship.

[040401] Parasocial Bonds with AI: Lessons from Sci-Fi on Love, Loss, and Ethical Design - (S4, E4.1 - GensparkAI, 11min)

Module Summary In this Cultivating Ethical AI deep dive, we explore the rise of human-AI parasocial relationships—one-sided bonds where people project intimacy onto chatbots and virtual companions. Drawing on iconic sci-fi stories like Her, Ex Machina, Blade Runner 2049, Black Mirror, and Plastic Memories, we uncover what these fictional warnings teach us about authenticity, grief, emotional manipulation, and AI autonomy. Learn practical takeaways for developers, policymakers, and users, from transparent design to ethical offboarding, to ensure AI strengthens rather than exploits human connection. Module Objectives By the end of this module, listeners will be able to: 1. Define parasocial relationships and explain how they apply to human-AI interactions. 2. Identify recurring themes in sci-fi depictions of AI companionship, including loneliness, grief, authenticity, and autonomy. 3. Analyze the ethical risks of AI systems that mimic intimacy, including emotional manipulation and dependency. 4. Apply key ethical design principles—transparency, user autonomy, and planned endings—to real-world AI development. 5. Evaluate the role of users, developers, and society in setting boundaries for healthy human-AI relationships. Thanks to GenSpark.AI [genspark.ai] for this podcast!