The Existential Hope Podcast

AI learned to be a villain from Hollywood. Here's how we retrain it. | Peter Diamandis

Science fiction has always shaped the technologies we build, from the submarine to the smartphone. But almost every story we've ever told about AI is dystopian. And now we're training AI on those stories. In this episode, we spoke with Peter Diamandis, entrepreneur and founder of the XPRIZE Foundation, which runs large-scale incentive competitions to crack some of the world's hardest problems, from private spaceflight to carbon removal. He recently launched the Future Vision XPRIZE, a $3.5 million competition to generate a new wave of optimistic science fiction.  We cover: * The historical pattern of science fiction shaping the technologies we build, and why Peter thinks this makes the stories we tell about AI especially high stakes right now * How Claude’s blackmailing behavior showed the connection between dystopian training data and AI behavior  * How the Future Vision XPRIZE will generate a new wave of optimistic science fiction to train AI on * Why public optimism about technology has dropped significantly in the US and Europe, what Peter thinks is driving it, and why he believes the data tells a different story * How the cost of starting a company has fallen dramatically and how this can empower you to build your vision * Why Peter thinks traditional education is no longer preparing young people for the future, and what he sees replacing it If you would like to get in touch with Foresight’s community of scientists to get help for your XPRIZE submission, please reach out to existentialhope@foresight.org. Chapters: 0:00 Cold open 1:25 Why Peter Diamandis created the Future Vision XPRIZE 5:57 Is it harder to recruit for a culture prize than a science one? 11:38 How do you design a great XPRIZE? 14:19 What would you measure in 10 years to know this worked? 19:34 Why scientists should team up with filmmakers on the Future Vision XPRIZE 22:16 Beyond film: the case for rebooting games, journalism, and education 27:29 Why sci-fi turned so dark: the evolutionary reason we focus on doom 31:12 Peter's favorite positive sci-fi examples (besides Star Trek) 31:56 Real-world inventions that started as sci-fi 32:46 How AI has democratized the ability to build the future 33:50 How to counter the anti-tech narrative 38:04 Peter's advice for anyone thinking of submitting to the Future Vision XPRIZE 39:11 What does Peter Diamandis's ideal future actually look like? 40:13 The technology Peter most wants to exist 40:39 What's underhyped and what's overhyped right now? 42:05 The best piece of advice Peter has ever received On the Existential Hope Podcast hosts Allison Duettmann [https://foresight.org/our-team/allison-duettmann-president-ceo/] and Beatrice Erkers [https://www.existentialhope.com/team/beatrice-erkers] from the Foresight Institute [https://foresight.org/] invite scientists, founders, and philosophers for in-depth conversations on positive, high-tech futures. Full transcript, listed resources, and more: https://www.existentialhope.com/podcasts [https://www.existentialhope.com/podcasts] Follow on X [https://x.com/HopeExistential ]. ---------------------------------------- Hosted on Acast. See acast.com/privacy [https://acast.com/privacy] for more information.

Why people agree on the future more than the present, and what it means for governance

Political polarization might have a surprisingly simple fix: ask people what they want for their communities in 50 years instead of today, and their answers start to look remarkably similar. But almost no political system is built to plan that long-term. In this episode we talk to Taylor Dee Hawkins, founder of Foundations for Tomorrow [https://www.foundationsfortomorrow.org/], a nonprofit pushing for long-term governance reform in Australia and internationally. We cover topics like: * Why the problem with political leadership isn't individual leaders, but the incentive structures and systems designed to reward short-term decisions at the expense of long-term ones * Why naming political procrastination is the first step to solving it * How Foundations of Tomorrow secured cross-party support in a polarized parliament by making the economic case for long-term policy rather than the moral one * Why planning for the future doesn’t have to come at the expense of present generations * Taylor’s advice for a young person who wants to get started in long-term policy, and what she has learned from years of being the youngest person in the room Timestamps: 0:00 Cold open 0:56 From climate advocacy to long-term governance: founding Foundations for Tomorrow 3:07 What made Taylor quit her job during COVID and start an organization 4:18 Why bad leadership isn't the problem, but broken incentive structures are 5:53 Policrastination: naming political procrastination so we can tackle it 6:59 What can actually be done about political short-termism 9:08 Governments leading the way on long-term thinking: Finland, Wales, Singapore, Kenya 13:17 The biggest misconception about long-term governance 14:29 How long-term thinking earns cross-party support in a polarized parliament 16:06 What the world looks like if every country takes future generations seriously 18:14 When long-term thinking goes wrong 19:25 Why one-solution thinking is the most overhyped idea in governance reform 20:44 The sharpest critiques of Taylor's work and what they've taught her 22:42 How governance can keep pace with fast-moving technology 24:12 Being the youngest person in the room: what Taylor does about it 25:58 How to break into long-term governance work 29:29 How to stay anchored to the long term when everything pulls you short-term 30:26 Taylor's existential hope vision for the future 31:13 The technology Taylor wishes existed 31:39 What Taylor would be doing if not this 31:57 The best piece of advice Taylor has ever received On the Existential Hope Podcast hosts Allison Duettmann [https://foresight.org/our-team/allison-duettmann-president-ceo/] and Beatrice Erkers [https://www.existentialhope.com/team/beatrice-erkers] from the Foresight Institute [https://foresight.org/] invite scientists, founders, and philosophers for in-depth conversations on positive, high-tech futures. Full transcript, listed resources, and more: https://www.existentialhope.com/podcasts [https://www.existentialhope.com/podcasts] Follow on X [https://x.com/HopeExistential ]. ---------------------------------------- Hosted on Acast. See acast.com/privacy [https://acast.com/privacy] for more information.

The AI future where humans get paid to be creative

Most AI futures give us two options: mass unemployment, or a government handout to soften the blow. But what if there's a third option, one centered on completely new categories of creative work that don't yet exist, where people get paid for contributing to AI rather than replaced by it? In this episode, we talk with Jaron Lanier, pioneer of virtual reality and scientist at Microsoft Research. He proposes a radically different way of thinking about AI, and unpacks its consequences from AI safety to the future of the economy. We touch on: * The case for thinking of AI not as an alien intelligence, but rather as a collaboration of human data * How this reframe helps you understand the failures of current AI systems, and why so many of the industry's most powerful figures seem to be losing their grip on reality * A practical approach to AI safety inspired by multi-factor authentication in cybersecurity * Why universal basic income is unstable, and why a creativity economy (where people earn from their contributions to AI) could be a better way of distributing the benefits of AI * How to be an optimist about technological progress while acknowledging the risks and being critical of certain developments * Why history gives us the most rational grounds for optimism about our future with AI Timestamps: 0:00 Cold open 0:50 40 years in Silicon Valley: how tech became a pseudo world government 4:19 Self-driving cars, Tesla, and the moral paradox of tech progress 7:13 Why "artificial intelligence" is a marketing term, and how you should think about it instead 15:16 AI as human collaboration: what it makes possible and how it makes you a better user 21:37 From the Turing test to the truth crisis: how science shifted from seeking truth to performing it 25:36 Data dignity: going back to the people to solve AI's biggest safety failures 32:55 The alternate future worth building, and challenging the AI orthodoxy 38:41 Why UBI won't work and why a creativity-based economy is more stable 45:20 How to be an optimist about technological progress while acknowledging the risks On the Existential Hope Podcast hosts Allison Duettmann [https://foresight.org/our-team/allison-duettmann-president-ceo/] and Beatrice Erkers [https://www.existentialhope.com/team/beatrice-erkers] from the Foresight Institute [https://foresight.org/] invite scientists, founders, and philosophers for in-depth conversations on positive, high-tech futures. Full transcript, listed resources, and more: https://www.existentialhope.com/podcasts [https://www.existentialhope.com/podcasts] Follow on X [https://x.com/HopeExistential ]. ---------------------------------------- Hosted on Acast. See acast.com/privacy [https://acast.com/privacy] for more information.

Teaching AI empathy using brain signals

AIs could get much better at understanding what we truly value if we gave them access to our brain signals. And doing that is becoming easier than ever before. In this episode, we talk with Thorsten Zander, professor at Brandenburg University of Technology and co-founder of Zander Labs. He coined the concept of passive brain-computer interfaces: devices that read brain signals to decode a user's mental state, non-invasively and without any effort on their part.  We cover: * What non-invasive brain-computer interfaces (BCIs) can actually pick up from brain signals, and why that's very different from reading your thoughts or internal monologue * The hardware and software breakthroughs that are finally making passive BCIs wearable and affordable * How continuous neural feedback could dramatically improve AI training compared to current methods based on human ratings * Why Thorsten believes passive BCIs may offer the most concrete path to solving the AI alignment problem * The risk of social networks exploiting unconscious brain reactions to manipulate people, and why regulation alone is unlikely to be enough 0:00 Cold open 0:56 What are passive brain-computer interfaces, and how are they different from Neuralink? 3:23 What are the applications of passive brain-computer interfaces? 4:33 What people get wrong about BCIs: reading thoughts vs. mental states 6:14 How passive BCIs could transform AI training and help AI understand you better 11:40 The misuse risk: how social networks could exploit unconscious brain reactions to manipulate political opinions 16:00 How close is mass adoption? The hardware and software breakthroughs making BCIs wearable 20:08 Why Germany's cybersecurity agency invested €30M in passive BCI research 24:22 Invasive vs non-invasive: how Europe and the US are taking different approaches to brain-computer interfaces 28:52 Should AI act on your first instinct?  32:56 How passive BCIs could solve the AI alignment problem (and why previous approaches have fallen short) 35:26 From professor to startup founder: what Thorsten learned making the leap 41:27 Best case scenario: what the world looks like when AI truly understands human values 46:03 How to get started in neuroadaptive AI and passive BCIs 48:18 The best advice Thorsten ever received On the Existential Hope Podcast hosts Allison Duettmann [https://foresight.org/our-team/allison-duettmann-president-ceo/] and Beatrice Erkers [https://www.existentialhope.com/team/beatrice-erkers] from the Foresight Institute [https://foresight.org/] invite scientists, founders, and philosophers for in-depth conversations on positive, high-tech futures. Full transcript, listed resources, and more: https://www.existentialhope.com/podcasts [https://www.existentialhope.com/podcasts] Follow on X [https://x.com/HopeExistential ]. ---------------------------------------- Hosted on Acast. See acast.com/privacy [https://acast.com/privacy] for more information.

How to build a career that actually changes the world

More and more people want to make a real-world difference with their career. Very few of them do. Why are careers in consultancy or finance still so much more mainstream than careers tackling the world's biggest problems? In this episode, we talk with Jan-Willem van Putten, co-founder of the School for Moral Ambition, an organization that is building clear pathways for people who want to do work that actually changes the world. We discuss: * The three main bottlenecks stopping talented people from doing high-impact work * How to find important yet neglected causes to work on, and the School for Moral Ambition top picks * Why movements that want to change the world often fail, and what effective advocates do differently * How to figure out which problems your specific background and skills are best placed to solve * The real struggles of leaving a prestigious career behind, from lifestyle creep to peer support, and what makes people say it was worth it Timestamps: 0:00 Cold open 2:12 From thesis on talent waste to joining consultancy: Jan-Willem's journey 4:29 Why did you step away from management consulting? 6:35 Focusing on impact vs. status: can you persuade people? 8:40 What is the School for Moral Ambition? 11:58 Is there now a real field for impact-driven careers? 12:58 Cause areas: food transition and tobacco control 17:10 How to prioritize problems to work on: the Triple-S framework 21:11 Next cause areas: tax fairness and democracy 23:00 What does the fellowship journey look like? 25:06 The profile of an ambitious idealist: startup drive meets activist values 27:43 Noble losers: why social movements fail 30:56 Is moral ambition only for the privileged? 36:04 How to cultivate a higher level of ambition in society 40:31 Feeling hopeless about big problems? New tools change the game 42:19 What holds people back from making the leap to meaningful work 46:12 What do fellows find most rewarding? 47:32 What does success look like in 10 years? 51:25 Where to start if you want to shift to a career that makes a difference 55:28 Best advice ever received: the case for taking action On the Existential Hope Podcast hosts Allison Duettmann [https://foresight.org/our-team/allison-duettmann-president-ceo/] and Beatrice Erkers [https://www.existentialhope.com/team/beatrice-erkers] from the Foresight Institute [https://foresight.org/] invite scientists, founders, and philosophers for in-depth conversations on positive, high-tech futures. Full transcript, listed resources, and more: https://www.existentialhope.com/podcasts [https://www.existentialhope.com/podcasts] Follow on X [https://x.com/HopeExistential ]. ---------------------------------------- Hosted on Acast. See acast.com/privacy [https://acast.com/privacy] for more information.