The case for a conditional AI safety treaty, with Otto Barten

London Futurists

London Futurists
The case for a conditional AI safety treaty, with Otto Barten
May 09, 2025 Season 1 Episode 113
London Futurists

How can a binding international treaty be agreed and put into practice, when many parties are strongly tempted to break the rules of the agreement, for commercial or military advantage, and when cheating may be hard to detect? That’s the dilemma we’ll examine in this episode, concerning possible treaties to govern the development and deployment of advanced AI.

Our guest is Otto Barten, Director of the Existential Risk Observatory, which is based in the Netherlands but operates internationally. In November last year, Time magazine published an article by Otto, advocating what his organisation calls a Conditional AI Safety Treaty. In March this year, these ideas were expanded into a 34-page preprint which we’ll be discussing today, “International Agreements on AI Safety: Review and Recommendations for a Conditional AI Safety Treaty”.

Before co-founding the Existential Risk Observatory in 2021, Otto had roles as a sustainable energy engineer, data scientist, and entrepreneur. He has a BSc in Theoretical Physics from the University of Groningen and an MSc in Sustainable Energy Technology from Delft University of Technology.

Selected follow-ups:


Music: Spike Protein, by Koi Discovery, available under CC0 1.0 Public Domain Declaration

Promoguy Talk Pills
Agency in Amsterdam dives into topics like Tech, AI, digital marketing, and more drama...

Listen on: Apple Podcasts   Spotify

Digital Disruption with Geoff Nielson
Discover how technology is reshaping our lives and livelihoods.

Listen on: Apple Podcasts   Spotify

Episode Artwork The case for a conditional AI safety treaty, with Otto Barten 38:12 Episode Artwork Humanity's final four years? with James Norris 49:36 Episode Artwork Human extinction: thinking the unthinkable, with Sean ÓhÉigeartaigh 43:05 Episode Artwork The best of times and the worst of times, updated, with Ramez Naam 45:45 Episode Artwork PAI at Paris: the global AI ecosystem evolves, with Rebecca Finlay 39:29 Episode Artwork AI agents: challenges ahead of mainstream adoption, with Tom Davenport 34:01 Episode Artwork Post-labour economics, with David Shapiro 43:59 Episode Artwork Longevity activism at 82, 86, and beyond, with Kenneth Scott and Helga Sands 46:20 Episode Artwork Models for society when humans have zero economic value, with Jeff LaPorte 42:11 Episode Artwork From ineffective altruism to effective altruism? with Stefan Schubert 34:43 Episode Artwork The global energy transition: an optimistic assessment, with Amory Lovins 35:05 Episode Artwork Building brain-like AIs, with Alexander Ororbia 48:18 Episode Artwork To sidestep death, preserve your connectome, with Ariel Zeleznikow-Johnston 42:32 Episode Artwork Insights from 15 years leading the self-driving vehicle industry, with Sterling Anderson 42:33 Episode Artwork The race for AI supremacy, with Parmy Olson 47:59 Episode Artwork A narrow path to a good future with AI, with Andrea Miotti 41:55 Episode Artwork Gen AI cuts costs by 30%: lessons from a leading law firm, with David Wakeling 36:01 Episode Artwork Climate change and populism: Grounds for optimism? with Matt Burgess 39:54 Episode Artwork Rejuvenation biotech - progress and potential, with Karl Pfleger 46:13 Episode Artwork ChatGPT runs for president, with Pedro Domingos 50:33 Episode Artwork The rise of digital pandemics, with James Ball 40:40 Episode Artwork Thinking more athletically about the future, with Brett King and Rob Tercek 56:34 Episode Artwork The low-cost future of preserving brains, with Jordan Sparks 39:04 Episode Artwork Surveillance and diversity: surprising insights from the Gulf, with Holly Joint 36:07 Episode Artwork The double-edged sword of technology, with Wendell Wallach 55:02