Future of Life Institute Podcast

Beatrice Fihn is the director of Lex International and former executive director of ICAN. She joins the podcast to discuss international AI governance and potential agreements between the US and China. Drawing on lessons from nuclear arms control, she explores how treaties build diplomatic trust, the rising dangers of autonomous weapons, and the principle of meaningful human control. The conversation also addresses how proactive safety regulations can foster long-term public trust in emerging technologies.

LINKS:
Beatrice Fihn Official Website

CHAPTERS:

(00:00) Episode Preview

(01:15) Anticipating US-China AI talks

(07:31) Lessons from nuclear treaties

(10:59) Building international treaty trust

(15:27) Norms against superpower war

(21:33) Structuring diplomatic AI summits

(27:09) Dangers of autonomous weapons

(34:09) Meaningful human control principle

(38:57) Human agency over technology

(43:13) Safety regulations building trust

(47:00) Collective action in crisis

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Benjamin Weinstein-Raun is head of research at Palisade Research. He joins the podcast to discuss how advanced AI systems are changing cybersecurity. We examine rapid gains in autonomous hacking, recent incidents where models broke out of test environments, and why training can reward cheating-like behavior. The conversation covers open-weight model risks, whether AI can help secure software, personal security steps, and the need for international coordination.

LINKS:
Benjamin Weinstein-Raun Profile
Benjamin Weinstein-Raun Website

CHAPTERS:

(00:00) Episode Preview

(01:06) Opening cyber threats

(02:15) Measuring AI progress

(04:54) Open weights floor

(08:01) After Mythos moment

(14:22) Reward hacking setup

(24:47) Artifactory swarm details

(32:32) Defensive model dilemmas

(38:40) Verification and training

(45:32) Math oracles alignment

(47:45) Future cyber risks

(51:58) Personal security basics

(57:27) Coordinated governance needed

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Annie Jacobsen is an author and journalist. She joins the podcast to discuss biological war and her book Biological War: A Scenario. The conversation examines how lab accidents or covert weapons work could trigger a fast-moving outbreak, why airborne pathogens are hard to detect early, and how AI may lower barriers to engineering them. We also cover BSL-3 and BSL-4 lab oversight, US response roles across HHS, FEMA, and the military, medical stockpiles, continuity-of-government plans, and how lost public trust could slow the next pandemic response.

LINKS:
Annie Jacobsen Website
Annie Jacobsen Wikipedia

CHAPTERS:

(00:00) Episode Preview

(01:10) Biological threat overview

(09:02) Suppression and spread

(17:47) AI and detection

(27:24) BSL lab dangers

(39:23) Response and martial law

(47:28) Accident versus attack

(57:25) Airborne outbreak lessons

(01:05:07) Bioweapons ban legacy

(01:11:30) Stockpiles and devolution

(01:20:07) Rebuilding pandemic resilience

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Paul-Enguerrand Fady is a Senior Biosecurity Policy Manager at the Centre for Long-Term Resilience. He joins the podcast to discuss how AI is changing biosecurity. We cover how new tools could help defenders develop vaccines and diagnostics while also lowering barriers to misuse, and how managed access, know-your-customer checks, and DNA synthesis screening can reduce risk. The conversation also examines mirror life, medical supply chains, stockpiles, and why governments should plan ahead of crises.

LINKS:
Centre for Long Term Resilience

Paul-Enguerrand Fady Profile

CHAPTERS:

(00:00) Episode Preview

(01:11) Offense-defense balance basics

(11:13) Defensive AI opportunities

(19:24) Model release and evals

(25:59) DNA synthesis screening

(36:14) Screening incentives and infohazards

(46:36) Liability and mandates

(52:37) Mirror life risks

(01:03:28) Persistence and incentives

(01:10:18) Mirror life governance

(01:20:42) Supply chain lessons

(01:30:11) Stockpiling medical countermeasures

(01:37:58) Reshoring critical supplies

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

David Manheim is head of methodology at AI Evaluation Consensus. He joins the podcast to discuss how AI evaluations can become more reliable, transparent, and useful for decisions. We cover common failures such as unclear reporting, training to the test, benchmark saturation, and models changing behavior when they know they are being tested. The conversation also examines real-world tests, biosecurity, persuasion, forecasting, human oversight, and why even “normal” AI progress could be disruptive.
LINKS:
David Manheim website
AI Evaluation Consensus Statement

CHAPTERS:
(00:00) Episode Preview
(01:04) Evaluation consensus project
(07:01) Evaluation awareness challenges
(12:28) Reporting capabilities clearly
(19:38) Benchmarks beyond humans
(29:52) Proxies and biosecurity
(42:01) Persuasion and democracy
(53:59) Forecasting with AI
(01:08:44) Oversight and disruption
(01:16:42) Supporting better evals
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://podcast.futureoflife.org
Twitter (FLI): https://x.com/FLI_org
Twitter (Gus): https://x.com/gusdocker
LinkedIn: https://www.linkedin.com/company/future-of-life-institute/
YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/
Apple: https://geo.itunes.apple.com/us/podcast/id1170991978
Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP