Stay informed

AI Alignment Forum (AF)

Hub for researchers to discuss ideas related to ensuring that transformatively powerful AIs are aligned with human values. Discussion ranges from technical models of agency to the strategic landscape, and everything in between.

Type

Forum

LessWrong (LW)

Online forum dedicated to improving human reasoning, containing a lot of AI safety content. AI Alignment Forum posts are cross-posted here so anyone, not just approved researchers, can engage with the research.

Type

Forum

Dwarkesh Podcast

Well-researched interviews with influential intellectuals going in-depth on AI, technology, and their broader societal implications. Hosted by Dwarkesh Patel.

Type

Podcast

Robert Miles AI Safety

Visually-rich explanations of AI safety concepts – highlighting risks, clarifying advanced topics, and advocating for responsible development.

Type

YouTube channel

Rational Animations

Animated videos aiming to foster good thinking, promote altruistic causes, and help ensure humanity's future goes well – particularly regarding AI safety.

Type

YouTube channel

AI Explained

YouTuber discussing the latest AI developments as they happen, offering clear explanations and in-depth analysis of important research and events.

Type

YouTube channel

The Inside View

Interviews with AI safety researchers, explainers, fictional stories of concrete threat models, and paper walk-throughs.

Type

YouTube channel

AI X-risk Research Podcast (AXRP)

Interviews with technical AI safety researchers about their research, aiming to get a sense of why it was written and how it might reduce existential risk from AI.

Type

Podcast

Don't Worry about the Vase

Blog by Zvi Mowshowitz on various topics including AI, often with detailed analysis, personal insights, and a rationalist perspective.

Type

Blog

AGI Safety Core

A followable list of accounts on Twitter/X belonging to AI thinkers and organizations that discuss AI safety.

Type

Twitter/X account

Effective Altruism Forum (EA Forum)

Online forum where individuals dedicated to doing the most good converge to share research, debate ideas, and collaboratively develop strategies for addressing the world’s most pressing challenges – including AI safety.

Type

Forum

Deadly by Default

A primer on existential risk from AI on the Homo Sabiens blog. Lays out the case for concern from start to finish, in language that a smart high-schooler could follow.

Type

Article

The Compendium

Living document aiming to present a coherent worldview explaining the race to AGI and extinction risks and what to do about them – in a way that is accessible to non-technical readers.

Type

Article

AI Safety Events & Training

Weekly summaries of newly-announced events and training programs in the AI safety space – online and in-person. Run by the AISafety.com team.

Type

Newsletter

Astral Codex Ten (ACX)

Blog covering many topics, including reasoning, science, psychiatry, medicine, ethics, genetics, AI, economics, and politics. Includes book summaries and commentary on AI safety.

Type

Blog

Import AI

Weekly developments in AI research (including governance) written by Jack Clark, co-founder of Anthropic.

Type

Newsletter

AI Policy Weekly

Weekly newsletter from the Center for AI Policy (CAIP). Each issue explores three key AI policy developments for professionals in the field.

Type

Newsletter

AI Safety in China

Newsletter from Concordia AI, a Beijing-based social enterprise, providing updates on AI safety developments in China.

Type

Newsletter

AI Safety Newsletter

Newsletter from the Center for AI Safety (CAIS) published every few weeks discussing developments in AI and AI safety. No technical background required.

Type

Newsletter

policy.ai

Monthly newsletter by the Centre for Security and Emerging Technology (CSET) covering AI, emerging technology, and security policy.

Type

Newsletter

The EU AI Act Newsletter

Fortnightly newsletter by the Future of Life Institute (FLI) summarizing and analyzing the latest developments surrounding the EU AI law.

Type

Newsletter

ML Safety Newsletter

Monthly-ish newsletter aiming to inform readers about the latest research developments in ML safety, focussing on topics such as adversarial robustness, interpretability, and control.

Type

Newsletter

ChinAI

The people with the most knowledge and insight on AI development in China may well be Chinese people themselves who are sharing their insights in Chinese. Jeff Ding provides weekly translations of their writings.

Type

Newsletter

Cold Takes

Blog about transformative AI, futurism, research, ethics, philanthropy etc. by Holden Karnofsky. Includes the "most important century" series, which argues that the 21st century could be the most important ever for humanity.

Type

Blog

Bounded Regret

Blog on AI safety by Jacob Steinhardt, a UC Berkeley statistics professor, analysing risks, forecasting future breakthroughs, and discussing alignment strategies.

Type

Blog

The AI Revolution

Pair of articles by Tim Urban on the website Wait But Why using engaging, accessible explanations and illustrations to explore AI’s potential evolution toward superintelligence and its existential risks for humanity.

Type

Article

Superintelligence – Nick Bostrom (2014)

Explores how superintelligence could be created and what its features and motivations might be. It argues that, if created, it would be difficult to control and could take over the world in order to accomplish its goals.

Type

Book

The AI Does Not Hate You – Tom Chivers (2019)

Entertaining and accessible outline of the core ideas around AI existential risk, along with an exploration of the community and culture of AI safety researchers.

Type

Book

Uncontrollable – Darren McKee (2023)

The most recent layman’s introduction to AI existential risk. Covers how powerful AI systems might become, why superhuman AI might be dangerous, and what we can do to prevent AI from killing billions.

Type

Book

The Precipice – Toby Ord (2020)

Argues that humanity's future is imperilled by modern existential threats – ranging from nuclear weapons and climate change to engineered pathogens and AI – and that coordinated global action is essential to ensure our survival.

Type

Book

Life 3.0 – Max Tegmark (2017)

Explores how advanced AI could fundamentally reshape human civilisation – offering transformative opportunities while also posing profound risks – and argues that we must carefully guide its development.

Type

Book

Introduction to AI Safety, Ethics and Society – Dan Hendrycks (2024)

Textbook covering the basics of modern AI, the technical challenges of AI safety, collective action problems, and the challenges of governing AI.

Type

Book

Human Compatible – Stuart Russell (2019)

Explains the problem of making powerful AI compatible with humans. The book discusses potential solutions with an emphasis on the approaches from Professor Russell's lab, the Center for Human-Compatible AI (CHAI).

Type

Book

The Alignment Problem – Brian Christian (2020)

Comprehensive overview of the challenges that come with aligning AI systems, from the perspective of a machine learning researcher.

Type

Book

Doom Debates

Channel hosted by Liron Shapira featuring in-depth debates, explainers, and live Q&A sessions, focused on AI existential risk and other implications of superintelligence.

Type

YouTube channel

AI Safety Takes

Blog by AI safety researcher Daniel Paleka curating and succinctly analyzing the latest research and news in AI safety, with posts about every two months.

Type

Blog

The 80,000 Hours Podcast

Interviews with people working on the world’s most pressing problems (such as AI safety), including advice on how you can use your career to help solve them.

Type

Podcast

Future of Life Institute Podcast

In-depth interviews with existential risk researchers, policy experts, philosophers, and a range of other influential thinkers.

Type

Podcast

Victoria Krakovna's Blog

Blog by a research scientist at Google DeepMind working on AGI safety, covering alignment research, rationality, and personal productivity insights.

Type

Blog

AI Prospects

Blog by Eric Drexler on AI prospects and their surprising implications for technology, economics, environmental concerns, and military affairs.

Type

Blog

For Humanity Podcast

Podcast by John Sherman, a Peabody and Emmy Award-winning former investigative journalist, aiming to speak to regular, non-tech people about the existential threat AGI poses to humanity.

Type

Podcast

LessWrong podcast

Audio narrations of top LessWrong posts, including all curated posts and posts with at least 125 karma.

Type

Podcast

EA Forum podcast

Audio narrations from the Effective Altruism Forum, including all curated posts and posts with at least 125 karma.

Type

Podcast

From AI to ZI

Blog on AI safety work by a PhD mathematician and AI safety researcher, Robert Huben. Currently semi-dormant.

Type

Blog

generative.ink

Blog about large language models by janus the GPT cyborg, focusing on things like prompt engineering, human-in-the-loop interactions, and the metaphysical implications of AI-generated content.

Type

Blog

Existential risk from artificial intelligence

Wikipedia article providing a broad overview of the idea that advanced AI could pose an existential threat to humanity, covering key arguments about superintelligence, alignment challenges, and potential mitigation strategies.

Type

Article

Preventing an AI-related catastrophe

Article from 80,000 Hours analyzing the existential threat posed by advanced AI and encouraging readers to consider a career in AI safety to address the problem.

Type

Article

Chip War – Chris Miller (2022)

An account of the decades-long battle to control what has emerged as the world's most critical resource – microchip technology – with the United States and China increasingly in conflict.

Type

Book

Transformer

Weekly briefing and occasional analyses of what matters in AI and AI policy. Written by Shakeel Hashim, ex-news editor at The Economist.

Type

Newsletter

AI Safety Playlist

A carefully curated and regularly updated YouTube playlist to help people gain an understanding of what's going on with AI.

Type

YouTube channel