Funding

Coefficient Giving (CG): Project Tailwind

Backs founders launching/scaling ambitious new AI safety initiatives. Pre-seed grants of $200k–$2m, seed funding of $2m–$20m, and scale funding of $20m–$200m.

Middle Powers and Transformative AI

RFP by Astralis Foundation and Macroscopic Ventures on the role of middle powers in the AI transition. Around $10M in total, with most grants between $100k and $2M.

BlueDot Impact: Seed Grants

Funds the first 6–12 months of a new AI safety project or organization before it is ready for larger institutional funding. Includes introductions to follow-on funders.

ISPA Inspection Prize

Offers $5M–$20M to whoever initiates and supervises peer-assisted inspections of frontier AI companies' pre-deployment security. From Survival and Flourishing Corporation (SFC).

Mercor: AI Safety Fund Grants

$5 million for AI safety research at universities, nonprofits, and small startups. Topics include misalignment, sandbox escape, evaluation awareness, and interpretability.

Iliad: Request for Proposals

Funds theory-driven research on ReLU networks and projects that raise the epistemic bar of AI safety. Mathematicians especially welcome, regardless of prior AI experience.

Iliad: Open Call for Research Projects

Funds new research orgs and projects meeting a high standard of scientific rigor – predictive, mathematically founded theory and methodologically mature experiments.

AI Alignment Foundation (AIAF)

Funds alignment researchers with ideas they can't pursue within their current institutional funding and experts from other fields whose perspectives could produce breakthroughs.

Transformative AI Fund (TAIF)

Funds new projects addressing transformative AI, with grants typically $10k–$150k. Run by Effective Altruism Funds. Replaced the Long-Term Future Fund (LTFF).

Survival and Flourishing Fund (SFF)

Provides financial support to organizations working to improve humanity’s long-term prospects for survival and flourishing. Speculation Grants are rolling; full S-Process runs annually.

Paradigm 3

Funds research on AI externalities, evals science, alignment questions, and slowing AI progress.

Corrigibility Research Fund

Awards grants and prizes for corrigibility research – aiming to ensure AI keeps humans informed and in control. Managed by Max Harms and housed at Lightcone Infrastructure.

Schmidt Sciences

Funder housing the science-focused philanthropic efforts of Eric and Wendy Schmidt, which moves large amounts of funding towards AI safety via its AI institute.

Coefficient Giving (CG): Capacity-Building

Funds projects that support people working in AI safety, help people transition to the field, or contribute to public discourse about transformative AI.

Leo Gao's Experimental Microgranting Program

Currently paused. $10k grants for ambitious, unusual projects to make AGI go well, via a deliberately minimal application. Open to anyone, including those new to the field.

Institute for Progress (IFP): The Launch Sequence

$10k honorarium plus funder matchmaking for short pitches for projects preparing for advanced AI – including in alignment, control, evals, and AI security.

BlueDot Impact: Rapid Grants

Grants of up to $20k for work on AI safety research, field-building, talent acceleration, events etc.

Manifund

Regranting platform where individual regrantors have funding pools to direct towards publicly listed projects.

Foresight Institute

Foresight's 'AI for Science & Safety Nodes' program offers funding, a community hub, and local compute in either San Francisco or Berlin.

grantmaking.ai

Public database of AI safety projects seeking funding. Applications are displayed to various donors and can receive rapid feedback.

Advanced Research + Invention Agency (ARIA)

UK government R&D funding agency aiming to unlock scientific and technological breakthroughs that benefit everyone. Similar to DARPA in the US.

AI Safety Tactical Opportunities Fund (AISTOF)

Pooled multi-donor fund structured to be fast and rapidly capture emerging opportunities, including in governance, technical alignment, and evaluations.

AI Risk Mitigation (ARM) Fund

Aiming to reduce catastrophic risks from advanced AI through grants towards technical research, policy, and training programs for new researchers.

Effective Altruism Infrastructure Fund (EAIF)

Aiming to increase the impact of effective altruism projects (including AI safety) by increasing their access to talent, capital, and knowledge.

Future of Life Institute (FLI): Digital Media Accelerator

Supporting digital content from creators raising awareness and understanding about ongoing AI developments and issues.

Longview Philanthropy

Devises and executes bespoke giving strategies for major donors. Grants focus on reducing the risks posed by AI, nuclear war, and engineered pandemics.

Macroscopic Ventures

Swiss nonprofit focused on reducing suffering risks, including that posed by catastrophic AI misuse and AI conflict. Makes both grants to nonprofits and investments in for-profit companies.

AI Forge

Joint DARPA and NSF program funding US university-led research on interpretability, control, and adversarial robustness for national security applications.

Tarbell: AI Reporting Grants

Grants of $1k–20k to support journalism on AI and its impacts. Mainly focuses on written journalism, but also funds other formats.

Astralis Foundation

Funding initiative backing people and ideas with the funding, strategic guidance, and networks they need to steer transformative AI toward beneficial outcomes.

UK AI Security Institute (AISI)

UK government organization running large-scale grant programs funding AI safety research. Collaborates with researchers and institutions to identify promising projects to fund.

Founders Pledge

Helping entrepreneurs direct their charitable giving where it will do the most good, including (but not limited to) AI safety.

Halcyon Futures

Fast grants/investments of up to $5M for new technical research nonprofits/for-profits advancing AI safety.

Future of Life Institute (FLI)

Makes grants for studying the risks from powerful technologies and developing strategies for reducing them – through RFPs, contests, and collaborations.

OpenAI Foundation

Nonprofit that controls OpenAI which has committed $25 billion to grants in various cause areas – including AI safety.

Cooperative AI Foundation (CAIF)

Charity foundation backed by a large philanthropic commitment supporting research into improving cooperative intelligence of advanced AI.

Cooperative AI PhD Fellowship

Provides financial support to future and current PhD students in the field of cooperative AI. Run by the Cooperative AI Foundation (CAIF).

Metaplanet

Evergreen VC and fund by Jaan Tallinn backing tech that supports humanity's long-term survival. Profits from the VC go towards funding AI safety nonprofits.

AI Safety Fund (AISF)

Initiative run by the Frontier Model Forum (i.e. frontier AI companies) to accelerate and expand the field of AI safety.

Laidir Foundation

Private foundation funding AI governance: policymaker education on capabilities, policy design across a range of future scenarios, and civil society coordination on AI risk.

Center on Long-Term Risk (CLR) Fund

Supports projects and individuals aiming to address worst-case suffering risks from the development and deployment of advanced AI systems.

CSET: Foundational Research Grants

Supports the exploration of foundational technical topics that relate to the potential national security implications of AI over the long term.

Meta Charity Funders

Network of donors funding charitable projects that work one level removed from direct impact, often cross-cutting between cause areas.

Global Technology Risk (GTR) Foundation

Berlin-based foundation of tech investor Jan Beckers. Its GTR AI Safety Fund (€50M over 3–7 years) offers flexible grants and hands-on support to people and early-stage orgs.

Saving Humanity from Homo Sapiens (SHfHS)

Small organization with a long history of finding people doing impactful work to prevent human-created existential risks and financially supporting them.

Astera Foundation

Private foundation providing grants to projects working to make the future with advanced AI go well. Also invests in for-profits in order to redeploy capital to AI safety nonprofits.

Good Ventures (GV)

Foundation run by Dustin Moskovitz and Cari Tuna providing funding in a range of cause areas, including AI safety.

AI2050

Program from Schmidt Sciences supporting exceptional people working on key opportunities and hard problems that are critical to get right for society to benefit from AI.

Nonlinear AI Safety Advocacy Grants

Grant program providing funding to those raising awareness about AI risks or advocating for a pause in AI development.

The Dreamery Foundation

Private foundation of Elastic co-founder Steven Schuurman, providing €5M/year to various initiatives including AI safety.

The Navigation Fund

Jed McCaleb's fund, making grants to organizations and projects in various cause areas including AI safety.

GiveWiki

Crowdsourced charity evaluator and one-stop shop for AI safety funding applications. No longer active.

BlueDot AGI Strategy Fund

$5–50k grants for individuals building high-impact AI safety projects. Applicants needed to have completed their AGI Strategy course.

EU AI Safety Tenders

The EU funded important projects to research AI safety and Tendery.ai offered free support in applying.

Lightspeed Grants

Funded projects that have a chance of substantially changing humanity's future trajectory for the better. Disbursed 8 million USD in the 2023 round but has been inactive since.

Nonlinear Network

Platform taking grant applications and presenting them to a donor circle, who then reached out if they were interested. Last round was in 2024.

Superlinear Prizes

Currently paused. Decentralized bounty platform offering prize money for delivering on specific AI safety projects.