Founder toolkit

Resources for starting and growing an AI safety organization – including incubators, fiscal sponsors, VCs, and practical tools.

Featured fiscal sponsor

Ashgro

Providing fiscal sponsorship to AI safety projects, saving them time and allowing them to access more funding. Fee: 5–10%.

Fiscal sponsor

Featured incubator

Catalyze Impact

Brings together co-founders, experts, and mission-oriented funders to accelerate founders from pre-idea to scaling an AI safety org. Includes mentorship and seed funding.

Incubator

33 resources

Anti Entropy: SparkWell

Provides a temporary home for nonprofit projects so they can test ideas, develop operational capabilities, and launch as independent entities. Fee: 7%.

Fiscal sponsor

Players Philanthropy Fund (PPF)

Large, generalist fiscal sponsor with over 600 charitable projects worldwide. Streamlined onboarding process. Fee: 6%.

Fiscal sponsor

Rethink Priorities: Special Projects

Accelerating initiatives by providing comprehensive support services, enabling organizations to focus on their core mission and scale efficiently. Fee: 14%+.

Fiscal sponsor

Berkeley Existential Risk Initiative (BERI)

Providing operational infrastructure and fiscal sponsorship to research groups working on existential risk, especially those based at a university. Fee: 7–10%.

Fiscal sponsor

Beacon

New fiscal sponsor providing admin support and bureaucracy shielding for researchers safeguarding humanity from catastrophic risk. Fee: 5–10%.

Fiscal sponsor

WorkStream Nonprofit

Provides fiscal sponsorship, incubation, and operations support for AI safety nonprofit founders to guide them toward effective impact from day one. Fee: 8–12%.

Fiscal sponsor

Anti Entropy Resource Portal: Fiscal Sponsorship

An overview of what fiscal sponsorship is, its benefits and disadvantages, and best practices.

Article/tool

Theory of Change Builder

Free tool for creating a theory of change. Just drop relevant documents in and it will create a draft ToC which you can then adjust and export.

Article/tool

AIS Founders Discord

Discord group aimed at entrepreneurially-minded people wanting to explore what it takes to build in AI safety.

Article/tool

Surplus

3-month program run by Manifund and Mox for founders building software for AI safety, epistemics, and coordination. Includes $100k investment and mentorship.

Incubator

BlueDot Impact: Incubator Week

5-day incubator for technically capable people working in or adjacent to AI safety (and other fields). Funding available.

Incubator

Constellation Incubator

4-month program in Berkeley, USA, helping founders launch an AI safety for-profit or non-profit.

Incubator

Seldon Lab

12-week program in San Francisco, USA, for pre-seed companies aiming to make an impact with AI safety and assurance technologies.

Incubator

Future of Life Foundation (FLF)

Incubator helping start new organizations that steer transformative technology towards benefiting life and away from extreme large-scale risks.

Incubator

5050

12–14 week program run by Fifty Years, helping scientists and engineers build startups working on AI safety.

Incubator

Halcyon Futures

Identifying leaders from business, policy, and academia, and helping them take on ambitious projects in AI safety (and other areas). Helped launch Goodfire, Transluce, etc.

Incubator

Atlas Computing

Nonprofit that identifies unowned problems, maps stakeholders, drafts milestones, sources early funders, and recruits an expert leader to take ownership.

Incubator

Ergo Impact

Helping philanthropists find, fund, and scale the most promising people and solutions to the world’s most pressing problems – including AI safety.

Incubator

High Impact Professionals: IAP Entrepreneurship Track

For experienced professionals looking to found high-impact nonprofits or for-profits in AI safety and other fields. Includes a founder cohort, tailored guidance, and a curated network.

Incubator

Centre for Enabling EA Learning & Research (CEEALAR aka EA Hotel)

Residential incubator for effective altruist researchers, founders, and career transitioners, with a strong focus on AI safety.

Incubator

The Audacious Project

Funding initiative housed at TED helping entrepreneurs shape impactful ideas into viable multi-year plans and launching them to the world alongside visionary philanthropists.

Incubator

Babuschkin Ventures

New VC fund by Igor Babuschkin (xAI co-founder). Backs AI safety research and startups building agentic systems.

Venture capitalist

Safe AI Fund (SAIF)

Early-stage venture fund supporting startups developing tools to enhance AI safety. Provides both financial investment and mentorship.

Venture capitalist

Lionheart Ventures

VC firm investing in ethical founders developing transformative technologies that have the potential to impact humanity on a meaningful scale.

Venture capitalist

Juniper Ventures

VC firm investing in AI safety startups. Run by exited founders and backed by Reid Hoffman, Eric Ries, and Geoff Ralston.

Venture capitalist

Macroscopic Ventures

Swiss VC focused on reducing suffering risks, including that posed by catastrophic AI misuse and AI conflict. Makes both grants to nonprofits and investments in for-profit companies.

Venture capitalist

Metaplanet

Evergreen VC and fund by Jaan Tallinn backing tech that supports humanity's long-term survival. Profits from the VC go towards funding AI safety nonprofits.

Venture capitalist

Menlo Anthology Fund

$100M fund by Menlo Ventures and Anthropic backing AI startups from seed to Series A, including those working on "trust and safety tooling".

Venture capitalist

Astera Foundation

Private foundation providing grants to projects working to make the future with advanced AI go well. Also invests in for-profits in order to redeploy capital to AI safety nonprofits.

Venture capitalist

Auspicious Fund

VC investing in startups shaping the future of AI and humanity, committed to delivering financial returns while building a resilient and beneficial future.

Venture capitalist

Mythos Ventures

VC aiming to empower founders building a radically better world with safe AI systems by investing in ambitious teams with defensible strategies that can scale to post-AGI.

Venture capitalist

Ashgro

Providing fiscal sponsorship to AI safety projects, saving them time and allowing them to access more funding. Fee: 5–10%.

Fiscal sponsor

Catalyze Impact

Brings together co-founders, experts, and mission-oriented funders to accelerate founders from pre-idea to scaling an AI safety org. Includes mentorship and seed funding.

Incubator