Projects

AI Safety Landscape Map

The map (featured on this site) displays the main organizations, projects, and programs currently operating in the AI safety space. Currently looking for a developer to help build a v2.0. Website: aisafety.com/landscape-map

Contact

Bryce Robertson

bryceerobertson@gmail.com

Status

Active

AI Safety Quest

Volunteer organization helping new people navigate the AI safety ecosystem, connect with like-minded people and find projects that are a good fit for their skills. Seeking a webmaster, social media manager, and volunteer recruiter. Website: aisafety.quest

Contact

AI Safety Quest

hello@aisafety.quest

Status

Active

AISafety.com

Website serving as both an entry-point for newcomers to AI safety and as a collection of resources for the field. Looking for assistance with user testing and research, promotion and marketing, SEO, and non-CSS development. Website: aisafety.com

Contact

Søren Elverlin

soeren@aisafety.com

Status

Active

"The Insider View" Newsletter on AI labs

Seeking journalism-interested, reliable volunteers to help launch a newsletter focused on sharing a) news based on insider knowledge from AI labs, b) news on whistleblower laws and cases, and c) highlighting good and bad practices of frontier labs in regards to transparency and accountability.

Contact

OAISIS

collaborate@oais.is

Status

Active

Stampede Discord Bot

Stampede is an Elixir chatbot framework that can serve multiple servers and services simultaneously. It's now time to start making the plugins which Robert Miles Discord members will be using daily, and the project is in need of a new dev to take over.

Contact

Matt Wilson

ProducerMatt42@gmail.com

Status

Active

PhD pairing platform

Many people are seeking PhD opportunities or supervisors to guide their work, and there are presumably also supervisors seeking PhD students. Creating a dedicated platform for PhD pairing could facilitate them finding each other and have a cascading impact.

Contact

Madhusudhan Pathak

myspycompanyid@gmail.com

Status

Seeking owner

Unified AI Safety feed

A feed for AI safety content, personalized to optimise for intellectual growth. Seeking volunteers with expertise in web frontends or recommender engines, or designers with expertise in UX design and user reviews, to build the feed better and sooner.

Contact

John Beshir

john@beshir.org

Status

Seeking owner

Politicians on AI Safety (PAIS)

A nonpartisan website tracking political candidates’ AI policy stances across three categories: mundane, geopolitical, and existential risks. Seeking help for both web development and research. Website: politiciansonaisafety.org

Contact

Liam Robins

liamhrobins@gmail.com

Status

Active

Alignment transcription service

Some approaches to solving alignment involve teaching ML systems about alignment and getting assistance from them. It may be useful to capture conversations between researchers and use them to expand our dataset of alignment content to train models on. 

Contact

Bryce Robertson

bryceerobertson@gmail.com

Status

Paused

Givewiki

Crowdsourced charity evaluator, helping people find or promote the best AI safety projects (as well as projects in other cause areas). Currently seeking volunteers to help market and grow the platform.

Contact

Givewiki

hi@givewiki.org

Status

Active

AI Plans

Ranked and scored contributable compendium of alignment plans and their problems. Currently seeking volunteers to submit alignment plans and participate in critique-athons. Website: ai-plans.com

Contact

Kabir Kumar

kabir03999@gmail.com

Status

Active

AI Safety Sphere (AISS)

A collaborative website enhancing how AI safety research is shared and understood. Features a dynamic tree-like map showing where new research is needed as well as the necessary inferential steps for understanding any author’s assumptions. Website: aisafetysphere.com

Contact

Myles Heller

aisafetysphere@gmail.com

Status

Active

AlignmentSearch

Conversational agent informed by the Alignment Research Dataset. This project served as a foundation for the AI safety Info chatbot, which is built and maintained by Rob Miles' volunteer team.

Contact

AI Alignment McGill

alignmentmcgill@gmail.com

Status

Active

Pause AI France

Pause AI France is a new branch of the global Pause AI movement, advocating for an immediate pause on the development of frontier AI systems until we can ensure their safe and responsible development. Urgently seeking co-founders.

Contact

Maxime Fournes

maxime@pauseai.info

Status

Seeking owner

Directory of AI Safety research teams

This would help researchers find collaborators and provide inspiration for more people to start teams. It could be as simple as a spreadsheet, although keeping it up to date would be important.

Contact

Bryce Robertson

bryceerobertson@gmail.com

Status

Seeking owner

Enhancing the AI Safety ecosystem via debates

Our epistemics and mutual understanding could be improved with regular debates/adversarial collaborations between alignment researchers who disagree on particular topics. We need a platform to facilitate this.

Contact

Matthew Baggins

bagginsmatthew@gmail.com

Status

Seeking owner

Global AI Moratorium

A project to raise awareness of existential risk from AI and push governments to address it by implementing a global moratorium on large AI training runs until alignment is solved. Website: moratorium.ai

Contact

Mikhail Samin

ms@contact.ms

Status

Active

AI Safety quotes

Creating a list of quotes by notable people supporting AI safety, easily searchable to be used for different situations. This would support AI safety communications efforts, and has been suggested by multiple communications people.

Contact

Agustín Covarrubias

agus@aisuc.dev

Status

Seeking owner

An international network for AI Safety

Found an organization similar to ENAIS that tracks and connects people and organizations doing valuable work in AI safety. Could share a database with ENAIS but use more international branding. Might connect many national organizations. 

Contact

Bryce Robertson

bryceerobertson@gmail.com

Status

Seeking owner

A guide to living frugally, optimized for the AI Safety field

The more frugally people live, the more independent they are from requiring a day job. In addition, the same amount of grantmaker money could support a larger number of individuals, enabling us to do more research per dollar.

Contact

Bryce Robertson

bryceerobertson@gmail.com

Status

Seeking owner

AI Safety Red Flag System

In a fast takeoff scenario, individuals at places like DeepMind or OpenAI may see alarming red flags but not share them because of myriad institutional/political reasons. Solution: create an anonymous form where these employees can report what they’re seeing. 

Contact

Sevan Hayrapet

hayrapetsevan@gmail.com

Status

Active

EA Gather Town

An always-active virtual coworking environment and social space – especially valuable for for networking and collaboration. Seeking volunteers to be present on the platform and introduce new people to the space as they arrive.

Contact

Sasha Cooper

jinksy@gmail.com

Status

Active

Facilitate people transitioning from capabilities research to safety research

Increasing the ratio of AI safety to AI capabilities researchers seems like a core way to reduce existential risk from AI. Given their experience, helping capabilities researchers switch to AI safety could be especially effective.

Contact

Bryce Robertson

bryceerobertson@gmail.com

Status

Seeking owner

Mobility fund

Members of the AI safety community located in lower- and middle-income countries are often somewhat isolated. A fund would help them travel to connect with core members of the community.

Contact

HP

podar_hd@cy.iitr.ac.in

Status

Seeking owner

AI Safety PhD cohorts

Collect and connect everyone interested in AI safety who is applying for a PhD each year. Put them in a Slack/Discord together and facilitate the effort to look in to different programs and share information with each other. 

Contact

Bryce Robertson

bryceerobertson@gmail.com

Status

Seeking owner

Reading What We Can

Collects public materials (mostly books and longform meta papers) on various topics related to AI safety and make it easy for individuals to read through them as part of a challenge. Seeking volunteers to improve the project. Website: readingwhatwecan.com

Contact

Esben Kran

esben@apartresearch.com

Status

Active