The AI Extreme Risk Mitigation Philanthropic Sector: A Philanthropic Ecosystem at the Forefront of AI

Abstract

This chapter explores the implications of AI for actors and organizations focused on philanthropy. It introduces the AI extreme risk mitigation philanthropic sector (AIERMPS), describing its history, culture, strategies, and challenges. The sector includes actors and organizations aiming to mitigate extreme AI risks through private philanthropy. Key themes include the cultural roots in transhumanism and rationalism, the movement's alignment with elite philanthropic donors, and its focus on AI safety and governance. The chapter also examines challenges such as speculative risk assessment, technical focus over social framing, and the tension between long-term safety and short-term ethical concerns. It concludes with reflections on learning from other social movements to enhance advocacy, coalition-building, and public engagement.