An Overview of Catastrophic AI Risks

Audio versions of blogs and papers from BlueDot courses.

This article from the Center for AI Safety provides an overview of ways that advanced AI could cause catastrophe. It groups catastrophic risks into four categories: malicious use, AI race, organizational risk, and rogue AIs. The article is a summary of a larger paper that you can read by clicking here.

Original text:
https://www.safe.ai/ai-risk

Authors:
Dan Hendrycks, Thomas Woodside, Mantas Mazeika

A podcast by BlueDot Impact.

Chapters

• 0:33 Catastrophic AI risks can be grouped under four key categories which are summarized below.
• 2:51 1.Introduction
• 4:39 2.Malicious Use
• 4:51 Bioterrorism
• 6:53 Unleashing AI Agents
• 7:40 Persuasive AIs
• 8:20 Concentration of Power
• 8:54 Suggestions
• 10:16 3.AI Race
• 10:35 Military AI Arms Race
• 12:57 Corporate AI Arms Race
• 14:17 Evolutionary Dynamics
• 15:39 Suggestions
• 16:47 4.Organizational Risks
• 17:51 Accidents Are Hard to Avoid
• 19:00 Organizational Factors Can Mitigate Catastrophe
• 21:07 Suggestions
• 22:59 5.Rogue AIs
• 23:28 Proxy Gaming
• 24:32 Goal Drift
• 25:20 Power-Seeking
• 26:04 Deception
• 26:57 Suggestions
• 27:51 6.Conclusion
• 29:16 Frequently Asked Questions