AGI Ruin: A List of Lethalities

Audio versions of blogs and papers from BlueDot courses.

I have several times failed to write up a well-organized list of reasons why AGI will kill you. People come in with different ideas about why AGI would be survivable, and want to hear different obviously key points addressed first. Some fraction of those people are loudly upset with me if the obviously most important points aren't addressed immediately, and I address different points first instead.

Having failed to solve this problem in any good way, I now give up and solve it poorly with a poorly organized list of individual rants. I'm not particularly happy with this list; the alternative was publishing nothing, and publishing this seems marginally more dignified.

Crossposted from the LessWrong Curated Podcast by TYPE III AUDIO.

---

A podcast by BlueDot Impact.

Chapters

• 6:45 Section A
• 20:37 Section B
• 21:15 Section B.1: The distributional leap.
• 30:29 Section B.2: Central difficulties of outer and inner alignment.
• 42:15 Section B.3: Central difficulties of sufficiently good and useful transparency / interpretability.
• 47:04 Section B.4: Miscellaneous unworkable schemes.
• 50:04 Section C: