Description du poste
In August 2026 Eliezer Yudkowsky and Geoffrey Irving had a 90-minute debate at the ILIAD III Conference. You can watch the "Fixed Audio"-version on YouTube. They first identify their disagreements like How hard is superalignment? and discuss the theory of impact of Irving's new organization Resolution. They then go into depth on scalable oversight.
Epistemic Effort: I transcribed the audio using 5 services and merged those using Claude Fable 5.1. Then I spent ~6 hours carefully reviewing and editing the transcript. (I also added links and [disagreement which they indicated non-verbally]. Subheadings by Claude Fable 5.2.)
IntroductionsYudkowsky [00:00]: Hi, I'm Eliezer, well-known Harry Potter fan fiction author. [cheering] [laughter]
Irving [00:10]: I'm Geoffrey Irving. I'm now the chief scientist at Resolution. I was at, for better or worse, various labs before, and also AISI.
Audience member: And Pixar.
Irving: And Pixar. [laughter]
Survey of disagreementsYudkowsky: So we're going to try to resolve all of our open disagreements over the course of the next hour. [laughter] An impossible task, but not as impossible as some, really. [laughter] So I would propose that we maybe take turns stating beliefs, that we suspect the other might disagree with, that we ourselves hold. And then this [lowers his hand to the floor] is very low disagreement, and this [holds his hand up high] is very high disagreement.
And so we can do a quick survey of the field before we actually go depth first into anything.
Irving: Sounds great.
How hard is superalignment?Yudkowsky: All right. I suspect that we have a disagreement about how difficult alignment is exactly. And in particular, I expect that superalignment is kind of beyond the reach of current human institutions or their close neighbors.
Irving: Here. Or sorry, here. [Irving indicates high disagreement] I think there's a question. This is maybe slightly related, but just to say it even anyways. I think it's plausible that a relative