Description du poste
Transcript generated with Gemini-4-Argon and spot checked in places but not fully verified by a human.
Ivan Vendrov: All right, welcome to the show, Gabriel.
Gabriel Alfour: Thanks for having me here.
Ivan Vendrov: So, we’re going to talk. This is a follow-up conversation to the chat I had with Davidad a few days ago on emergent wisdom in language models. And suffice to say, Gabriel doesn’t buy it. Do you want to articulate your main disagreement? I can also summarize if you’d like.
Gabriel Alfour: For sure. First, I want to restate what is meant by... I forgot the word that you used, wisdom?
Ivan Vendrov: Emergent wisdom.
Gabriel Alfour: Emergent wisdom. I like the presentation that you had, I think, in your last conversation where it was like, “Oh, it looks like there’s a latent for hacking, bad stuff, and so on and so forth, and emergent wisdom is the opposite of this.”
I think this is a fair characterization, and I do think that there is such a latent. I don’t think this is where my disagreement lies. Ultimately, we all see the same reality. My disagreement is more about the interpretation. For instance, I would not call this wisdom. That’s a big one. And the second one, which I think is more important, is that I think this is just largely unrelated to actual alignment. The road to hell is paved with good intents or good intentions, I’m not sure what’s the English version of the saying, that would be basically my main takeaway there.
Ivan Vendrov: Cool. So I guess maybe the first place I want to double-click on is the first comment you made to me privately is you’re on the same page as Elena. Elena is the bodyworker I mentioned in the podcast with Davidad, who her response to talking to chatbots is disgust. She’s like, “Whoa, this thing is pretending to be a human being, but it clearly isn’t. And unlike a human being, I have no somatic, emotional, physical affordances to work with it.” So it’s this object that’s almost optimized to fool me in some way, and I wan