← Toutes les offres
D

AI Skeptics Should Wear Their Seatbelts

dyllan_han

Global
Publié le 16 novembre 2026

Description du poste

Crosspost from my Substack 1.When I get into my car, I wear my seatbelt. This is not because I think I will crash. In fact, if I was getting into my car and some smug researcher told me, “Erm, actually, there is a 10% chance you’ll crash”, I would laugh and ignore him. And then I would wear my seatbelt anyways. To see why, here’s a payoff matrix: subscribe to help support me! Notice that if I wear my seatbelt and don’t end up crashing, I’ve spent 2 seconds of effort unnecessarily. On the other hand, if I wear my seatbelt and end up crashing, I have saved my life. There is a saying when you buy a gun: “treat it as if it were always loaded”. This applies even if you are almost certain the gun is not loaded. In fact, if I bought a new gun and some researcher told me “there is a 10% chance your gun is loaded”, I would laugh and ignore him. And then I would still gingerly put the gun away, pointing the muzzle at the ground. To see why, here’s a payoff matrix: Notice that if you mistakenly treat the gun as loaded when it is really empty, you waste some energy being a worrywart. But if you mistakenly treat the gun as empty when it is really loaded, you risk the possibility of killing someone. 2.A few weeks ago I was quite skeptical of AI risk. I read Ramez Naam and Arvind Narayanan and David Thorstad. I think they give good counterarguments against more extreme forms of fast takeoff. I remain uncertain about extinction risk. At this stage, I don’t think it is possible to be certain. First, because AI is a genuinely novel technology, without historical precedent. I hope skeptics will at least grant this. Everybody who predicts that capabilities will certainly speed up or certainly slow down is probably bullshitting. I think there are doomers who are also irresponsibly certain. Second, because the frontier labs have locked their most capable models behind closed doors. Unless you are a lab employee, your lackluster experience using ChatGPT doesn’t count for much. That