Description du poste
Disclaimer: While I spent a lot of time carefully reading their work and checking my claims with an AI, this writing was not double-checked by anyone on the AIFP team.
Jaggedness, Takeoff Speeds, and Modeling Differences.The AI Futures Project, the team behind AI 2027 and AI 2040, recently wrote a report detailing how their timelines to superhuman AIs have shifted. This was prompted by last week’s METR report, which estimated[1] that Anthropic’s AI models have been improving twice as fast as they were in previous years, according to an internal metric called the AECI.[2] Because the report’s estimated rate of progress was several months ahead of many of the most bullish predictions, including those in AI 2027, it caught many people off guard.
But what are the AIFP forecasters predicting, exactly? As many have pointed out, the term “AGI” is pretty unspecific. Toby Ord describes “AGI” like hiking through a cloud: it’s unclear where it begins or ends, but it’s helpful to say that at some point, people were definitely inside of one. However, it’s hard to predict the exact beginning of the cloud.
To get around these blurred edges, AIFP describes a few different milestones of AI progress:
• Superhuman AI Researcher (SAR): According to the most recent timeline update, “SAR is roughly the point at which a company would rather fire all their human researchers and rely solely on automated AI researchers than have a team of the best human researchers in the world with no AIs.” In other words, imagine a world where all the researchers at an AI company were as talented as the best researchers. In this world, SAR would be the point of AI-human parity:
Adapted from Ajeya Cotra. The lines don’t sum to 100% because humans and AIs are assumed to be complements, meaning they increase each other’s productivity in addition to adding their own value. • Top-Expert-Dominating AI (TED-AI): TED-AI is an AI that consistently performs at the level of (or higher than) the best human expert at