Description du poste
This article portrays an experiment on how good current frontier AIs are at producing detailed forecasting analyses. For this, I tasked Opus 5.5 to write an analysis on the effectiveness of AI safety advocacy work. Opus 5.5 decided to turn it into a broader forecast on the likelihood of a US-China AI deal by the end of 2030, and the cost effectiveness of various strategies for increasing that probability. At a later stage, it also added the likelihood of a US-China AI deal before complete automation of AI R&D.
I was moderately impressed. Opus 5.5 performs far above previous Claude models. I was planning on writing an article myself on this topic, and just take some inspiration from Opus 5.5’s article, but its first draft was interesting enough that I put my own article on hold, and took on the role of a supervisor to see whether Opus 5.5 could improve its work further. The article linked below is the result.
Still, the article should be considered a lower bound on what Opus 5.5 can produce. The instructions and feedback could be further improved. I could have asked it to iterate even more on the article. Now that I know more about its strengths and weaknesses, I could have restarted the entire process and worked more with Opus 5.5 to handle those better. But now I want to work on other projects.
I absolutely recommend reading or skimming the article. I personally found it quite interesting. A few caveats before you do so:
• Authorship: Everything is written by Opus 5.5. I only provided suggestions and critiques, though this feedback was sometimes very concrete (e.g. “You should consider doing X in a way that handles issue Y, perhaps by doing Z”). Consequentially, I don’t agree with all the parameter choices and modeling decisions that Opus 5.5 does. This is Opus 5.5’s forecast, not mine. However, my thinking and views have undoubtedly affected the analysis, as disclosed in the disclaimer below.• Article length and complexity: I intentionally let the analysis grow lo