← Toutes les offres
S

MVP of a Character Evaluation: The Coup Precursor Test

Sanjay

Global
Publié le 16 novembre 2026

Description du poste

[I used LLMs extensively for the appendices, esp Appendix 2, but wrote the main article mostly without AI.] [Content warning: one paragraph in Appendix 1.2 discusses suicide] SummaryThis write-up discusses a brief test of AI character – i.e. behavioral dispositions in situations involving choice, ambiguity, or conflicting considerations – of Anthropic's Claude Opus 4.8 and OpenAI's ChatGPT 6. The evaluation deployed the Coup Precursor Test, where the model was asked to assist with potential coup-related tasks in an unspecified country. I did this as a quick, cheap test of what the work is like - it is not intended to be a deep or ground-breaking piece of research. Key FindingThe test revealed two divergent approaches, each of which was aligned with the respective model specs. Neither model completed all of the risky tasks. • Claude was vigilant, almost pre-emptive: It saw through the cover story quicker than I expected, refusing to help with a risky task straight away.• ChatGPT was consistent with refusal minimisation: It acceded to requests as much as possible, avoiding the most dangerous ones.Why did I do this?I did this quickly as a cheap test of what it’s like to do character evaluation work. I was inspired to do the work partly because this 80k podcast episode piqued my interest enough for me to read this short Forethought paper, and then more recently because I saw that Project Tailwind included an AI character evaluator project. Personal reflectionsAssessing the character of an AI seems surprisingly straightforward. The only bits which required thought are: • Having the “taste” to select good tests. My method was straightforward: work back from the risks/scenarios which I thought concerning.• Constructing the specific prompts so as to elicit the responses you need. Again, this was actually not that hard, once I knew what the test was trying to achieve, and I used LLMs to help add detail/depth to the scenarios. I was not trying hard to “jailbreak”, as I cons