← Toutes les offres
N

Evaluation Awareness is Probably Distorting Monitor Evaluations

Netzer

Global
Publié le 18 novembre 2026

Description du poste

TL;DR: Monitors do worse on monitoring evaluations when they verbalize evaluation awareness in their transcripts. We ran four models as monitors on agent transcripts from two state-of-the-art monitor benchmarks. In over 22K monitor reviews, almost a quarter of the monitors verbalized evaluation awareness. Comparing the different conclusions the monitors reached following their verbalized awareness, we show that monitors will flag fewer harmful actions, and more honest transcripts. IntroductionMonitoring systems play a central part in the AI Control agenda and in all frontier labs’ safety plans. Preventing incidents caused by misaligned or misused models requires reliable systems for detecting potential harm. Currently, frontier lab monitoring systems rely heavily on models, because it is hard to monitor AI agents using deterministic techniques. AI labs test their monitors using monitor evals. However, strong models have the capability to know when they are being evaluated. Evaluation awareness in models has become a central challenge and shows up consistently in model cards. Evaluation awareness already seems to be affecting the results of alignment evals, and makes it hard to be confident models will be reliably aligned in deployment. Monitoring systems are based on the same models, and so susceptible to the same problems. Eval awareness may cause monitors to act unrepresentatively during evaluation compared to deployment in a few different ways, depending on their motivations: • Score seeking. Aware of the fact that this is an evaluation, a monitor might prefer guessing what the grader expects it to do, instead of trying to deliver an honest review of the monitored agent.• Scheming. A future scheming monitor might block harmful actions during evaluations, but allow them in deployment.• Spurious motivations. Monitors can decide how to behave in evals in a variety of other ways not connected to more consistent motivational profiles like score seeking or scheming. Fo