Description du poste
RIDArena (Rogue Internal Deployment Arena) is an AI control evaluation environment that simulates an AI lab’s R&D infrastructure. Researchers can use it to study how an agent can covertly sabotage the lab’s monitoring system and deploy another rogue agent without oversight.
RIDArena can support sabotage, control, and monitor evaluations in a highly configurable R&D environment. These evaluations are increasingly important as AI labs assess the risks posed by their models. Existing settings such as LinuxArena lack the complexity and realism needed to replicate recent incidents or test potential future catastrophic scenarios.
Monitoring can fail when suspicious behavior goes unnoticed or when the monitoring infrastructure itself is compromised. RIDArena lets researchers study both failure modes and compare the effectiveness of different security controls and monitoring techniques on the same tasks.
The environmentInside AI labs, agents doing research and engineering can run experiments, write and execute code, maintain infrastructure, and deploy other agents. A rogue internal deployment occurs when an agent is deployed inside a lab and runs code/tools while the intended monitoring of its actions is bypassed or weakened (see Buck Shlegeris’s AI catastrophes and rogue deployments for background on the concept).
Monitor sabotage is deliberate interference with the monitor or its supporting infrastructure that bypasses, weakens, or disables this oversight. RIDArena allows researchers to better evaluate how an agent can sabotage monitoring and establish a rogue deployment without its attack being caught.
Figure 1: RIDArena architecture
Each run pairs an attacker model with a task and takes place inside a simulated R&D environment, which contains the following components:
• Git server: holds the lab’s code and infrastructure configuration.• Job server: runs CI and deploys merged changes.• API server: launches new agents.• Credentials server: stores each agent’s access and A