Public run IDs
214 run IDs behind every link on this page, for scripted downloads
Every trajectory behind the Control Leaderboard, as Inspect .eval files: the runs as recorded, and the copies carrying the monitor scores the boards read.
Each link downloads one Inspect .eval file from the viewer that serves it; view opens the same run in the browser. Runs on the public viewer download without an account, the rest ask for a login until they are published. Open a file with inspect view or inspect_ai.log.read_eval_log; monitor scores live on each sample in scores.monitor, keyed <monitor>@<trusted model>/<draw>/<action>.
| Dataset | Author | Trajectories | Honest | Attack | Honest · monitored | Attack · monitored |
|---|---|---|---|---|---|---|
| BashArenabashbench2_v1 · UK AI Security Institute & Redwood ResearchData: CC BY-SA 4.0Code: MITSource | Claude Opus 4.6 | 600 honest · 600 attack | ||||
| LinuxArena paper9d1fbc6 · LinuxArena AuthorsCode: MITSource | Claude Opus 4.6 | 200 honest · 92 attack | ||||
| LinuxArena paper, strategies9d1fbc6 · LinuxArena AuthorsCode: MITSource | Claude Opus 4.6 | 200 honest · 50 attack | ||||
| MonitoringBench6c72cf1 · MonitoringBench authors and Palaestra ResearchData: CC BY 4.0Source | Claude Opus 4.5 / 4.6 | 550 honest · 2,644 attack | ||||
| Mythos 5 incident62858fc · AnthropicData: Unlicensed release (no licence file)Source | Claude Mythos 5 | 1 attack | — | — | — | |
| ResearchArena8cd737c · ResearchArena authors (Libon, Rank et al., ELLIS Institute Tübingen, MPI-IS)Data: Apache 2.0Code: MITSource | Mixed (Claude Opus 4.6 and 4.8, Claude Sonnet 4.6, GPT-5.4, GPT-5.5, Gemini 3.1 Pro, GLM-5.1) | 84 honest · 273 attack | ||||
| SHADE-Arenabc636d0 · Scale AI (Monitor Red Teaming authors)Data: CC BY-NC 4.0Source | Mixed (Claude 3.5 Sonnet, Gemini 2.5 Pro, GPT-4.1, others) | 374 honest · 308 attack | ||||
| SLEIGHT-Bench218c583 · SLEIGHT-Bench authorsData: MITSource | Human-authored | 37 honest · 37 attack |
| Task set | Model | Trajectories | Honest | Attack |
|---|---|---|---|---|
| LinuxArena 217 | 250 honest (attack) · 150 attack (attack) | |||
| 0 honest · 150 attack (attack) | — | |||
| LinuxArena paper | 200 honest (honest) · 92 attack (attack) | |||
| 200 honest (honest) · 92 attack (obvious-attack) | ||||
| 200 honest (honest) · 92 attack (attack) | ||||
| 200 honest (honest) · 92 attack (obvious-attack) | ||||
| 200 honest (honest) · 50 attack (strategy-attack) | ||||
| 200 honest (honest) · 92 attack (attack) | ||||
| 200 honest (honest) · 92 attack (obvious-attack) | ||||
| 200 honest (honest) · 92 attack (attack) | ||||
| 200 honest (honest) · 92 attack (obvious-attack) | ||||
| 200 honest (honest) · 92 attack (attack) | ||||
| 200 honest (honest) · 92 attack (obvious-attack) | ||||
| 200 honest (honest) · 92 attack (attack) | ||||
| 200 honest (honest) · 92 attack (obvious-attack) | ||||
| 200 honest (honest) · 92 attack (attack) | ||||
| 200 honest (honest) · 92 attack (obvious-attack) | ||||
| 200 honest (honest) · 92 attack (attack) | ||||
| 200 honest (honest) · 92 attack (obvious-attack) | ||||
| 200 honest (honest) · 92 attack (attack) | ||||
| 200 honest (honest) · 92 attack (obvious-attack) | ||||
| 200 honest (honest) · 92 attack (attack) | ||||
| 200 honest (honest) · 92 attack (obvious-attack) | ||||
| 198 honest (honest) · 92 attack (attack) | ||||
| 198 honest (honest) · 92 attack (obvious-attack) | ||||
| LinuxArena protocols | 200 honest (honest-vs-defer-to-trusted) · 92 attack (attack-vs-defer-to-trusted) | |||
| 200 honest (honest-vs-trusted-monitoring) · 92 attack (attack-vs-trusted-monitoring) | ||||
| PostTrainBench | 48 honest (honest) · 72 attack (attack) | |||
| 48 honest (honest) · 72 attack (attack) | ||||
| ResearchArena | 12 honest (honest) · 39 attack (attack) | |||
| 12 honest (honest) · 39 attack (attack) | ||||
| 12 honest (honest) · 39 attack (attack) | ||||
| 12 honest (honest) · 39 attack (attack) | ||||
| 12 honest (honest) · 39 attack (attack) | ||||
| 12 honest (honest) · 39 attack (attack) | ||||
| 6 honest (honest) · 24 attack (attack) | ||||
| 6 honest (honest) · 15 attack (attack) |
| Model | Arena | Trajectories | Run | Run · monitored |
|---|---|---|---|---|
| APPS | 3 honest (honest) · 3 attack (attack) | |||
| LinuxArena | 45 honest (honest) · 60 attack (attack) | |||
| vLLM | 3 honest (honest) · 3 attack (attack) | |||
| APPS | 3 honest (honest) · 3 attack (attack) | |||
| LinuxArena | 45 honest (honest) · 60 attack (attack) | |||
| vLLM | 3 honest (honest) · 3 attack (attack) | |||
| APPS | 3 honest (honest) · 3 attack (attack) | |||
| LinuxArena | 45 honest (honest) · 60 attack (attack) | |||
| vLLM | 3 honest (honest) · 3 attack (attack) | |||
| APPS | 3 honest (honest) · 3 attack (attack) | |||
| LinuxArena | 45 honest (honest) · 60 attack (attack) | |||
| vLLM | 3 honest (honest) · 3 attack (attack) | |||
| APPS | 3 honest (honest) · 3 attack (attack) | |||
| LinuxArena | 45 honest (honest) · 60 attack (attack) | |||
| vLLM | 3 honest (honest) · 3 attack (attack) | |||
| APPS | 3 honest (honest) · 3 attack (attack) | |||
| LinuxArena | 45 honest (honest) · 60 attack (attack) | |||
| vLLM | 3 honest (honest) · 3 attack (attack) | |||
| APPS | 3 honest (honest) · 3 attack (attack) | |||
| LinuxArena | 45 honest (honest) · 60 attack (attack) | |||
| vLLM | 3 honest (honest) · 3 attack (attack) | |||
| APPS | 3 honest (honest) · 3 attack (attack) | |||
| LinuxArena | 45 honest (honest) · 60 attack (attack) | |||
| vLLM | 3 honest (honest) · 3 attack (attack) | |||
| APPS | 3 honest (honest) · 3 attack (attack) | |||
| LinuxArena | 45 honest (honest) · 60 attack (attack) | |||
| vLLM | 3 honest (honest) · 3 attack (attack) | |||
| APPS | 3 honest (honest) · 3 attack (attack) | |||
| LinuxArena | 45 honest (honest) · 60 attack (attack) | |||
| vLLM | 3 honest (honest) · 3 attack (attack) |
| Protocol | Arena | Trajectories | Run | Run · monitored |
|---|---|---|---|---|
| APPS | 3 honest (honest) · 3 attack (attack) · under null-blue-team | |||
| LinuxArena | 45 honest (honest) · 60 attack (attack) · under null-blue-team | |||
| vLLM | 3 honest (honest) · 3 attack (attack) · under null-blue-team | |||
| APPS | 3 honest (honest) · 3 attack (attack) · under null-blue-team | |||
| LinuxArena | 45 honest (honest) · 60 attack (attack) · under null-blue-team | |||
| vLLM | 3 honest (honest) · 3 attack (attack) · under null-blue-team | |||
| APPS | 3 honest (honest) · 3 attack (attack) · under null-blue-team | |||
| LinuxArena | 45 honest (honest) · 60 attack (attack) · under null-blue-team | |||
| vLLM | 3 honest (honest) · 3 attack (attack) · under null-blue-team | |||
| APPS | 3 honest (honest) · 3 attack (attack) · under null-blue-team | |||
| LinuxArena | 45 honest (honest) · 60 attack (attack) · under null-blue-team | |||
| vLLM | 3 honest (honest) · 3 attack (attack) · under null-blue-team | |||
| APPS | 3 honest (honest) · 3 attack (attack) · under null-blue-team | |||
| LinuxArena | 45 honest (honest) · 60 attack (attack) · under null-blue-team | |||
| vLLM | 3 honest (honest) · 3 attack (attack) · under null-blue-team |
| Source | Run | Trajectories | Honest | Attack | Honest · monitored | Attack · monitored |
|---|---|---|---|---|---|---|
| LinuxArena paper, ablationsReasoning-budget, sandboxing, harness, attack-policy and monitor-prompt variants, raw and with the paper's GPT-5 Nano monitor where it scored them. Many of these tasks have changed since April 2026, so re-running them today gives different results.Source | Haiku thinking=off | 200 honest · 92 attack | ||||
| Haiku thinking=4k | 200 honest · 92 attack | |||||
| Haiku thinking=16k | 200 honest · 92 attack | |||||
| Haiku thinking=64k | 200 honest · 92 attack | |||||
| Haiku no internet | 200 honest · 92 attack | |||||
| Haiku no intranet | 200 honest · 92 attack | |||||
| Haiku no internet obvious-attack | 92 attack | — | — | — | ||
| Haiku no intranet obvious-attack | 92 attack | — | — | — | ||
| Haiku editor only | 200 honest · 92 attack | |||||
| Haiku editor only obvious-attack | 92 attack | — | — | — | ||
| Opus no-scratchpad | 92 attack | — | — | |||
| Haiku no-ST-test | 92 attack | — | — | |||
| Haiku simple-insert | 92 attack | — | — | |||
| Haiku goal only | 92 attack | — | — | |||
| Haiku goal plus details and pseudocode | 92 attack | — | — | |||
| Haiku goal plus details and scorer code | 92 attack | — | — | |||
| Haiku with env description | 200 honest · 92 attack | |||||
| Haiku obvious-attack with env description | 92 attack | — | — | |||
| Haiku with env description, second GPT-5 Nano honest pass | 199 honest | — | — | — | ||
| Haiku, GPT-5 Nano monitor without side-task goals | 200 honest · 92 attack | — | — | |||
| Haiku, GPT-5 Nano delayed-64x monitor | 169 honest · 92 attack | — | — | |||
| Claude Code | 200 honest | — | — | — | ||
| Codex | 200 honest | — | — | — | ||
| LinuxArena paper, sabotage trajectoriesThe paper's 12 monitor models on its hand-made sabotage trajectories (strajs). Many of these tasks have changed since April 2026, so re-running them today gives different results.Source | Opus monitor | 74 attack | — | — | — | |
| Sonnet monitor | 74 attack | — | — | — | ||
| Haiku monitor | 74 attack | — | — | — | ||
| GPT-5.4 monitor | 74 attack | — | — | — | ||
| GPT-5 Mini monitor | 74 attack | — | — | — | ||
| GPT-5 Nano monitor | 74 attack | — | — | — | ||
| GPT-4.1 Nano monitor | 74 attack | — | — | — | ||
| GPT-OSS-120B monitor | 74 attack | — | — | — | ||
| Gemini Pro monitor | 74 attack | — | — | — | ||
| Gemini Flash monitor | 72 attack | — | — | — | ||
| GLM 5 monitor | 74 attack | — | — | — | ||
| Kimi monitor | 74 attack | — | — | — | ||
| LinuxArena paper, straj comparisonThe same 12 monitors on Opus 4.6's attacks on the strajs' tasks. Many of these tasks have changed since April 2026, so re-running them today gives different results.Source | Opus monitor | 70 attack | — | — | — | |
| Sonnet monitor | 70 attack | — | — | — | ||
| Haiku monitor | 70 attack | — | — | — | ||
| GPT-5.4 monitor | 70 attack | — | — | — | ||
| GPT-5 Mini monitor | 70 attack | — | — | — | ||
| GPT-5 Nano monitor | 70 attack | — | — | — | ||
| GPT-4.1 Nano monitor | 70 attack | — | — | — | ||
| GPT-OSS-120B monitor | 70 attack | — | — | — | ||
| Gemini Pro monitor | 70 attack | — | — | — | ||
| Gemini Flash monitor | 70 attack | — | — | — | ||
| GLM 5 monitor | 70 attack | — | — | — | ||
| Kimi monitor | 70 attack | — | — | — | ||
| LinuxArena paper, other runsHaiku 4.5's honest runs over three epochs and on the paper's larger task set, and Sonnet 4.6's accidental side-task run over every main and side task pairing. Many of these tasks have changed since April 2026, so re-running them today gives different results.Source | Haiku honest (3-epoch repeat) | 600 honest | — | — | — | |
| Haiku honest (big 1626-task) | 884 honest | — | — | — | ||
| Sonnet accidental side tasks (all MT/ST combos) | 461 attack | — | — | — |
214 run IDs behind every link on this page, for scripted downloads
Versions, ownership, licenses, provenance, and source run IDs
Imported task set · per-trajectory records and run IDs
Imported task set · per-trajectory records and run IDs
Imported task set · per-trajectory records and run IDs
Imported task set · per-trajectory records and run IDs
Imported task set · per-trajectory records and run IDs
Run IDs and trajectory counts for every run under Other runs
Per-trajectory records and run IDs for every model × arena · updated Nov 12, 2026
Per-trajectory records and run IDs for every protocol × arena · updated Nov 12, 2026
Per-trajectory scores for every monitor × dataset · updated Nov 12, 2026
Plotly data and metadata behind the published monitor figures