Skip to content
onsuggest
Log in
Article en

Probe monitors seem to perform realistically in simulated control environments

Source: LessWrong ·

TL;DR In simulated control evaluations , instead of executing an agent’s proposed commands and returning the outputs, a language model simulates what the outputs would have been. This allows control evals to be more on-distribution for deployment use without actually running on production systems. However, imperfect simulators may create a subtle distribution shift that changes the behavior of white-box methods such as probes. We investigate whether probe monitors perform similarly when attacks are run in simulation vs. when they are run for real. We run attacks with Qwen3.5-27B against 1,313

What is Probe monitors seem to perform realistically in simulated control environments?

Probe monitors seem to perform realistically in simulated control environments is a article discovery curated from LessWrong. TL;DR In simulated control evaluations , instead of executing an agent’s proposed commands and returning the outputs, a language model simulates what the outputs would have been…

How can I access or experience this?

You can experience this content directly on its original host (LessWrong) by clicking the "Open Original" button.

Where does this content come from?

Curated from LessWrong by the OnSuggest team to surface the most interesting and serendipitous content on the web.

Article · Culture & ideas

“Give Me the Ball!” Serves a Powerful Portrait of Billie Jean King

Billie Jean King and Ilana Kloss attend the premiere of Give Me the Ball! by Liz Garbus and Elizabeth Wolff, an official selection of the 2026 Sundance Film Festival. (© 2026 Sundance Institute | photo by Jemal Countess) By Ramona Flume “This film you’re about to see is an extraordinary documentary about a competitor, a […] The post “Give Me the Ball!” Serves a Powerful Portrait of Billie Jean King first appeared on sundance.org .

Sundance News View Details →
Article · Culture & ideas

Former ‘Blade’ Director Left MCU Reboot Because “Life’s Too Short to Make Sh-t Films”

For years, Marvel Studios and the Marvel Cinematic Universe ignored anything that came before Iron Man, regardless of what audiences thought. This means that, despite Wesley Snipes‘ Blade helping kick start the idea of Marvel movies, the franchise not only ignored those movies, but also left the character behind entirely. Then, in 2019, Marvel Studios […] The post Former ‘Blade’ Director Left MCU Reboot Because “Life’s Too Short to Make Sh-t Films” appeared first on Bloody Disgusting! .

Bloody Disgusting View Details →
Article · Culture & ideas

‘Hellraiser: Revival’ Wins Game of the Year at The Horror Game Awards 2026

While Resident Evil Requiem took home the most awards at The Horror Game Awards this year, Clive Barker’s Hellraiser: Revival won the coveted Game of the Year Award, beating out Requiem. The Saber Interactive title also took home the Best Performance for Doug Bradley‘s return as the iconic Pinhead. Despite missing out on Game of […] The post ‘Hellraiser: Revival’ Wins Game of the Year at The Horror Game Awards 2026 appeared first on Bloody Disgusting! .

Bloody Disgusting View Details →

Keyboard shortcuts

Previous discovery
←P
Next discovery
→N
Like
L
Not for me
X
Save
S
Show this help
?
Close
Esc

Shortcuts work on the discovery page.