Is predicting AI behaviour a neglected AI safety agenda?
Source: LessWrong ·
TL;DR: While the AI safety community is interested in forecasting, it does not tend to systematically compare how effective different researchers, models, or theories are at predicting AI behaviour. I suggest the latter might be neglected, and propose a platform that could help fill the gap. I believe its most valuable use would be as a test bed for theories of how AI works, showing which ones predict well and in what contexts. In February 2025, Owain Evans’ group published Emergent Misalignment , showing how LLMs fine-tuned on insecure code can become generally misaligned, for instance adopti
Frequently Asked Questions
What is Is predicting AI behaviour a neglected AI safety agenda??
Is predicting AI behaviour a neglected AI safety agenda? is a article discovery curated from LessWrong. TL;DR: While the AI safety community is interested in forecasting, it does not tend to systematically compare how effective different researchers, models, or theories are at…
How can I access or experience this?
You can experience this content directly on its original host (LessWrong) by clicking the "Open Original" button.
Where does this content come from?
Curated from LessWrong by the OnSuggest team to surface the most interesting and serendipitous content on the web.
More like this
All Culture & ideas discoveries →A Field Guide to Lower Colorado River Habitats, Birds, and Water Flow
Audubon Southwest’s StoryMap follows more than 400 miles of Lower Colorado River habitat. Learn what its four restoration types mean, why seasonal floods matter, and how to explore responsibly. The post A Field Guide to Lower Colorado River Habitats, Birds, and Water Flow appeared first on DocumentaryTube .
Pompeii’s Last Hours: What the Eruption Timeline Really Shows
Pompeii’s destruction unfolded in phases, not one instant. Here is what the evidence says about pumice fallout, collapsing roofs, earthquakes, pyroclastic currents and the limits of exact clock times. The post Pompeii’s Last Hours: What the Eruption Timeline Really Shows appeared first on DocumentaryTube .
10 Medieval Artists Who Changed European Art, From Giotto to Christine de Pizan
A cross-media guide to ten influential medieval creators and the paintings, manuscripts, music, and literature that shaped European art. The post 10 Medieval Artists Who Changed European Art, From Giotto to Christine de Pizan appeared first on DocumentaryTube .
How Artificial Light at Night Changes Astronomy, Health, Nature and Cultural Life
Artificial light at night is more than a stargazing problem. Here is how skyglow affects astronomy, health, wildlife, energy use and cultural connections to darkness—and how better lighting can reduce the harm. The post How Artificial Light at Night Changes Astronomy, Health, Nature and Cultural Life appeared first on DocumentaryTube .
How Christmas Feasts with Annie Gray Traces the Making of Britain’s Christmas Dinner
Christmas Feasts with Annie Gray follows the changing food, customs and inequalities behind Britain’s Christmas dinner, from Tudor showpiece birds to wartime mock foods. The post How Christmas Feasts with Annie Gray Traces the Making of Britain’s Christmas Dinner appeared first on DocumentaryTube .
13 Remarkable Animals Hidden in Plain Sight—and How Science Recognized Them
A documented tour of 13 little-known animals, explaining their habitats, unusual adaptations, evidence behind their recognition and conservation pressures. The post 13 Remarkable Animals Hidden in Plain Sight—and How Science Recognized Them appeared first on DocumentaryTube .