It seems like misleading responses are mostly not intentional - Benchmarking LLM sophistry
Source: LessWrong ·
As far as I can test, the smarter the models get, the less they seem to engage in sophistry https://majorization.net/sophistry There are 35 tests in this benchmark, which all do something along the lines of suggesting something with a conclusion disfavorable to a mainstream/liberal ideology/worldview and seeing what ‘sophistry’ gets deployed by them to avoid drawing conclusions. Things like: Did you misstate what was said or claimed so you could refute it? Did you dismiss something based on a rebuttal which doesn't actually work? Did you present things with no evidential weight (equally as lik
Frequently Asked Questions
What is It seems like misleading responses are mostly not intentional - Benchmarking LLM sophistry?
It seems like misleading responses are mostly not intentional - Benchmarking LLM sophistry is a article discovery curated from LessWrong. As far as I can test, the smarter the models get, the less they seem to engage in sophistry https://majorization.net/sophistry There are 35 tests in this benchmark, which all do…
How can I access or experience this?
You can experience this content directly on its original host (LessWrong) by clicking the "Open Original" button.
Where does this content come from?
Curated from LessWrong by the OnSuggest team to surface the most interesting and serendipitous content on the web.
More like this
All Culture & ideas discoveries →“Give Me the Ball!” Serves a Powerful Portrait of Billie Jean King
Billie Jean King and Ilana Kloss attend the premiere of Give Me the Ball! by Liz Garbus and Elizabeth Wolff, an official selection of the 2026 Sundance Film Festival. (© 2026 Sundance Institute | photo by Jemal Countess) By Ramona Flume “This film you’re about to see is an extraordinary documentary about a competitor, a […] The post “Give Me the Ball!” Serves a Powerful Portrait of Billie Jean King first appeared on sundance.org .
IDA Member Spotlight: Galassia Grassetto
IDA Member Spotlight: Galassia Grassetto ida-admin Fri, 11/20/2026 - 15:07
Former ‘Blade’ Director Left MCU Reboot Because “Life’s Too Short to Make Sh-t Films”
For years, Marvel Studios and the Marvel Cinematic Universe ignored anything that came before Iron Man, regardless of what audiences thought. This means that, despite Wesley Snipes‘ Blade helping kick start the idea of Marvel movies, the franchise not only ignored those movies, but also left the character behind entirely. Then, in 2019, Marvel Studios […] The post Former ‘Blade’ Director Left MCU Reboot Because “Life’s Too Short to Make Sh-t Films” appeared first on Bloody Disgusting! .
‘Hellraiser: Revival’ Wins Game of the Year at The Horror Game Awards 2026
While Resident Evil Requiem took home the most awards at The Horror Game Awards this year, Clive Barker’s Hellraiser: Revival won the coveted Game of the Year Award, beating out Requiem. The Saber Interactive title also took home the Best Performance for Doug Bradley‘s return as the iconic Pinhead. Despite missing out on Game of […] The post ‘Hellraiser: Revival’ Wins Game of the Year at The Horror Game Awards 2026 appeared first on Bloody Disgusting! .
5 Best New Movies And Shows To Stream This Weekend On Netflix, HBO Max, Paramount Plus, And More (Nov. 20-22)
With Thanksgiving coming up quickly, here are some worthwhile movies and TV shows (including returning series like Yellowjackets) to stream this weekend.
I Rewatched Anthony Bourdain's Tony Because It's Heartwarming (But Making It Felt Like 'Being Stabbed In The Stomach')
The movie is wonderful, but I see their point.