Measure Optimal AI Share of Labor Costs Instead of AI or Human-Only Performance
Source: LessWrong ·
In a research post , Cunningham et al. of METR propose the “‘expenditure horizon’ over an optimization problem as the dollar value at which the improvement to the goal metric is equal to the improvement by a human with the same budget.” Though their work focuses on individual optimization problems (with NanoGPT as the main subject), the expenditure horizon can be meaningful for any task distribution: it’s the budget at which human-only and AI-only work reach the same performance. Though I like expenditure horizons as an operationalization of AI capability, I have a few critiques which suggest
Frequently Asked Questions
What is Measure Optimal AI Share of Labor Costs Instead of AI or Human-Only Performance?
Measure Optimal AI Share of Labor Costs Instead of AI or Human-Only Performance is a article discovery curated from LessWrong. In a research post , Cunningham et al. of METR propose the “‘expenditure horizon’ over an optimization problem as the dollar value at which the improvement to the goal metric is…
How can I access or experience this?
You can experience this content directly on its original host (LessWrong) by clicking the "Open Original" button.
Where does this content come from?
Curated from LessWrong by the OnSuggest team to surface the most interesting and serendipitous content on the web.
More like this
All Culture & ideas discoveries →The Odyssey of the Amistad
Podcast Transcript In 1839, a group of Africans from the Mende Tribe was forcibly taken from their homeland and transported across the Atlantic to be sold into slavery. However, their captors hadn’t anticipated that the people they had enslaved would fight back. What began as a desperate struggle for freedom aboard a small sailing ship ... Read more
The Possibilities of the Unseen: In Conversation with Lee Chang-dong
Lee Chang-dong. When I first met Lee Chang-dong in person, in April 2025, he was already waiting for me at his office in Seoul’s Mapo District. He sat hunched over his notes, reviewing the questions I had sent him in advance. After a moment of small talk, he looked up at me, his expression suddenly serious. “How long do you want to talk?” he asked. I thought two hours would be enough. “Not enough,” he replied. We talked for nearly four hours, with a large Secret Sunshine (2007) poster looming behind us. Our conversation took place in Seoul ahead of a retrospective of Lee’s work at Poland’s New
MUBI Podcast | “Yol”: The Picture Made from Prison (feat. Alejandro G. Iñárritu)
How do you direct a Palme d’Or-winning film…from behind bars? Our new season about dissident filmmakers kicks off with the tale of Yilmaz Güney—one of Turkish cinema’s most revered and controversial directors—from his days as a tough-guy movie star nicknamed “The Ugly King,” to his years as a left-wing activist, to his 19-year prison sentence…during which he somehow managed to make his masterpiece, Yol (1982). Featuring Oscar-winner and Yol megafan Alejandro G. Iñárritu ( Digger , 2026) and German-Turkish auteur Fatih Akin ( Head-On , 2004). The MUBI Podcast returns for its 12th season, “Under
40 Years Later, Top Gun's Most Famous Line Is Still The Greatest '80s Movie Quote
Top Gun is a 1980s classic, and the movie's most famous line works as both a representation of the decade itself and a defining trait of the film's lead character.
Jamie Dornan, like most of us, hopes Hunt For Gollum works out
In a new interview, Jamie Dornan expressed the sense of duty he feels to the role of Aragorn, and the responsibility he's taken on to ensure fans embrace <i>The Lord Of The Rings: The Hunt For Gollum</i>.
"Edgy" Grey's Anatomy spin-off gets "haunted and cynical" lead Karla Souza
"Edgy" <i>Grey's Anatomy</i> spin-off gets "haunted and cynical" lead Karla Souza