LLMs can learn (some) multi-step reasoning on filler tokens
Source: LessWrong ·
Research update of a project done as part of MARS 5 and the Meridian Visiting Researcher Programme . Filler-token reasoning is the ability to use extra tokens (such as a chain of thought) to reason about a task without using the words emitted at those token positions. This is possible because attention can move information between token positions without routing it through the words the LLM emits. This can give a model more parallel, but not more serial, computation. The canonical demonstration of this is the "Let's Think Dot by Dot" paper ( Pfau, Merrill & Bowman, 2024 ). There, the authors t
Frequently Asked Questions
What is LLMs can learn (some) multi-step reasoning on filler tokens?
LLMs can learn (some) multi-step reasoning on filler tokens is a article discovery curated from LessWrong. Research update of a project done as part of MARS 5 and the Meridian Visiting Researcher Programme . Filler-token reasoning is the ability to use extra tokens (such as a chain of…
How can I access or experience this?
You can experience this content directly on its original host (LessWrong) by clicking the "Open Original" button.
Where does this content come from?
Curated from LessWrong by the OnSuggest team to surface the most interesting and serendipitous content on the web.
More like this
All Culture & ideas discoveries →Film Festival Watch: 22 Sundance Institute–Supported Films Screening at the 2026 DOC NYC Festival
Few festivals celebrate the art of bringing dynamic, real-life stories to the screen quite like DOC NYC. For more than 15 years, the New York City event has championed nonfiction filmmaking, showcasing the work of visionary documentarians for audiences who want to see the world through a different lens. It’s a mission that resonates deeply […] The post Film Festival Watch: 22 Sundance Institute–Supported Films Screening at the 2026 DOC NYC Festival first appeared on sundance.org .
Joel McHale, George Lopez & Jade Pettyjohn to Star in Horror Movie ‘Junkyard’
Jade Pettyjohn (#AMFAD: All My Friends Are Dead), George Lopez (Blue Beetle), and Joel McHale (Scream 7) have been set to star in the horror movie Junkyard, Deadline reports today. Dan Riesser, who previously co-wrote and directed Bigfoot dramedy Stomping Ground, directs from a script co-written with Mike L. Kinshella. Junkyard follows “Sam (Pettyjohn), a […] The post Joel McHale, George Lopez & Jade Pettyjohn to Star in Horror Movie ‘Junkyard’ appeared first on Bloody Disgusting! .
22 Things We Learned from the ‘House of the Long Shadows’ Commentary
The world at large, and horror film lovers in particular, lost one of its kindest and most knowledgeable voices recently with the passing of David Del Valle. Loving remembrances by those who knew him can be found elsewhere, but I’m going to celebrate him with the medium where I “knew” him – via a commentary […] The post 22 Things We Learned from the ‘House of the Long Shadows’ Commentary appeared first on Bloody Disgusting! .
Viral Minecraft Horror Creator ThatMob Teases New Web Series ‘Mikey’s Magical Mayhem’
Canadian Minecraft YouTuber and digital horror creator ThatMob, known for the viral webseries and movie Verity, is developing new original horror series Mikey’s Magical Mayhem. The new series aims to introduce a new universe, original characters, and a fresh storytelling concept, and you can find the first teaser below. Like Verity, which originated in a […] The post Viral Minecraft Horror Creator ThatMob Teases New Web Series ‘Mikey’s Magical Mayhem’ appeared first on Bloody Disgusting! .
Limited Run Games Long-Awaited Release of ‘Castlevania: Rondo of Blood’ Reportedly Cancelled
If you were ever wondering what happened to that announced English release of Castlevania: Rondo of Blood from Limited Run Games for the TurboDuo (aka the TurboGrafx-CD), you weren’t the only one. Unfortunately, it turns out that the release has apparently been scrapped. Spotted by Time Extension, several fans have inquired about the release to […] The post Limited Run Games Long-Awaited Release of ‘Castlevania: Rondo of Blood’ Reportedly Cancelled appeared first on Bloody Disgusting! .
‘Hell House LLC’ Creator Teases Franchise’s Future After ‘Lineage’ Cliffhanger Ending
Writer/Director Stephen Cognetti previously stated that the fifth entry in his popular found footage franchise, Hell House LLC: Lineage, would act as the final installment. Its abrupt cliffhanger ending, however, suggested otherwise. Without delving into spoilers, the closing moments end with the protagonist discovering that an important figure in the Hell House LLC mythology was […] The post ‘Hell House LLC’ Creator Teases Franchise’s Future After ‘Lineage’ Cliffhanger Ending appeared first on Bloody Disgusting! .