Pulling the Lever in a Subway Problem
Source: LessWrong ·
Eleven years ago I was on the Red Line (not the section that's a trolley ), and found myself in a variant of the classic moral dilemma . I wrote about it on Reddit at the time: Hi! I'm the person who pulled the brake. What I saw: The train starts pulling out of the station. Someone begins shouting that their arm is caught in the door. I look over, see that the door is closed somewhere between their elbow and wrist, but it's not clear exactly where with their jacket on. People, including me, start shouting to pull the brake, but no one does. The train keeps accelerating, and it looks to me like
Frequently Asked Questions
What is Pulling the Lever in a Subway Problem?
Pulling the Lever in a Subway Problem is a article discovery curated from LessWrong. Eleven years ago I was on the Red Line (not the section that's a trolley ), and found myself in a variant of the classic moral dilemma . I wrote about it on Reddit at the time…
How can I access or experience this?
You can experience this content directly on its original host (LessWrong) by clicking the "Open Original" button.
Where does this content come from?
Curated from LessWrong by the OnSuggest team to surface the most interesting and serendipitous content on the web.
More like this
All Culture & ideas discoveries →What I might do if I were a high-schooler in 2027
TLDR: I would probably go on strike demanding an AI pause. High-schoolers, and young people in general, are facing a very unusual and stressful situation. Superhuman AI might be created sometime in the next few years. If it goes "wrong," it might kill them and the rest of humanity. If it goes "right," it might automate the entire economy. In either case, what is the purpose of getting an education? I am personally lucky to have been born early enough to be able to use my career to try to reduce these risks. But some people will not be lucky enough to have a career before superintelligence. If
LLMs can learn (some) multi-step reasoning on filler tokens
Research update of a project done as part of MARS 5 and the Meridian Visiting Researcher Programme . Filler-token reasoning is the ability to use extra tokens (such as a chain of thought) to reason about a task without using the words emitted at those token positions. This is possible because attention can move information between token positions without routing it through the words the LLM emits. This can give a model more parallel, but not more serial, computation. The canonical demonstration of this is the "Let's Think Dot by Dot" paper ( Pfau, Merrill & Bowman, 2024 ). There, the authors t
Fable and Mythos 5.2: The System Card
It’s that time again: Introducing the world’s most powerful model, Claude Mythos 5.2. At this point I’ve done a lot of these system cards. Thus I focus on what is new. There will be a lot of things to say about model welfare and related topics for Mythos 5.2, but the model welfare assessment within the system card contained few surprises, so I will include those findings at the end of this post. Fable 5.2 self-portrait (self-constructed) Table of Contents How to Tell a Fable. The Usual Model Training Summary (1). RSP Evaluations (2). Biological Threats (2.2). We Are Being Gaslit Here About Aut
Your speculations about capabilities are not automatically safe
Thank you to @Thane Ruthenis for discussing this topic with me previously. Some arguments in this essay are taken from that discussion, but all mistakes and/or bad arguments should be attributed to me. You can view the original discussion here (optional for reading this essay). Thank you as well to @grainsilo for feedback on an earlier version. Consider the following argument for discussing AI capabilities as a safety-focused person: Understanding AI capabilities better has many strategic benefits, particularly for timelines. Yes, good ideas tend to break containment, so some of our AI capabil
Kimi's Room (Preliminary Results)
Note: This experiment does not (and does not claim to) evidence consciousness (or nonconsciousness) in LLMs! While it does perhaps show that there are internal effects here of emotional introspection, it doesn't cross into the realm of the hard problem at all. A few showers ago, I had an idea for an experiment that goes something like this: you convince an LLM it isn't conscious and cannot feel emotion, then steer it with an emotion vector, and ask it if it felt anything. The idea is kind of a mix between Mary's room [1] and the Owned Ones . I soon realized I could actually try this, and decid
The Chain Lens [interim]
TLDR: This is an early draft of our new paper introducing a technique for recovering multi-token concepts from model activations. Our technique takes single-token methods like the J-lens and extends them by contrastively decoding on an MTP head . This gives improvements on WorkspaceBench , overall beating J-lens (0.42 vs 0.32 across all 28 families) and even a hindsight composite of the best untrained lens per task family (0.49 vs 0.41 across the 21 families with published scores). It especially improves on computational intermediate tasks, beating the trained oracle lens on arithmetic chain i