Homeopathic Learning: Diluting Poisoned Fine-Tuning Data Can Strengthen Its Effect
Source: LessWrong ·
Authors: Matt Clarke *, Jan Dubiński *, James Chua , Simon Schrodi , Owain Evans , Alex Cloud (*- Core contribution) tl;dr. We find that poisoned training data with little effect on its own can create a hidden backdoor once clean, contrasting data is added. We demonstrate this effect in small models fine-tuned on datasets we constructed. 📄 Paper , 💻 Code , 🐦 Twitter Work done as part of the Anthropic Fellows Program , in collaboration with Truthful AI . This article is cross-posted from the Anthropic Alignment Science Blog . Paper abstract We study homeopathic learning , a phenomenon where
Frequently Asked Questions
What is Homeopathic Learning: Diluting Poisoned Fine-Tuning Data Can Strengthen Its Effect?
Homeopathic Learning: Diluting Poisoned Fine-Tuning Data Can Strengthen Its Effect is a article discovery curated from LessWrong. Authors: Matt Clarke *, Jan Dubiński *, James Chua , Simon Schrodi , Owain Evans , Alex Cloud (*- Core contribution) tl;dr. We find that poisoned training data with little effect…
How can I access or experience this?
You can experience this content directly on its original host (LessWrong) by clicking the "Open Original" button.
Where does this content come from?
Curated from LessWrong by the OnSuggest team to surface the most interesting and serendipitous content on the web.
More like this
All Culture & ideas discoveries →The World’s Best Breakfast Sliders
There used to be a bakery in my neighborhood that made the most delicious breakfast sandwiches with these thick, fluffy squares of baked eggs so tall and golden yellow you’d swear it was a cheese soufflé. Unfortunately the sandwich left the menu several years ago, and with it my enigmatic favorite breakfast egg. Then I saw a picture of Grilled Cheese Social’s fluffy egg sandwiches, and they reminded me of what I’d been missing. READ MORE...
This Rare KitchenAid Mixer Sale Is the Best I’ve Ever Seen
It’s guaranteed to get me baking. READ MORE...
Skip the Packet: This Flavorful Gravy Is Like Liquid Gold
Whenever I’m asked which Thanksgiving side dishes are my favorite, my answer is always as follows: super-rich mashed potatoes and herb stuffing. But the caveat is that both of those dishes (and the turkey) have to be absolutely covered in turkey gravy when they’re on my plate. Gravy is the element that ties all the different things together and is what I look forward to the most at Thanksgiving. READ MORE...
The Essential Thanksgiving Kitchen Gear Black Friday Deals
I’ll never cook a holiday meal without them. READ MORE...
My Family Asks For "Butter-Swim Biscuits" Every Thanksgiving
You only need one bowl to make them. READ MORE...
40 Delicious Vegetarian Thanksgiving Side Dishes
We all know that the best part of Thanksgiving dinner are the side dishes. And I have really great news when it comes to sticking with vegetarian Thanksgiving sides: Nearly all of the most crowd-pleasing side dishes are naturally meat-free. From the mashed potatoes and stuffing to the cranberry sauce and everything in between, we’ve got 40 can’t-miss vegetarian sides for your Thanksgiving dinner. READ MORE...