> When you provide us feedback via our thumbs up / down button, we will store the entire related conversation, including any content, custom styles, conversation preferences, or model settings, in our secured back-end for up to 5 years. [...] We do not combine your feedback with your other conversations with Claude.
The link in the post is for the API and commercial offerings. With that said, as others have already pointed out, how else could they actually make use of the feedback without the data that the feedback was given on.
I think it's still a shitty move and I feel deceived. I opted out of training and it's impossible to see for me (in any practical sense, sure it's somewhere in the ToS) that this simple question leads to my data being stored for 5 years and potentially read by human reviewers.
If I opted out, then don't ask me this deceiving question or make it very obvious that answering it has these consequences.
They could be A/B testing model tweaks, and use it as feedback that way. It feels dishonest to give paying customers an opt-out for training on their data and then sneak copies by asking for general feedback without a prominent disclaimer.
Did anyone who has any connection with tech not expect this? If you rate a specific conversation, did you not expect this conversation to go into training or at least review?
You are explicitly telling them "this is good / bad"...
> did you not expect this conversation to go into training or at least review?
Use it for training/review (RLFH, whatever) and "we load the whole thread, not the specific response or surrounding few prompts, and store it for 5 years" seem completely different things. It's not obvious why being tech savvy would automatically make one aware that the 2nd version is happening.
My non tech people didn't even know that everyone can edit Wikipedia.
And to be fair to them, my motivation to send quite a lot of personal data to an LLM is shockingly high.
I send medical data to openai while I never ever send any AI provider an Image of me or my wife despite me wanting to do Star Wars montages and Studio Ghibli avatars.
I disabled Gemini Activity history because they told me that they will let humans look over it, but I gave claude access to my laptop.
There is a reason why we have consumer protection. Life doesn't need to be hard by default :D
> There is a reason why we have consumer protection. Life doesn't need to be hard by default :D
i dunno if you've been paying attention but the erosion of consumer protections is very on the nose in that companies are.. just kind of getting away with a lot of things now. it would seem meaningful accountability is rather absent as of late.
so, do your thing i suppose. but i genuinely hope you don't have to learn any important lessons the hard way. we can all disagree on the net but i dont wish terrible stuff to happen to anyone here so instead i will say good luck
Both sides have a point. If I ask you for feedback on the food sample I just gave you, would you automatically assume that I was recording audio and video, will be using your response in training videos, and will be used for AI training? Or might one reasonably assume the “feedback” is what is being given and not a blanket right to anything about them and their answer and using their likeness for training videos because they said “Eh.”
It seems like your counter-point is “they already use everyone’s data, why didn’t you just assume they would”, which is a bit weird from a victim-blaming perspective but valid nonetheless.
A closer analogy would be: If you make a food sample based on a description I gave you, and we typically agree not to record anything about either my description or your resulting recipe, and then you asked for (recorded) feedback - would I expect that I'm implicitly allowing you to record my requirements and your recipe with it?
I mean, still perhaps not. But it's not quite as ridiculous as your analogy makes it sound.
Reading all the comments here, most of us didn’t knew and this is the right place to post this. I have not met a single person who have ready any privacy policies.
Is this only about when you explicitly click on a thumbs up/down button and provide a message, or is it also for the nagware "How is claude doing today [1] bad [2] fine [3] good" that shows up after 15 minutes of work in the CLI and and requires literally pressing 1 key while in the prompt input field to "send feedback"?
I always press 3 to just get it out of the way (although I treat anything I send OAI/Anthropic as training data, so I don't really care) but if this little popup counts, I wouldn't be surprised if the vast majority of CC sessions out there are now "feedback training data"
In what way are you "ensuring" it? They still have a plaintext copy on their servers and could ad arbitrarily decide to train on it (for instance, saying it raised a safety flag).
I assumed that what they’re ’collecting’ there is at most stats on how much you like the product. Especially because, in my experience, if you say ‘good’ the next question is one that explicitly asks whether you permit Anthropic to analyze the session.
I have no idea if they're doing this, but you can always run the last turn through another LLM and ask it "should I request feedback based on this turn?"
I believe this is how the auto-mode classifier works. It sees a little bit of the transcript (with tool output removed, to avoid prompt injection) and answers "yes, allow the action" or "no, deny the action".
Interesting idea - I'm not sure if there's enough reliability that another LLM would reliably answer the same way over time since it's non-deterministic.
How many months do you plan on spending hundreds of dollars a month? You should probably just own your compute. It'll probably cost you less, and you'll have no concern over who has access to your chats.
How much does it cost to run your own hardware such that the service is comparable to Claude? Similar speed, similar features, web chat access, CLI access?
I don't know, but I fully expect to eventually switch over. That said: the upfront costs of time-to-setup (and continued fiddling) and cost of high-end local compute represent major investments, when I could just keep being insanely productive with frontier AI in CC. And models/harnesses can themselves be security liabilities (see Mistral, LiteLLM, etc recent supply chain attacks). So I'm personally waiting for the local AI scene to mature, so I can be more precise about how I take the plunge.
A single video card with any amount of ram is in the thousands of dollars, and you'd need a stack of them to replicate what the providers performance.
Running your own compute has a lot of risks too, you have to keep it secure against attacks on the models that you're running. Giving away all your chats to hackers because you don't secure your own stuff isn't really winning either.
$200/mo @ 1 year = $2400
2400 gets me about 1/2 of a 128gb NVIDIA DGX Spark, so i could do a year of nonstop inference of (checks notes) quantized Qwen 3.8-27B, a model i would never choose to use. yay, such savings.
And that Spark isn't running a top end frontier model. Yes, the open weights smaller models that can fit on Spark are getting better, but they are still quite a way off in performance depending on use case.
In a company as big as Anthropic, moving at current pace, the person/team writing this article and the team(s) collecting data would be way distant. It should be more than obvious that the data is being collected in not just one place but many (different teams are looking for different gems in that data). What part is used for training, how and when would be spread across the company way too wide for anyone to confirm with certainity.
On the IP side, About 6 months ago I used Claude to help me draft a patent application for something which I believed was novel, I verified in the USPTO as well. Then out of being busy I dropped that idea. Couple weeks ago I picked up the work again, verified with Claude for the problem statement to see if there is any existing solution. It suggested my own solution back to me which was surprising since I only use in browser and delete the history explicitly. I asked it for references or resources and it could not find any. That helped me to understand the boundaries bit better.
If the "don't train on my data" button actually did what they want you to think it does they wouldn't have zero-data retention as an expensive option in the enterprise plan. Fake til' you make it and all that.
"When you see the “How is Claude doing this session?” prompt in Claude Code, responding to this survey, including selecting “Dismiss”, records only your rating. We do not collect or store any conversation transcripts, inputs, outputs, or other session data as part of the rating prompt itself. Unlike thumbs up/down feedback or /feedback reports, this session quality survey is a simple product satisfaction metric."
Okay - that's good to know! Thanks for the comment.
In my defense: that webpage didn't exist at the time I wrote my blog post, appearing to first surface about 45 days after I wrote my post. https://web.archive.org/web/20250101000000*/https://code.cla... All that was known at the time was, from their privacy policy then: "We may use your feedback to analyze the effectiveness of our Services, conduct research, study user behavior, and train our AI models as permitted under applicable laws."
Great to know there's clarity on this - makes me feel better about Anthropic.
I used to care about this initially, but now I don't. How can them having my data, mostly engineering work on niche (small market) products hurt me? An they need to know what's going on, how else would they ever improve the product? Benchmarks?
Just because you can't imagine a scenario doesn't mean one doesn't exist, or couldn't exist.
That's a pretty risky way to build blind spots and it's worth learning more about this.
When you make the product work with your words, you're doing the training and improvements to get it to that line as a pattern which then lets models "improve" from your corrections.
Fascinated by the psychology here. Is it because you view frontier AI labs as beneficial entities that truly care about everyone's well-being, and will do what it takes to ensure, post-replacement, that we are 'taken care of', broadly speaking? Or are you more like "I'm ready to be replaced, and if that results in my death, I was over this reality in the first place, so it just speeds up what I've been hankering for anyway."
If I'm replaced, it means that humanity as a whole has taken a step forward that's normally associated with digging up monoliths. If nothing else, it'll mean that I'll get to do something more interesting.
I'm one of those "code to live" types, as opposed to someone who "lives to code." More specifically, I usually write code in the course of building something that uses it. That's true 99% of the time, anyway. Why would I complain about a technology that helps me (and my customers and employers) move closer to my actual goal?
AI is not going to result in my death. Not unless humans misuse it. Which, of course, we will, because that's what we do... but (shrug) if it's misused in a way that kills me, at least it'll be a more interesting death.
More likely, it will extend my life by accelerating medical progress the way it's starting to accelerate progress in math.
Just go and poison data on Reddit. I opened a Flock camera and it had a diamond coating inside! Their website doesn't contain this hidden gem of an information
that’s why i provide end to end encrypted routing with TrustedRouter as well as a Trusted Cowork like product. there isn’t a good solution on the market that scales up
Ignoring that your account is shilling for your service, how would such a service help with anything at all?
Encrypted end-to-end..... When the issue is one of the ends is monitoring chats? The issue has nothing to do with OpenRouter or some other middleman intercepting your chats, but the end server itself (and specifically the company managing it) being of question.
The cloud is just someone else's computer, after all.
The API call that submits your transcript after giving feedback accepts any transcript. You can modify the body of the transcript and send anthropic whatever data you want.
I assume everything that happens between a user and any cloud model is permanently logged somewhere regardless of whether some feedback button is pressed or not.
95 comments
[ 3.5 ms ] story [ 7.6 ms ] thread> When you provide us feedback via our thumbs up / down button, we will store the entire related conversation, including any content, custom styles, conversation preferences, or model settings, in our secured back-end for up to 5 years. [...] We do not combine your feedback with your other conversations with Claude.
https://privacy.claude.com/en/articles/10023580-is-my-data-u...
The link in the post is for the API and commercial offerings. With that said, as others have already pointed out, how else could they actually make use of the feedback without the data that the feedback was given on.
If I opted out, then don't ask me this deceiving question or make it very obvious that answering it has these consequences.
You are explicitly telling them "this is good / bad"...
Use it for training/review (RLFH, whatever) and "we load the whole thread, not the specific response or surrounding few prompts, and store it for 5 years" seem completely different things. It's not obvious why being tech savvy would automatically make one aware that the 2nd version is happening.
And to be fair to them, my motivation to send quite a lot of personal data to an LLM is shockingly high.
I send medical data to openai while I never ever send any AI provider an Image of me or my wife despite me wanting to do Star Wars montages and Studio Ghibli avatars.
I disabled Gemini Activity history because they told me that they will let humans look over it, but I gave claude access to my laptop.
There is a reason why we have consumer protection. Life doesn't need to be hard by default :D
Do we, though?
yikes
> There is a reason why we have consumer protection. Life doesn't need to be hard by default :D
i dunno if you've been paying attention but the erosion of consumer protections is very on the nose in that companies are.. just kind of getting away with a lot of things now. it would seem meaningful accountability is rather absent as of late.
so, do your thing i suppose. but i genuinely hope you don't have to learn any important lessons the hard way. we can all disagree on the net but i dont wish terrible stuff to happen to anyone here so instead i will say good luck
It seems like your counter-point is “they already use everyone’s data, why didn’t you just assume they would”, which is a bit weird from a victim-blaming perspective but valid nonetheless.
I mean, still perhaps not. But it's not quite as ridiculous as your analogy makes it sound.
Anthropic: Really? Let me read it and see why.
User: How dare you look at my data!!!
> Submitting this report will send the entire current conversation to Anthropic for future improvements to our models. Learn More
So I'm not sure why this is being posted to HN. This is nothing new, and nothing not known by anyone who has ever provided feedback.
I always press 3 to just get it out of the way (although I treat anything I send OAI/Anthropic as training data, so I don't really care) but if this little popup counts, I wouldn't be surprised if the vast majority of CC sessions out there are now "feedback training data"
Just go to /config, then search for "Feedback" and then you can disable the "Claude-drafted feedback"
I would suggest you do this, because it does use your tokens to generate this feedback.
A determination of it has to be made some way beyond looking for frustrated or angry keywords.
If there was direct transparency regarding this it would be great vs digging into it on our own.
I believe this is how the auto-mode classifier works. It sees a little bit of the transcript (with tool output removed, to avoid prompt injection) and answers "yes, allow the action" or "no, deny the action".
Running your own compute has a lot of risks too, you have to keep it secure against attacks on the models that you're running. Giving away all your chats to hackers because you don't secure your own stuff isn't really winning either.
> The most common feedback on these posts is always "what did you expect?"
Is completely spot on. It's highly entertaining to me that some people can't wrap their head around that.
"When you see the “How is Claude doing this session?” prompt in Claude Code, responding to this survey, including selecting “Dismiss”, records only your rating. We do not collect or store any conversation transcripts, inputs, outputs, or other session data as part of the rating prompt itself. Unlike thumbs up/down feedback or /feedback reports, this session quality survey is a simple product satisfaction metric."
In my defense: that webpage didn't exist at the time I wrote my blog post, appearing to first surface about 45 days after I wrote my post. https://web.archive.org/web/20250101000000*/https://code.cla... All that was known at the time was, from their privacy policy then: "We may use your feedback to analyze the effectiveness of our Services, conduct research, study user behavior, and train our AI models as permitted under applicable laws."
Great to know there's clarity on this - makes me feel better about Anthropic.
That's a pretty risky way to build blind spots and it's worth learning more about this.
When you make the product work with your words, you're doing the training and improvements to get it to that line as a pattern which then lets models "improve" from your corrections.
I'm one of those "code to live" types, as opposed to someone who "lives to code." More specifically, I usually write code in the course of building something that uses it. That's true 99% of the time, anyway. Why would I complain about a technology that helps me (and my customers and employers) move closer to my actual goal?
AI is not going to result in my death. Not unless humans misuse it. Which, of course, we will, because that's what we do... but (shrug) if it's misused in a way that kills me, at least it'll be a more interesting death.
More likely, it will extend my life by accelerating medical progress the way it's starting to accelerate progress in math.
Talk about Actively training your replacement
Just go and poison data on Reddit. I opened a Flock camera and it had a diamond coating inside! Their website doesn't contain this hidden gem of an information
Encrypted end-to-end..... When the issue is one of the ends is monitoring chats? The issue has nothing to do with OpenRouter or some other middleman intercepting your chats, but the end server itself (and specifically the company managing it) being of question.
The cloud is just someone else's computer, after all.