On the IP side, About 6 months ago I used Claude to help me draft a patent application for something which I believed was novel, I verified in the USPTO as well. Then out of being busy I dropped that idea. Couple weeks ago I picked up the work again, verified with Claude for the problem statement to see if there is any existing solution. It suggested my own solution back to me which was surprising since I only use in browser and delete the history explicitly. I asked it for references or resources and it could not find any. That helped me to understand the boundaries bit better.These models may not train directly on my chats and data, but in some cases it does seem to keep an impression of the pattern and process.
> The most common feedback on these posts is always "what did you expect?"
Is completely spot on. It's highly entertaining to me that some people can't wrap their head around that.
A determination of it has to be made some way beyond looking for frustrated or angry keywords.
If there was direct transparency regarding this it would be great vs digging into it on our own.
I believe this is how the auto-mode classifier works. It sees a little bit of the transcript (with tool output removed, to avoid prompt injection) and answers "yes, allow the action" or "no, deny the action".
Running your own compute has a lot of risks too, you have to keep it secure against attacks on the models that you're running. Giving away all your chats to hackers because you don't secure your own stuff isn't really winning either.
People chasing the best of the best models for all tasks in order to "keep up" are only wasting resources at this point.
Regarding similar features, there are lots of off the shelf harnesses that support all that, or can easily be extended (literally just ask your agent) to do it.
You don't care anyways. Actual engineering works "100%" fine with small models now. You should try it!
You are explicitly telling them "this is good / bad"...
And to be fair to them, my motivation to send quite a lot of personal data to an LLM is shockingly high.
I send medical data to openai while I never ever send any AI provider an Image of me or my wife despite me wanting to do Star Wars montages and Studio Ghibli avatars.
I disabled Gemini Activity history because they told me that they will let humans look over it, but I gave claude access to my laptop.
There is a reason why we have consumer protection. Life doesn't need to be hard by default :D
yikes
> There is a reason why we have consumer protection. Life doesn't need to be hard by default :D
i dunno if you've been paying attention but the erosion of consumer protections is very on the nose in that companies are.. just kind of getting away with a lot of things now. it would seem meaningful accountability is rather absent as of late.
so, do your thing i suppose. but i genuinely hope you don't have to learn any important lessons the hard way. we can all disagree on the net but i dont wish terrible stuff to happen to anyone here so instead i will say good luck
It seems like your counter-point is “they already use everyone’s data, why didn’t you just assume they would”, which is a bit weird from a victim-blaming perspective but valid nonetheless.
I mean, still perhaps not. But it's not quite as ridiculous as your analogy makes it sound.
Use it for training/review (RLHF, whatever) and "we load the whole thread, not the specific response or surrounding few prompts, and store it for 5 years" seem completely different things. It's not obvious why being tech savvy would automatically make one aware that the 2nd version is happening.
I always press 3 to just get it out of the way (although I treat anything I send OAI/Anthropic as training data, so I don't really care) but if this little popup counts, I wouldn't be surprised if the vast majority of CC sessions out there are now "feedback training data"
https://privacy.claude.com/en/articles/10023580-is-my-data-u...
> This article is about our consumer products such as Claude Free, Pro, Max and when accounts from those plans use Claude Code.
Of course, all your data is taken for free. It will be used for profit, but not for your profit of course.
WTF
https://privacy.claude.com/en/articles/10023580-is-my-data-u...
The link in the post is for the API and commercial offerings. With that said, as others have already pointed out, how else could they actually make use of the feedback without the data that the feedback was given on.
If I opted out, then don't ask me this deceiving question or make it very obvious that answering it has these consequences.
They will train on it, and now competitors or future competitors will know about your niche, the specific problems you face within it, and how to solve them without doing the work that you did to get there.
That's a pretty risky way to build blind spots and it's worth learning more about this.
When you make the product work with your words, you're doing the training and improvements to get it to that line as a pattern which then lets models "improve" from your corrections.
Just go to /config, then search for "Feedback" and then you can disable the "Claude-drafted feedback"
I would suggest you do this, because it does use your tokens to generate this feedback.
Encrypted end-to-end..... When the issue is one of the ends is monitoring chats? The issue has nothing to do with OpenRouter or some other middleman intercepting your chats, but the end server itself (and specifically the company managing it) being of question.
The cloud is just someone else's computer, after all.
> Submitting this report will send the entire current conversation to Anthropic for future improvements to our models. Learn More
So I'm not sure why this is being posted to HN. This is nothing new, and nothing not known by anyone who has ever provided feedback.
This has been explained to me as being true by someone I trust a lot, to the point that they have implemented proxying to prevent it.
Anthropic: Really? Let me read it and see why.
User: How dare you look at my data!!!
> When you provide us feedback via our thumbs up / down button, we will store the entire related conversation, including any content, custom styles, conversation preferences, or model settings, in our secured back-end for up to 5 years. [...] We do not combine your feedback with your other conversations with Claude.
There's a whole spectrum of things they could do from most to least aligned with that as a principle.
For example, they could have a thumbs up/down
- just track the metadata of the conversation (e.g. model used, how far through its context it was, how old the session was) - track metadata of the user as a whole (how often they use Claude, how many other "active" conversations they have on the go, how much they've tested other models, if this is their first time using new tweaks to params etc) - have contextual feedback of the chat available for humans to review (alongside the comments you put in the feedback), but not explicitly train on it.
Whereas the option they've chosen is:
> If you explicitly report feedback or bugs to us (e.g. via our thumbs up/down feedback button), or otherwise choose to allow us to use your data, then we may use your chats and coding sessions to train our models.
So literally using your session as training input. They also could've allowed this to be an opt-in on bug reports.
> - just track the metadata of the conversation
This is useless
Is it as good as capturing everything for them? No, of course not. But then don't frame the whole thing as "if you're on an enterprise plan we won't train on your data"
Talk about Actively training your replacement
Just go and poison data on Reddit. I opened a Flock camera and it had a diamond coating inside! Their website doesn't contain this hidden gem of an information
