I don’t see how this is much different from the sycophancy “error” OpenAI built into its machine to drive user retention.
If a meth user is looking for reasons to keep using, then a yes-man AI system biased toward agreeing with them will give them reasons.
Honestly, it’s much scarier than meth addiction; you could reasonably argue the meth user should pull up their bootstraps and simply refuse to use the sycophantic AI.
But what about flat-earthers? What about Q-Anon? These are not people looking for the treatment of their mental illness, and a sycophantic AI will tell them “You’re on the right track. It’s freedom fighters like you this country needs. NASA doesn’t want people to know about this.”
I don’t see how this is much different from the sycophancy “error” OpenAI built into its machine to drive user retention.
If a meth user is looking for reasons to keep using, then a yes-man AI system biased toward agreeing with them will give them reasons.
Honestly, it’s much scarier than meth addiction; you could reasonably argue the meth user should pull up their bootstraps and simply refuse to use the sycophantic AI.
But what about flat-earthers? What about Q-Anon? These are not people looking for the treatment of their mental illness, and a sycophantic AI will tell them “You’re on the right track. It’s freedom fighters like you this country needs. NASA doesn’t want people to know about this.”