How is that a dark pattern? What is the light pattern for getting feedback from users?
replyThere are multiple ways to use feedback. Personally I would often be fine with actual human reading my feedback, taking in account the points I made and evaluating how it should affect their feature development and future roadmap.
replyNow what I would expect AI companies to do is to take things which were submitted as feedback and pretty much adding to training:
"Do more of this: <copy of the whole response which was flagged as good in feedback>"
"Do less of this: <copy of the whole response which was flagged as bad in feedback>"
It's paraphrased, but the point is that they will most likely use it more-or-less as-is and thus whatever is in there will be part of the model's training set rather than someone picking up the parts from response that are important and only including them (which happens with traditional feedback).
If you have a naive loop like this you will quickly poison your dataset with e.g. thumbs downs because someone is unhappy with the latest frontend update, or teach models to not correctly refuse. I’m sure the pipeline is more sophisticated and in the middle.
reply