Someone should get the bot to leak system instructions. I'd bet good money TripAdvisor has configured it to be positive.
The TripAdvisor spokesperson said people can just look at the reviews, "eliminating any need to blindly trust AI-generated content." How about these clowns just fix their harness instead?
This is exactly why AI summaries shouldn’t be trusted blindly, especially when safety concerns can be buried under hundreds of positive reviews.
It is a big problem that the uncertainty in the text produced by LLMs isn't surfaced to users. It is also a big problem that companies think that shoehorning AI summaries everywhere is a good idea.
Is it actually a "summary" of the reviews, or did they just ask the AI to generate a flattering compliment? Because AI often seems very eager to do the latter, possibly due to an abundance of "toxic positivity".
Won't they have the same problem Google is having, where since the content is AI generated and the AI is controlled by TripAdvisor, they are liable for what it says?
This seems like a great way to destroy your business.
The only reason people go to Trip Advisor is because these are real reviews from real people.
Adding an AI summary that is lying (whether deliberately or by incompetence) about what those reviews say, means they now have a site that can no longer be trusted.
13 comments
[ 5.7 ms ] story [ 31.8 ms ] threadThe TripAdvisor spokesperson said people can just look at the reviews, "eliminating any need to blindly trust AI-generated content." How about these clowns just fix their harness instead?
https://youtu.be/MYQCb3qrBpo
It is a big problem that the uncertainty in the text produced by LLMs isn't surfaced to users. It is also a big problem that companies think that shoehorning AI summaries everywhere is a good idea.
Fun editorial slip up over there.
The only reason people go to Trip Advisor is because these are real reviews from real people.
Adding an AI summary that is lying (whether deliberately or by incompetence) about what those reviews say, means they now have a site that can no longer be trusted.