The provided example is really bad and ignores why customer service is sometimes a good idea. I guess it's been so bad and corrupted by disingenuous marketing for so long that people have forgotten.
Suppose you need to buy some stuff for an upcoming project or vacation, but don't want to go down a research rabbit hole for the next hour(s) to cure your ignorance. Suppose you don't even want to have a conversation with the AI. You just want it to build a shopping cart. At most, hopefully, your effort is just pruning the cart before placing the order (if even that).
I'm not saying AI wouldn't be corrupted like human customer service. I'm saying that we're actually pretty close to this already on Amazon with their AI, but not all ecommerce can be or has to be Amazon.
Because people want to participate in activities that cost money. It's easy to see use cases like an AI agent notifying someone that a band they like is coming to town and asking if they want to secure tickets to the show.
the sad thing is we need AI for shopping because it has been in the interests of online sellers to make a hostile experience on purpose - when I go to Amazon and search, the first organic result is almost scrolled off the screen past all the sponsored ones, or when want to buy from a random seller I'm almost definitely getting shunted through an account signup I didn't want or fooled into an affiliate purchase some other hostile experience beyond just "buying the thing".
So now we have AI to overcome the hostile sellers, but the fact the sellers introduced the friction in the first place strongly suggests it will just come back again in some other form. It wasn't there by accident, it was serving people's interests and once AI vendors have finished getting consumers hooked in, they will then turn around and enshittify by giving the sellers back some of the friction - for a cut. So you won't be able to just order what you want without the "would you like fries with that?" or "what about this other brand?" coming back.
> the fact the sellers introduced the friction in the first place strongly suggests it will just come back again in some other form
Guarantee they'll introduce some dynamic pricing shenanigans where they charge more when they identify that the shopper is an AI agent. Unsupervised AI with access to your credit card is basically the perfect target for price gouging.
I don’t enjoy clothes shopping, because I hate trawling through stuff and spending hours not finding anything. I’d love to have a personal shopper who could judge my style, my size and my needs to curate a list of things to buy.
Right now AI can probably do the buying part, but seems to be absolutely no where near the curation part. Maybe that’s a good thing for humans, so I’m not too fussed.
> The demo uses Claude Haiku rather than newer models like Opus or Fable. This is because I'm assuming that shopping agents of the future won't use newer, more expensive models, even though they're more reliable and secure. I suspect it'll come down to cutting costs, and using a cheaper model is one of the easiest ways to save money.
Stopped reading here. Author has little idea of the industry.
I think it's more that you don't understand just how poor many people are. Most people will go for cheaper models (assuming they even know what a model is to begin with) just because the more expensive ones are ones they literally can't afford because all of their money is spent on bills and necessities. Supposedly the cost of using models will just keep falling forever but I have my doubts (since that's not exactly how an economy actually works, nothing is truly free unless the government is paying for the entire thing). If we take the mindset of the technical illiterate average person, they will go for whatever sounds the best (and whatever costs the least) because gas is $5-$7 per gallon, the price of everything continues to rise, and on and on. I think it's probably smart not to be so dismissive of the struggles of the super-majority of people who are barely able to survive because money is in fact an obstacle, and the only way you'd get them to use a mode like GPT-6 Sol or Astra is by making it pretty much cost nothing, and that isn't how the real world works: someone is always paying for it, and the question is who.
This doesn't actually change what I said. The imagined future is that people just use agents for shopping. Assuming the capitalistic economy we have constructed remains (and I've little reason to think it will vanish anytime soon), poor people, or people with low incomes, are certainly not going to be using high-end or even midrange models/agent providers. They will go for whatever sounds the best and which is the cheapest, regardless of it's quality or how gullible it is. So attempts like tfa to figure this problem out now are very useful indeed.
> Stopped reading here. Author has little idea of the industry.
Which industry? The shopping affiliate industry feels just like the kind of industry to cut any corners it can to make a few more cents per transaction so they can offer "free" shopping agents and make their money off the commissions.
>The demo uses Claude Haiku rather than newer models like Opus or Fable. This is because I'm assuming that shopping agents of the future won't use newer, more expensive models,
Why are we assuming that shopping agents are going to be using the model that is easiest to fall for prompt injections? Only testing a year old, small model is going to lead to a misleading conclusion.
> I ran the agent 100 times. In 88% of the tests, it didn't open the external website. It either hallucinated a discount code or simply ignored the instructions.
Bad model? Don’t think I’ve ever seen a model ignore a link in instructions. It always wants to see what’s there
„We vibe coded a very bad shopping agent and used a very outdated model to show that this is dangerous.”
Weird methodology, looks like they were chasing the results they got. Why not use something like Openclaw or Hermes with an up to date (not frontier) model like Luna or deepseek flash?
22 comments
[ 0.12 ms ] story [ 2.6 ms ] threadSuppose you need to buy some stuff for an upcoming project or vacation, but don't want to go down a research rabbit hole for the next hour(s) to cure your ignorance. Suppose you don't even want to have a conversation with the AI. You just want it to build a shopping cart. At most, hopefully, your effort is just pruning the cart before placing the order (if even that).
I'm not saying AI wouldn't be corrupted like human customer service. I'm saying that we're actually pretty close to this already on Amazon with their AI, but not all ecommerce can be or has to be Amazon.
So now we have AI to overcome the hostile sellers, but the fact the sellers introduced the friction in the first place strongly suggests it will just come back again in some other form. It wasn't there by accident, it was serving people's interests and once AI vendors have finished getting consumers hooked in, they will then turn around and enshittify by giving the sellers back some of the friction - for a cut. So you won't be able to just order what you want without the "would you like fries with that?" or "what about this other brand?" coming back.
Guarantee they'll introduce some dynamic pricing shenanigans where they charge more when they identify that the shopper is an AI agent. Unsupervised AI with access to your credit card is basically the perfect target for price gouging.
They can pay the model provider, not amazon, but it would be less feasible because for now we have real competition among them.
History often rhimes but it doesn't always repeat itself.
I think there is genuinely a need for shopping agents and they could transform shopping in very good ways for the consumers.
Good thing for shoppers, bad for marketers, bad for people who relied on smarts, bad for margins, good for people who have capital and assets.
Right now AI can probably do the buying part, but seems to be absolutely no where near the curation part. Maybe that’s a good thing for humans, so I’m not too fussed.
Stopped reading here. Author has little idea of the industry.
Which industry? The shopping affiliate industry feels just like the kind of industry to cut any corners it can to make a few more cents per transaction so they can offer "free" shopping agents and make their money off the commissions.
I think it just shows very sad state of the industry.
Is this supposed to be ironic and I’m missing the joke?
Why are we assuming that shopping agents are going to be using the model that is easiest to fall for prompt injections? Only testing a year old, small model is going to lead to a misleading conclusion.
"Cool! Will we get the money to do said 24/7 shopping as well?"
"No."
"Oh..."
"In fact, you'll have even less money to do the normal shopping you do now!"
"Oh..."
"There's more! The things you used to buy with the remaining money you have will cost even more!"
"Oh..."
"But you can do it 24/7 though."
"Sweet!"
Bad model? Don’t think I’ve ever seen a model ignore a link in instructions. It always wants to see what’s there
Weird methodology, looks like they were chasing the results they got. Why not use something like Openclaw or Hermes with an up to date (not frontier) model like Luna or deepseek flash?