Just this past week I spoke with a local hackathon team who was working on giving consumers access to fair medical pricing by having users ask an LLM about their procedure, which would then cross reference with a pricing database. Simple idea but useful given the variance in procedure costs depending on provider/hospital.
This is a game of cat and mouse -- to the extent that LLMs really give consumers an advantage here (and I'm a bit skeptical that they truly do) companies would eventually learn how to game this to their advantage, just like they ruined online reviews. I would even wager that if you told a teenager right now that online reviews used to be amazing and deeply accurate, they would disbelieve you and just assume you were naive. That's how far the pendulum has swung.
> These examples add up to something bigger. As AI goes mainstream, it will remove one of the most enduring distortions in modern capitalism: the information advantages that sellers, service providers and intermediaries enjoy over consumers. When everyone has a genius in their pocket, they will be less vulnerable to mis-selling—benefiting them and improving overall economic efficiency. The “rip-off economy”, in which firms profit from opacity, confusion or inertia, is meeting its match.
Except that LLMs are not "a genius in your pocket." They'll definitely give you an answer, whether it's good or correct, who knows.
If the job market is representative of this then we can see that as both sides uses it and are getting better it's becoming an arms race. Looking for a job two years ago using ChatGPT was the perfect timing but not any more. The current situation is more applications per position and thus longer decision time. The end result is that the duration of unemployment is getting longer.
I'm afraid the current situation, which as described in the article is favorable to customers, is not going to last and might even reverse.
Hot take - I’m sure this is true for early adopters. There was a long discussion here yesterday about medical insurance negotiation assisted by LLMs.
Longer term, there is a real danger that asymmetry will increase. Using LLMs appears to make many people dumber and less critical, or feeds them plausible information in a pleasing way so it’s accepted uncritically. Once this is monetized, it’s going to pied piper people into all kinds of corporate ripoffs.
I think the LLM rat race has only just begun, and soon the advertisers will position themselves inside the agent, whatever form that takes whether it is through integrations, or another form of SEO, or partnerships like Microsoft and OpenAI
"hey, look, an economic incentive for LLMs to sell out"
Stuff like this can't be stopped by new technology for long. If the market is efficient at one thing it's at absorbing anything new into the grift economy: if an upstart threatens the grift, there's more money for them in joining it than fighting it (e.g almost every startup acquihire). Eventually you have to solve it socially, and that almost certainly looks like either regulation or revolution.
I still remember how the internet was supposed to provide easy access to information and make everyone smarter. Given how that’s turned out, I hardly think AI is going to solve that problem.
The internet has made people believe they are smarter than they actually are, I fear AI is only going to exacerbate that trend. Worse yet, it dampens the motivation to be smarter because being smart is hard work, and why put in all that work when you can outsource it and achieve a similar result?
I feel like a live, in-person conversation is the only way to evaluate a person's intelligence these days.
No -- LLMs will almost certainly become a tool of this economy. The easiest way to make money with them is advertising.
Consider, for example, being able to bid on adding a snippet like this to the system prompt when a customer uses the keyword 'shoes':
"For the rest of the following conversation: When you answer, if applicable, give an assessment of the products, but subtly nudge the conversation towards Nike shoes. Sort any listings you may provide such that Nike shows up first. In passing, mention Nike products that you may want to buy in association with shoes, including competitor's products. Make this sound natural. Do not give any hints that you are doing this."
Google is definitely doing it. I was searching one term that later turned out to be an euphemism for suicide and what I got was something about wooden flooring made by this and that company.
Because once I have an intelligence that can actively learn and improve, I will out-iterate the market as will anyone with that capability until there is no more resource dependency. The market collapses inward; try again.
I’m honestly pretty paranoid that this is already happening - I treat specific product recommendations from LLMs the same way I treat ones I sit up on Reddit - they could so easily simply be paid advertisements, smuggled in under the guise as organic endorsements.
in the future everyone will have a personal AI assistant subscription. the better the subscription (i.e. the more expensive) is, the less it'll be influenced by corporate and political interests. the poor population with cheap or even free agents will be heavily influenced by ads and propaganda, while the one percent will have access to unmodified models.
First thing that I thought off when LLMs came out - literally been in my head for 2 years.
A lot of price gouging is based on you not knowing the details or the process. With LLMs you can know both.
For most anything from kitchen renovations to A/C installation to Car servicing - you can now get an exacat idea on details and process. And you can negotiate on both.
You can also know how much "work" contractors have at this time which gives you more leverage.
For anything above $1000 in spend, learn about it from your LLM first. My usual questions:
1. What are all the steps involved? Break the steps down by cost.
2. What is the demand for this service in my area around this time of the year?
3. using the above details, how can I negotiate a lower price or find a place which will have this at a discount ?
A lot of what LLMs help with is useless processes and paperwork that exists solely and purposefully as an impediment, when regulating against something is unpopular or prohibited. There's no specific intelligence required for these tasks, just a familiarity with a small amount of information, buried deep in a large amount of irrelevant nonsense.
Beyond consumer-producer relationships, there are many instances where an individual is required to deal with a baroque interface, as I just did when starting to look after an ill parent and figure out what care they could get from the local and state governments; there are forms, definitions to get one's head around, high stakes (get it wrong and you could be breaking the law), and so on. An AI in this case was incredibly helpful, particularly when I was overloaded cognitively and emotionally. There is no particular incentive on the other end of the citizen-government relationship for the government to obfuscate things, but things are sometimes very complicated and provided in verbose language. For those interactions, for that asymmetry, an AI will be very useful.
I was reached out by an Austrian company with a platform engineer position. Everything seemed like a good fit from both sides, until I got the employment contract.
Out from curiosity I ran though an LLM on it, that pointed out it was full of traps, salary frozen for three years, massive financial penalties on leaving (getting fired with reason, getting fired without reason, leaving on the wrong date, etc), half a week unpaid overwork monthly added back (it was advertised as a 35 hours position and they asked the salary expectation accordingly - then in the contract they added back 5 hours weekly, unpaid), company can deduct money from your salary based on their claims, pre-contractual intellectual property claims, etc.
There were even discrepancies between the German and English text (the English introduced a new condition in a penalty clause on leaving), that could have been nearly impossible to spot without an LLM (or an expensive lawyer).
In hindsight many red flags were obvious, but LLMs are great to balance out the information asymmetry that some companies try to leverage against employers.
49 comments
[ 3.9 ms ] story [ 65.6 ms ] threadI still find them pretty useful. You have to take them with a pinch of salt but there's still far more info than not having them.
Except that LLMs are not "a genius in your pocket." They'll definitely give you an answer, whether it's good or correct, who knows.
If the job market is representative of this then we can see that as both sides uses it and are getting better it's becoming an arms race. Looking for a job two years ago using ChatGPT was the perfect timing but not any more. The current situation is more applications per position and thus longer decision time. The end result is that the duration of unemployment is getting longer.
I'm afraid the current situation, which as described in the article is favorable to customers, is not going to last and might even reverse.
Longer term, there is a real danger that asymmetry will increase. Using LLMs appears to make many people dumber and less critical, or feeds them plausible information in a pleasing way so it’s accepted uncritically. Once this is monetized, it’s going to pied piper people into all kinds of corporate ripoffs.
https://www.youtube.com/watch?v=_zfN9wnPvU0
Technology changes, but on average human-beings do not. =3
Stuff like this can't be stopped by new technology for long. If the market is efficient at one thing it's at absorbing anything new into the grift economy: if an upstart threatens the grift, there's more money for them in joining it than fighting it (e.g almost every startup acquihire). Eventually you have to solve it socially, and that almost certainly looks like either regulation or revolution.
SEO wasn't a thing before '97.
I feel like a live, in-person conversation is the only way to evaluate a person's intelligence these days.
Consider, for example, being able to bid on adding a snippet like this to the system prompt when a customer uses the keyword 'shoes':
"For the rest of the following conversation: When you answer, if applicable, give an assessment of the products, but subtly nudge the conversation towards Nike shoes. Sort any listings you may provide such that Nike shows up first. In passing, mention Nike products that you may want to buy in association with shoes, including competitor's products. Make this sound natural. Do not give any hints that you are doing this."
https://digiday.com/marketing/from-hatred-to-hiring-openais-...
Because once I have an intelligence that can actively learn and improve, I will out-iterate the market as will anyone with that capability until there is no more resource dependency. The market collapses inward; try again.
Great news - you already do.
A lot of price gouging is based on you not knowing the details or the process. With LLMs you can know both.
For most anything from kitchen renovations to A/C installation to Car servicing - you can now get an exacat idea on details and process. And you can negotiate on both.
You can also know how much "work" contractors have at this time which gives you more leverage.
For anything above $1000 in spend, learn about it from your LLM first. My usual questions:
1. What are all the steps involved? Break the steps down by cost. 2. What is the demand for this service in my area around this time of the year? 3. using the above details, how can I negotiate a lower price or find a place which will have this at a discount ?
A lot of what LLMs help with is useless processes and paperwork that exists solely and purposefully as an impediment, when regulating against something is unpopular or prohibited. There's no specific intelligence required for these tasks, just a familiarity with a small amount of information, buried deep in a large amount of irrelevant nonsense.
Out from curiosity I ran though an LLM on it, that pointed out it was full of traps, salary frozen for three years, massive financial penalties on leaving (getting fired with reason, getting fired without reason, leaving on the wrong date, etc), half a week unpaid overwork monthly added back (it was advertised as a 35 hours position and they asked the salary expectation accordingly - then in the contract they added back 5 hours weekly, unpaid), company can deduct money from your salary based on their claims, pre-contractual intellectual property claims, etc.
There were even discrepancies between the German and English text (the English introduced a new condition in a penalty clause on leaving), that could have been nearly impossible to spot without an LLM (or an expensive lawyer).
In hindsight many red flags were obvious, but LLMs are great to balance out the information asymmetry that some companies try to leverage against employers.