"Among the concerns the FTC is investigating is whether the data generated about a consumer’s home by iRobot’s Roomba vacuum will give it an unfair advantage over a wide variety of other retailers. That concern was voiced by multiple critics of the deal when it was first announced early this month. For example, Amazon could have an advantage with a consumer looking to buy a couch, by using detailed home maps generated by iRobot to suggested particular items."
How detailed are the maps? I'm assuming they're using SLAM. [1] If so, the maps aren't that detailed, and I struggle to see how the maps will give them an unfair _retail_ advantage.
I do get the need for the review, it's just this point that doesn't make sense to me.
This is Amazon, the company which still offers to sell me more vacuum cleaners after I buy one.
The company which will completely ignore keywords like "6A" in a desperate attempt to show you anything but what you're looking for.
I'm not so worried!
Added: this is also the company which sells a popular line of home-security cameras, some of which are meant to be installed indoors. Worrying about your vacuum snitching on you makes good sci-fi but maybe this product isn't where regulators should be focusing.
The reason after you make a purchase you still see offers for the same product is because you are still statistically more likely to purchase a vacuum than average. What if the vacuum doesn’t work well, it’s too heavy, the package doesn’t arrive? You’ll be turning around and buying another.
Not quite. ML algorithms that continuously crunch billions of data points don't need to be called "genius", they're simply way more exhaustive in their search of optimums than "a vague idea from a regular person on the Internet that the best reaction to such situation is to do x" (with absolutely zero evidence to show for it of course).
AIUI, recommendations can come from multiple providers. If very detailed recommendations that take into account the fact that you’ve already bought a vacuum timeout, then your recommendations come from a dumber provider that is based on recent searches.
Just because they are inept now doesn't mean we should allow them something that could turn into an unfair advantage once they figure out how to actually do it.
The issue probably isn't the final map but the raw data used to generate it. Which in the case of the newer iRobots is cameras. So the question is, how much is extensive continuously updated photos of everything in your house worth to Amazon?
For example, you search for decorative pillows and they filter based on those that match the style and color scheme of your living room. That would be an advantage over other retailers, and is just one simple example. OTOH implementation is everything and that wouldn't work well if you just ordered new furniture from somewhere else and are looking for pillows to match that.
Even if the maps are basic, it would allow Amazon to jack up the prices for amazon.com queries from the same IP address if the place, say, is really big. iRobot app also encourages naming all areas in the house, so that too can be pretty telling.
In fact, iRobot requires the access to the location services to initialize their iOS apps, so even without a map this would allow Amazon to link an IP address to the exact property. Creative abuse of this combo can go a very long way.
I think rather than misinformed, you just left out a word in your claim. If you added the word "yet", then it would seem more appropriate to me.
If the advertising world believes that targeted ads are the holy grail, then why wouldn't retailers believe targeted pricing to be also be the holy grail?
Targeted pricing is the holy grail, it’s just normally done through market segmentation and targeted advertisement.
My personal belief is that if Amazon tried what you’re suggesting, they’d be shooting themselves in the foot (lose any remaining customer trust, regulators would be all over them, and competitors like Walmart would use it to gain market share overnight). In fact I was really hoping you’d share an article describing Amazon doing this so I have justification to cancel prime, ha!
Honestly, I was just going all 1984 on the concept.
However, if Amazon was really wanting to do this, they already know the avg income on everyone of their customers that have an Amazon credit card. That would be the ultimate in targeted pricing. Not just Amazon, any store branded card.
They tried it before, it was quickly noticed, and they apologized. But since then, they've started doing it with Prime membership, offering some deals only to Prime members while everyone else pays full price. That's not quite the same thing but certainly is hanging out in the same neighborhood.
Other way around. An app with Bluetooth/Wifi access can determine your approximate location by seeing what devices are nearby. So the OS asks you to grant location permissions since, in effect, that is what you're granting the app.
It means they could eliminate that requirement but it wouldn't be a meaningful improvement to privacy, because the roomba would still know where it is.
Amazon has your shipping address. Given an address, I can get the size of your house, the number of floors, room distribution and price from a few API calls, no ML required.
I have a feeling that I lot of people don't appreciate the degree of information about them that is public as a matter of policy and law. It's cheaper and easier to obtain today than a few decades ago but much of it has long been public.
Of course, availability through an API can greatly expand how the information is used but, for the most part, it's tricky to say that data is public but you have to make it painful to access.
Price discrimination based on home dimensions is illegal in Europe, so most people here are fine with some of their info landing on a publicly accessible cadastre database.
Even occupancy grids can be used to detect if you some kind of furniture or what kind of windows you have. Also, iRobot added visual slam some time ago, those maps can give huge amount of detail even if they don't contain images, just feature based bag of words models.
Pretty detailed. I used to own one of the high-end Roombas that would show you a map of your house, and the wifi signal strength in all the nooks and crannies (really quite useful when you move to a new home).
It doesn't show what kind of chair you have or what you have on the walls, or anything like that. But it's not hard at all to determine the size of the rooms, the layout, the placement of key pieces of furniture, and similar things. From the way a home is arranged and the amount of furniture, I can easily think of ways that the map could be used to infer information about a home. (Larger couch and entertainment center may indicate someone more interested in consuming media. Individual chairs around a smaller coffee table — perhaps they like entertaining.)
The maps are far from accurate, since there are a number of problems with a Roomba building a full map: Closed doors; areas cordoned off by lighthouses; unless you put blue painter's tape over the sensors, Roomba thinks rugs with black in them are cliffs.
But the maps don't have to be prefect to be very revealing. Especially since the higher-level Roombas have cameras on them. I don't know how detailed the images they capture are, but even if they are only vague monochrome blurs, that's enough to determine patterns of activity in the house. (Family regularly comes home at 5pm? Start advertising dinner food on partner web sites and apps.)
If you're talking about SLAM you're overanalyzing the situation. Essentially, unfettered decades of rapacious corporate abuse has created a group of people who are essentially skeptical of anything that big business does. FTC Commissioner Lina Khan is one of those people and is now coming at Big Tech with a broadsword. Because Big Tech is so abusive, most of this makes sense, but much of it does not (eg. blocking a small VR app acquisition by Facebook)
> How detailed are the maps? I'm assuming they're using SLAM. [1] If so, the maps aren't that detailed
A few years ago I would have probably agreed. But modern machine learning can draw spooky inferences from seemingly sparse data, on a scale that makes it practical. As the roomba bumps around a room it will learn where obstacles are but not what those obstacles are. But the size and shape of the footprint of those obstacles probably contains enough information to make guesses at what those might be. Approximate identification of some obstacles as couches is probably possible, just from the size and shape, and likely the position of those obstacles in the room.
That won't tell you how old the couch is, or whether it's worn out or not, but if the roomba can't find any probable couches in that person's house, advertising couches to that person may pay off.
Also, did the roomba start finding a new room recently, but the other rooms have remained the same? That person may have build an addition to their house, or started furnishing their basement. Did all the rooms change but the roomba is still paired to the same smartphone? They may have moved into a new home. In either case, if the new room[s] don't have couch-shaped obstacles, advertise couches.
And this is just with the bumpers. If Amazon adds a camera to roombas, the snooping potential is obvious.
Yep, pretty much exactly this. I've spent some time with SLAM, and in my experience, it's usually just a part of a larger ML pipeline. Not only can SLAM be paired with external data sources to generate labeled 3D objects, but inferences can be drawn directly from a generated point cloud without any ML involved.
My best guess for this is that floor plans and furniture can be used to _fingerprint_ a user, rather than knowing that the user owns a couch so that The Company can recommend a particular CPG. Knowing who their target demographics are with greater accuracy certainly feeds back into their recommender systems, but not so directly, which makes me concerned for this investigation's success.
This article is misleading. It’s the only source I can find claiming that there is an FTC investigation. This sounds like part of the FTC’s antitrust review for the acquisition, which is standard procedure.
The iRobot’s stock price also has not tanked, suggesting that this is indeed just a standard review rather than an investigation.
It's getting harder to stay out of the orbit of Facebook and Amazon. When Meta bought Oculus I gave mine away. I'm keeping the Roomba but.. I am wary of it now.
As much as they don't want to admit it, Eero has been indeed Amazonified. Making weird, unfocused products and no longer supporting the community that existed around the products. I'm likely stepping up to Ubiquiti with the next Wi-Fi generation as my home networking needs have become more intense. (Who's hasn't?)
And there is another reason why "smart" devices are all so dangerous. The older Roombas without any kind of network connectivity are still as safe to use as they were before.
my older Roomba did not have any of these mapping features. it would show a map of the space it crawled over at the end of a job. the next model up allowed for the naming of rooms and allowing the roomba to clean a specific room by name. however, earlier this year, my roomba received an update that now allows it to "map" the house. it's a rountine it will run around the house banging into things to generate that map without doing any cleaning. after that, it will allow you to name rooms and clean by specified room. i've never run that special mapping routine.
My concern is more with Amazon making the repairability of roombas non existent.
I own a non WiFi enabled roomba it's 7 years old and in that time apart from the brushes etc I've had to replace the bin and motor which cost a tenth of the cost of the whole unit.
I love the fact you can buy just about any part that might fail and fix it yourself. I don't see that being the case if any of the major tech corps buy irobot :(
We bought a Roomba early this year and the factor that tipped the scales towards iRobot over others was that they still sell parts for the original Roomba, which suggested we could count on being able to repair ours well into the future. If Amazon changes that, I'll be ticked.
Absolutely. I love how much I can repair/maintain my Roomba. It's the most maintainable device in the house, almost. There's two dogs that shed, so we're rather rough on the Roomba and Braava. It's not like core components break, it's all wear items that are very easily serviceable. (I actually desire a more top of the line, more repairable & pet-friendly Roomba.)
Amazon's hardware product ethos is the exact inverse. Replace it or trade it in when it's old or dies, and buy the new one. Their hardware, even some recent Kindles, doesn't scream premium quality.
Is it just me or can anyone else envision a near future where Amazon puts cameras on these Roombas and comes up with some consumer-friendly reason for doing so?
There are cameras in the latest Roombas already. They're actually quite helpful: they're used to detect if it's about to run into something it shouldn't, like power cables, cloths, or pet accidents. With just the pressure sensor some things won't trigger the "back away" response that really should have.
Well there you go then. That’s why Amazon would buy them. This talk of “maps of your house” and the low-res diagrams people post seem to be a red herring.
Why doesn’t Roomba show you the photos it’s taking? Or does it?
It does. If it runs into a new obstacle it's not sure about, it'll take a picture and show you to have you confirm whether it should avoid it in the future.
Amazon's problem here is that the head of the FTC (Lina Khan) does not like Amazon. See her 2017 Yale Law Journal article about wanting to break them up [0]. Many of the bureaucrats that Biden has hired into his administration do not like big business and will do whatever they can to stop them.
"Does not like Amazon" or "do not like big business" is an awfully unchariable way to frame it: She believes that "the current framework in antitrust —specifically its pegging competition to 'consumer welfare,' defined as short-term price effects— is unequipped to capture the architecture of market power in the modern economy."
The FTC exists "to protect the public from deceptive or unfair business practices and from unfair methods of competition through law enforcement, advocacy, research, and education."[1] When Amazon and other big businesses harm the public through predatory pricing and other anticompetitive business practices, it's the FTC's obvious charter to do whatever they can to stop those businesses, whoever they are and whatever they're doing.
Their personal preferences don't matter that much. Even if these administrators are true believers in what they say and not just following the political winds, they're only going to be appointed if it's politically expedient for someone with that stance to be in that position.
So the political determiner is not that Linda Khan doesn't like Amazon, but the politically favourable thing for the Democratic party is to have someone poking big tech * . This makes sense too - it courts people on the economic left who see big tech driving inequality in tech cities, it courts people concerned with privacy, it even courts some folks on the moderate right who see big tech as an enemy because of censorship.
* And it is just big tech - you don't see the same rhetoric in other industries at the moment. For example Disney's ownership of Marvel, lucasfilm, Pixar, 20thC Fox, HBO, ABC, ESPN is approaching monopolistic but nobody is proposing blocking new acquisitions let alone breaking it up.
I am pretty sure the last Roomba I looked at had an upward-facing camera.
Amazon can therefore ask the drone, I mean Roomba, to take a closer look at something.
This could be tied in with AI: move to the window and detect curtains or window coverings; offer to sell if missing or unchanged in over a year, for instance.
Is there something in your house you wouldn't want Amazon to take an upskirt shot of?
Doesn't matter to me if the deal goes through or not. That iRobot is so willing to utterly betray their promises about the data they collect puts them on my list of companies to never do business with anyway. They cannot be trusted.
75 comments
[ 4.5 ms ] story [ 154 ms ] threadhttps://www.politico.com/news/2022/09/02/amazons-ftc-problem...
The key paragraph:
"Among the concerns the FTC is investigating is whether the data generated about a consumer’s home by iRobot’s Roomba vacuum will give it an unfair advantage over a wide variety of other retailers. That concern was voiced by multiple critics of the deal when it was first announced early this month. For example, Amazon could have an advantage with a consumer looking to buy a couch, by using detailed home maps generated by iRobot to suggested particular items."
How detailed are the maps? I'm assuming they're using SLAM. [1] If so, the maps aren't that detailed, and I struggle to see how the maps will give them an unfair _retail_ advantage.
I do get the need for the review, it's just this point that doesn't make sense to me.
[1] https://en.wikipedia.org/wiki/Simultaneous_localization_and_...
The company which will completely ignore keywords like "6A" in a desperate attempt to show you anything but what you're looking for.
I'm not so worried!
Added: this is also the company which sells a popular line of home-security cameras, some of which are meant to be installed indoors. Worrying about your vacuum snitching on you makes good sci-fi but maybe this product isn't where regulators should be focusing.
Frankly, calling it Bezos's Razor would be very appropriate, because that's basically how the whole Amazon storefront works.
In fact, iRobot requires the access to the location services to initialize their iOS apps, so even without a map this would allow Amazon to link an IP address to the exact property. Creative abuse of this combo can go a very long way.
> it would allow Amazon to jack up the prices for amazon.com queries from the same IP address if the place, say, is really big.
Afaik this sort of airline-style price discrimination is not something amazon engages in ever. Maybe I’m misinformed
If the advertising world believes that targeted ads are the holy grail, then why wouldn't retailers believe targeted pricing to be also be the holy grail?
My personal belief is that if Amazon tried what you’re suggesting, they’d be shooting themselves in the foot (lose any remaining customer trust, regulators would be all over them, and competitors like Walmart would use it to gain market share overnight). In fact I was really hoping you’d share an article describing Amazon doing this so I have justification to cancel prime, ha!
However, if Amazon was really wanting to do this, they already know the avg income on everyone of their customers that have an Amazon credit card. That would be the ultimate in targeted pricing. Not just Amazon, any store branded card.
https://en.wikipedia.org/wiki/Amazon_Sidewalk
Of course, availability through an API can greatly expand how the information is used but, for the most part, it's tricky to say that data is public but you have to make it painful to access.
Pretty detailed. I used to own one of the high-end Roombas that would show you a map of your house, and the wifi signal strength in all the nooks and crannies (really quite useful when you move to a new home).
It doesn't show what kind of chair you have or what you have on the walls, or anything like that. But it's not hard at all to determine the size of the rooms, the layout, the placement of key pieces of furniture, and similar things. From the way a home is arranged and the amount of furniture, I can easily think of ways that the map could be used to infer information about a home. (Larger couch and entertainment center may indicate someone more interested in consuming media. Individual chairs around a smaller coffee table — perhaps they like entertaining.)
The maps are far from accurate, since there are a number of problems with a Roomba building a full map: Closed doors; areas cordoned off by lighthouses; unless you put blue painter's tape over the sensors, Roomba thinks rugs with black in them are cliffs.
But the maps don't have to be prefect to be very revealing. Especially since the higher-level Roombas have cameras on them. I don't know how detailed the images they capture are, but even if they are only vague monochrome blurs, that's enough to determine patterns of activity in the house. (Family regularly comes home at 5pm? Start advertising dinner food on partner web sites and apps.)
A few years ago I would have probably agreed. But modern machine learning can draw spooky inferences from seemingly sparse data, on a scale that makes it practical. As the roomba bumps around a room it will learn where obstacles are but not what those obstacles are. But the size and shape of the footprint of those obstacles probably contains enough information to make guesses at what those might be. Approximate identification of some obstacles as couches is probably possible, just from the size and shape, and likely the position of those obstacles in the room.
That won't tell you how old the couch is, or whether it's worn out or not, but if the roomba can't find any probable couches in that person's house, advertising couches to that person may pay off.
Also, did the roomba start finding a new room recently, but the other rooms have remained the same? That person may have build an addition to their house, or started furnishing their basement. Did all the rooms change but the roomba is still paired to the same smartphone? They may have moved into a new home. In either case, if the new room[s] don't have couch-shaped obstacles, advertise couches.
And this is just with the bumpers. If Amazon adds a camera to roombas, the snooping potential is obvious.
My best guess for this is that floor plans and furniture can be used to _fingerprint_ a user, rather than knowing that the user owns a couch so that The Company can recommend a particular CPG. Knowing who their target demographics are with greater accuracy certainly feeds back into their recommender systems, but not so directly, which makes me concerned for this investigation's success.
The iRobot’s stock price also has not tanked, suggesting that this is indeed just a standard review rather than an investigation.
I own a non WiFi enabled roomba it's 7 years old and in that time apart from the brushes etc I've had to replace the bin and motor which cost a tenth of the cost of the whole unit.
I love the fact you can buy just about any part that might fail and fix it yourself. I don't see that being the case if any of the major tech corps buy irobot :(
Amazon's hardware product ethos is the exact inverse. Replace it or trade it in when it's old or dies, and buy the new one. Their hardware, even some recent Kindles, doesn't scream premium quality.
ADT, however.
https://newsroom.adt.com/financial/adt-announces-closing-450...
Now google will know anytime I leave the house, or there's "FAULT, garage door!"
Why doesn’t Roomba show you the photos it’s taking? Or does it?
[0] (PDF) https://www.yalelawjournal.org/pdf/e.710.Khan.805_zuvfyyeh.p...
The FTC exists "to protect the public from deceptive or unfair business practices and from unfair methods of competition through law enforcement, advocacy, research, and education."[1] When Amazon and other big businesses harm the public through predatory pricing and other anticompetitive business practices, it's the FTC's obvious charter to do whatever they can to stop those businesses, whoever they are and whatever they're doing.
[1] https://www.ftc.gov/about-ftc/mission
So the political determiner is not that Linda Khan doesn't like Amazon, but the politically favourable thing for the Democratic party is to have someone poking big tech * . This makes sense too - it courts people on the economic left who see big tech driving inequality in tech cities, it courts people concerned with privacy, it even courts some folks on the moderate right who see big tech as an enemy because of censorship.
* And it is just big tech - you don't see the same rhetoric in other industries at the moment. For example Disney's ownership of Marvel, lucasfilm, Pixar, 20thC Fox, HBO, ABC, ESPN is approaching monopolistic but nobody is proposing blocking new acquisitions let alone breaking it up.
Amazon can therefore ask the drone, I mean Roomba, to take a closer look at something.
This could be tied in with AI: move to the window and detect curtains or window coverings; offer to sell if missing or unchanged in over a year, for instance.
Is there something in your house you wouldn't want Amazon to take an upskirt shot of?
Same with sports watches, using Polar because it is even somewhat privacy minded.