Facebook patent application (US 20180032883) for "classifiers input information about a user and output a probability that the user belongs to a given socioeconomic group".
Full disclosure: repost of https://news.ycombinator.com/item?id=16315606 (from 70 days ago). Reposted by explicit request of the mods. May now be exceptionally topical in light of the Facebook revelations that have occurred since.
It's a good thing for business, yes, but there are a lot of ethical implications surrounding socioeconomic/behavioural predictions. I've been getting the feeling recently that Facebook has successfully circumvented decades of regulation on human studies since their research isn't (correct me if I'm wrong) governed by the Institutional Review Board
To "clickbait" poor person with luxury car is easier than rich person.
It is not a bad thing because in the end yes, will be discriminated at the counter by amount of money they have. Of course no one should get stuff for free.
It is bad in general, because people will be closed by their socioeconomic status and will have less possibilities to see better things. It can reduce economic mobility by some business not wanting to deal with people who are classified by automatic classifiers, even though they might have more money, be smarter, than what their FB history is telling.
Personally, even with the recent news, I'm still having mixed feeling about the whole ordeal.
On one side I'm not against using/collecting data for the purpose of better content (=better engagement) or more targeted ads (still better than looking at ads that have nothing to do with me). Though I am for it to be anonymized (ie separating the personal data from the generic things like names from items bought) however that is pretty much useless from the moment you enter your name anywhere as they can basically fingerprint the data and match it up to you anyways.
On the flipside of this, I don't like the direction this all is going - sure I like tailored content, but at what point do we reach a threshold where people are just shoved content down their throat since they cant find stuff outside these mechanisms to broaden their view and interests.
More related to this topic, as long as the data is there, someone will analyze it, and socioeconomic targeting has been done for a while already (you don't market 8K curved suround sound TVs to 90 year olds) this is just a step up. However I'm a bit scared of when we reach the tipping point on content in terms of targeting: what we might want to see vs what it might want us to see.
That's true, and I generally dislike them, thus I run an ad blocker and some limits on JS. However I have a bit of a broader view on the topic. For one instance, we wouldn't have many of the things we have without the economic backbone of the internet - ads. Google Maps - No, E Mail services - No and many more as they are just to drive user engagement to serve more ads or to lock you into the rest of their ecosystems hence Android and iOS and their integrations with the services. However I don't mind at all some higher quality marketing like technical blogs with some real value + a plug for their service on how it solves the problem, and similar sponsored content.
There is almost always to sides to both stories.
Email predates Google. https://www.openstreetmap.org/ does fine without ads. The ad-based business model makes it harder to develop competing essential information tools that are also economically viable.
Email predates google, however I don't thing the services would be anything alike without the bigger players. Initialy email was just a communication tool, however it quickly evolved to be sold as a feature on various hosting provides or was "thrown in" a more general package just to be feature par in attempt to bring in more people to use the service. This is not really directly related to online ads, however just shows that it's comercialized one way or another.
Open street map is a great example, along with wikipedia and numerous open source projects which are either backed by some foundations or collect donations and membership fees. The broader scope here is that while this is a better approach for the world, as long as there is the possibility to earn a buck on some service, there will be a comercial version of it. Guess capitalism just works that way.
When I read a printed tech magazine, I get the ad targeting that may be interesting for me, just because of the content I'm reading. There is no other information flowing back to online advertisers, or, to be more realistic, person tracking companies, which is what they really are. The content should be enough to determine the ad category, which would suite your desire for more engaging ads.
There's no reason why online publications can't do that as well. If I read a blog post about food, show me an ad about the coolest frying pan on earth and also one about the one with the best price to performance to ratio.
Show me ads for a Porsche even if I can't afford it, I may in a couple of years, and in the meantime the ads may have told my subconsciousness that this Porsche should be my goal.
That is also a good view on it. I would like it the most if online marketing was flipped - no networks but the media agencies have to serve related content and make ad deals based on those, hence much less cross marketing crap.
However I see also why businesses don't do it as the conversions would probably be much lower with that approach.
Also I think the auto industry, since you mentioned it, is closer to this approach as they condition users from a young age to pick a brand they like.
This is possible for focused websites (like the website about food you mention), but not really for something generic like Facebook. Unless they start guessing what you are interested in based on your behavior, which is kind of what they do now.
Then maybe the business model for these genericas should be toast. No entity has to have the ability to be able to know me in such a fine grained way as to be able to even target me out of context and influence me for consumerist (or even political) reasons.
If I am in the mood of car prOn - show me porsche or stuff. If I ready about python - show me current books on the topic. Or Udemy courses. Or what not.
If I currently read about how to get rid of pimples - show me beauty products.
But don't try to influence me into buying the latest camera gear, when I am interaction with my animal protection buddies over facebook.
I don't mind ads like that so much because they don't hijack my thought process.
If I'm researching about food, ads about where to buy ingredients or kitchen tools will be integrated into my thinking lines without problems, and that's fine. I might even click them if they seem legit and honest and fit to what I'm trying to do.
If you start showing me, say, ads about the newest movie or holiday destinations, if I allow them, they will derail my thoughts into different areas. I hate that, and that is a large part of why I block ads too.
edit: There is even a place where I like advertisements. In the work area, please do inform me what new developments your company has made that can help me with my developments, and do inform me what your company sells, roughly, so I can get back to you when I do need that UV CCD.
What if one country wants their poor to stay poor, and one country wants their poor to aspire to be rich, so they can take advantage of opportunity for upward mobility?
Why would this patent or the associated technology (which in my view is barely patenable) have any bearing on a governments ability to do this? Governments have been doing this very successfully for thousands of years without the need of a machine learning model.
It hasn't been challenged yet, and it likely wont be. Basically, Facebook (and other companies) patent stuff so if they are sued they can counter sue. Essentially, causing a kind of nuclear war for the companies (think Apple and Samsung).
The whole point is to avoid conflict. Even if it's not enforceable it might cost a few hundred thousand to million dollars to fight it.
The best solution, given these nukes are artificial, is to get rid of them. With real world nukes, you can't put the genie back into the bottle, but in this case you can remove the government distortion that is causing this arms race.
Having legal "nukes" can also be a good thing, even for David when they're going against Goliath. I was recently involved with a legal dispute with a large corporate landlord. I was able to line up enough potential illegal civil and criminal acts that I'm pretty sure their lawyers just decided it would cheaper to settle with me.
that's nice. doesn't really inform the decision on software "nukes" though, does it? it might be that regulation/'distortion' is appropriate in one case, but not the other...
I think these companies just don't get involved in nuclear confrontations of this kind - it's a costly buiseness; this is a game for the big suckers. You still might want to get a few patents of your own in order to prop up your own valuation. (If you want to be bought out by a bigger player)
These companies unwillingly get involved in nuclear confrontations of this kind as soon as one of their products ends up looking remotely like it could eat some of the big suckers' lunch.
In some ways, patents losely correlate with R&D spend. So when a new play enters a mature field, they'll lack patents and end up having to license patents from companies that did the hard R&D.
It's a way of allowing R&D externalities to be captured.
The system doesn't work all that well, but that is the intent.
I wish patents/trademark fees were tied to a companies, or individual's income.
A poor guy with a good idea gets a few patents at reduced costs.
A big company should be charged an exponential sum of their gross sales.
For instance, my patent fees, because I'm poor, would be no more than $100.
Facebook would be charged, say three 3 million at this stage in the game.
It just might prevent frivolous patents? Plus, it would level out the playing field for newcommers?
(I looked into patent fees a few years ago, and was shocked over the fees. I contacted the Patent Office, and they were kind. They didn't offer much in discounts. While I'm on my box, I would like to see America tie all fees/fines to income.)
Broadness is not a bar to patentability, as long as that breadth doesn't read on other claimed art or is obvious. There might be other reasons to invalidate the patent, but that's not one of them.
Given that the parent said "facebook basically has just patented statistical classification if its output are socioeconomics?", I think the commenter's point is that the breadth does include things that have massive amounts of prior art and are thus obvious.
This is not a patent. It is an application for a patent. The claims may be rejected during the application examination process, for example, if the examiner determines that the claims are obvious in light of the prior art.
It depends on the art unit processing the application[0]. If your application is classified as a 'software-related business method', your chances drop dramatically.
Is there any kind of public comment period where the patent's claims to novelty could be disputed? I feel like a lot of the worst patents may be granted because no one else was watching.
You might even be able to find prior art someplace you don't expect, like some sociology academic paper.
That was once true about software patents, but it's no longer true. I've seen some legitimately interesting / intellectually surprising software patents get denied not because they weren't novel or industrially useful, but because they lacked an inventive step.
Inventive steps are hard to come by if math isn't patentable and the fundamental principles of software creation aren't really changing.
Even if it gets granted, there's prior art. The big TV and movie analytics firms have been extrapolating socioeconomic data from viewing patterns since at least the early 2000s
How money does it cost to apply for a patent?. Because if the cost is negligible, then an exploit would be to flood the patent system with dumb patent application until one of them is accepted. Hell, maybe a machine learning algorithm could be trained to produce trillions of gibberish pdf files, until one of them makes sense, then you can claim the invention.
The patent system requires people to review the patents before they are accepted. Overloading patent reviewers with garbage patents isn't going to do you any favors. It'd be a bit like DDOS'ing yourself...
You're supposed to write a patent as broadly as you can while still being a non-obvious improvement over the prior-art. That lets your monopoly apply as broadly as possible and make it more likely that you can successfully prosecute an infringer.
You can patent specific applications of existing technology. But this particular patent may not pass the Section 101 abstract idea hurdle. “Use machine learning to determine socioeconomic status” is pretty abstract, and could be unpatantable under the Supreme Court’s Alice case law. Under that case law, something seemingly directed at an abstract idea may be patantable if it has an inventive concept (reflected in the claims) that goes beyond the abstact idea.
If the claims pointed to specific features and specific processes that gave you more reliable determinations than prior-art methods, that'd probably be patentable. (Leaving aside whether it should be, it probably would be). But machine learning presents an odd situation. With machine learning, you don't iterate on an algorithm, improving it until it generates reliable results. You feed data to a machine learning algorithm, which then infers e.g. which features are particularly probative of the desired classifications. I would wonder whether even specific applications of machine learning would be patentable under Alice, since the computer rather than the patent applicant makes the inventive inferences.
> Patent a very specific model for determining socioeconomic status? Sure. Patent the process in general? No fuckin way.
That's my point. If you're using machine learning, isn't the "specific model" just the output of the machine learning algorithm? And if so, even that may not be patentable, because the applicant didn't create the inventive parts, the computer did.
Not necessarily. I'm not talking about the weights of a neural network per se. I'm talking about something like a specific neural network architecture, or a specific feature engineering procedure.
This could be really useful for targeted public Health messaging and services.
TV stations need to broadcast a certain number of hours of public good programming. Online ads should show a percentage of ads for public good.
An algorithm like this could do good since it may have better sensitivity and specificity than self reported data but would need to be used by non-FB people to make sure that it’s really for public good rather than has the appearance of public good.
And this is why an expert propagandist understands that you don't need to prove anything. You just say it (preferably with some emotionally-wrapped slogan), and three to ten years later, people will simply recite what you've said as though it is fact.
Of course, you can pad it in weasel words and boring facts. Nobody will remember those parts of the message anyway.
I still think Facebook is US government tool . How it was spread in 2006 - 2010 on all foringe media channels financed by USAID. Most people in US still think that USAID is free money to foringers and want it to cut.
This has powerful implications I believe in the United States and other nations that are made to hold the tacit communal belief that they are a largely middle-class society.
Certainly, you could classify these groups in a closed process and operate to exploit their individual wants and desires, which is something existing models of capitalist industry engage in already. However, what if Facebook were to do this all transparently? For example, being sold something with the explicit revelation that your economic class is the primary consumer?
The patent seems to be based on defining class solely on the dollar value of last years income, whereas the actual measures of class membership take other forms.
There's nothing wrong or useless about advertising based on W-2 income level; but that won't have greater sociological effects on economic class or whatever.
Of course via the magic of widely shared credit reports, everyone already knows actual class breakdowns based on class differences in personal balance sheets and other measures.
It appears that FB [edit: is attempting to patent] a questionnaire that allows them to guess your socioeconomic status from, for example, where you live, how old you are, and how many internet-connected appliances you have. Another argument for overhaul of the US patent system, and to delete the FB app.
An ethical spin can be made on it, as Zuck did in his testimony. He is making advertising more efficient for small businesses, which helps those businesses grow. That is a good goal, and I believe this to be true. We just need to decide if the juice is worth the squeeze.
I would think they are classifying each individual into one of many groups, each group being an arbitrarily delineated social class. If that's true, than Mr. Buffet would indeed have the potential to be misclassified, because his behaviours ("features") are atypical of people as rich as him.
I wish people wouldn’t post direct links to patents.
The advice from the IP lawyers at every company I’ve worked for (Microsoft, Dropbox, Amazon, Google) has been to never read patents or patent applications.
I'm honestly curious what the aversion is to reading patents and patent applications. Is it to avoid suspect patent infringement by being able to claim ignorance? i.e. "I have not read any patent that relates to some work that I've created wholly on my own that out of coincidence achieves the same as a patented work." Does that actually hold up if defending IP?
Yeah, as osteele points out, it moves the needle from unknowing infringement to willful infringement. And willful infringement carries triple damages.
When people have asked “how would they even know?”, there are usually two answers: 1) don’t underestimate what can come out in discovery, and 2) no lawyer is going to advise perjuring yourself
Yes. You are subject to triple damages if you read the patent, so it's foolish to read patents unless you have to. It's impossible to read all patents, and patents in almost all cases are useless, so "I didn't read the patent" is the normal case for software developers.
Patents make no sense for software, and should be abolished for software.
Yeah, it’s definitely a toss up, but because I can’t/won’t read a patent, but might read a discussion about it, in this case the techjunk article is counterintuitively preferable
A patent doesn’t grant the assignee the right to use a technique. It grants them the right to keep others from doing so. Whether or not this patent is granted, a separate mechanism, such as regulation or legislation, would be necessary to prevent Facebook from employing the methods it claims — unless someone else, who could afford to litigate it and wouldn’t license to Facebook (a ”non-practicing non-licensing entity” (NPNLE), or “benevolent troll”?), had patented it first.
Letting them hide behind their branding as "credit agencies" is ridiculously naive in this day and age. They are surveillance companies. Faceboot's only difference is being a relative newcomer compared to the incumbents.
This entire surveillance industry is an escalating crime against humanity.
116 comments
[ 4.7 ms ] story [ 174 ms ] threadRelevant Twitter thread: https://twitter.com/WolfieChristl/status/960630738256367617
Copy-and-paste friendly version of the patent application, but without images: http://appft.uspto.gov/netacgi/nph-Parser?Sect1=PTO1&Sect2=H...
Limited news coverage, e.g., http://expressnewsline.com/2018/02/05/facebook-to-develop-sy...
Full disclosure: repost of https://news.ycombinator.com/item?id=16315606 (from 70 days ago). Reposted by explicit request of the mods. May now be exceptionally topical in light of the Facebook revelations that have occurred since.
It is not a bad thing because in the end yes, will be discriminated at the counter by amount of money they have. Of course no one should get stuff for free.
It is bad in general, because people will be closed by their socioeconomic status and will have less possibilities to see better things. It can reduce economic mobility by some business not wanting to deal with people who are classified by automatic classifiers, even though they might have more money, be smarter, than what their FB history is telling.
Luxury cars aren't the concern. It's tumbrels we're worried about.
On one side I'm not against using/collecting data for the purpose of better content (=better engagement) or more targeted ads (still better than looking at ads that have nothing to do with me). Though I am for it to be anonymized (ie separating the personal data from the generic things like names from items bought) however that is pretty much useless from the moment you enter your name anywhere as they can basically fingerprint the data and match it up to you anyways.
On the flipside of this, I don't like the direction this all is going - sure I like tailored content, but at what point do we reach a threshold where people are just shoved content down their throat since they cant find stuff outside these mechanisms to broaden their view and interests.
More related to this topic, as long as the data is there, someone will analyze it, and socioeconomic targeting has been done for a while already (you don't market 8K curved suround sound TVs to 90 year olds) this is just a step up. However I'm a bit scared of when we reach the tipping point on content in terms of targeting: what we might want to see vs what it might want us to see.
Open street map is a great example, along with wikipedia and numerous open source projects which are either backed by some foundations or collect donations and membership fees. The broader scope here is that while this is a better approach for the world, as long as there is the possibility to earn a buck on some service, there will be a comercial version of it. Guess capitalism just works that way.
When I read a printed tech magazine, I get the ad targeting that may be interesting for me, just because of the content I'm reading. There is no other information flowing back to online advertisers, or, to be more realistic, person tracking companies, which is what they really are. The content should be enough to determine the ad category, which would suite your desire for more engaging ads.
There's no reason why online publications can't do that as well. If I read a blog post about food, show me an ad about the coolest frying pan on earth and also one about the one with the best price to performance to ratio.
Show me ads for a Porsche even if I can't afford it, I may in a couple of years, and in the meantime the ads may have told my subconsciousness that this Porsche should be my goal.
If I am in the mood of car prOn - show me porsche or stuff. If I ready about python - show me current books on the topic. Or Udemy courses. Or what not.
If I currently read about how to get rid of pimples - show me beauty products.
But don't try to influence me into buying the latest camera gear, when I am interaction with my animal protection buddies over facebook.
If I'm researching about food, ads about where to buy ingredients or kitchen tools will be integrated into my thinking lines without problems, and that's fine. I might even click them if they seem legit and honest and fit to what I'm trying to do.
If you start showing me, say, ads about the newest movie or holiday destinations, if I allow them, they will derail my thoughts into different areas. I hate that, and that is a large part of why I block ads too.
edit: There is even a place where I like advertisements. In the work area, please do inform me what new developments your company has made that can help me with my developments, and do inform me what your company sells, roughly, so I can get back to you when I do need that UV CCD.
How can this be legal? Facebook did not invent machine learning. How can they patent it?
The whole point is to avoid conflict. Even if it's not enforceable it might cost a few hundred thousand to million dollars to fight it.
It's a way of allowing R&D externalities to be captured.
The system doesn't work all that well, but that is the intent.
We very explicitly discussed that we would either aquire them or use the patents portfolio to shut them down.
A poor guy with a good idea gets a few patents at reduced costs.
A big company should be charged an exponential sum of their gross sales.
For instance, my patent fees, because I'm poor, would be no more than $100.
Facebook would be charged, say three 3 million at this stage in the game.
It just might prevent frivolous patents? Plus, it would level out the playing field for newcommers?
(I looked into patent fees a few years ago, and was shocked over the fees. I contacted the Patent Office, and they were kind. They didn't offer much in discounts. While I'm on my box, I would like to see America tie all fees/fines to income.)
[0] http://www.ipwatchdog.com/2015/05/21/hardest-easiest-art-uni...
Is there any kind of public comment period where the patent's claims to novelty could be disputed? I feel like a lot of the worst patents may be granted because no one else was watching.
You might even be able to find prior art someplace you don't expect, like some sociology academic paper.
Inventive steps are hard to come by if math isn't patentable and the fundamental principles of software creation aren't really changing.
I recently did not renew the patent and have allowed it go into the public domain.
If the claims pointed to specific features and specific processes that gave you more reliable determinations than prior-art methods, that'd probably be patentable. (Leaving aside whether it should be, it probably would be). But machine learning presents an odd situation. With machine learning, you don't iterate on an algorithm, improving it until it generates reliable results. You feed data to a machine learning algorithm, which then infers e.g. which features are particularly probative of the desired classifications. I would wonder whether even specific applications of machine learning would be patentable under Alice, since the computer rather than the patent applicant makes the inventive inferences.
This is analogous to patenting image classification, in the abstract. It's completely ridiculous.
Patent a very specific model for determining socioeconomic status? Sure. Patent the process in general? No fuckin way.
That's my point. If you're using machine learning, isn't the "specific model" just the output of the machine learning algorithm? And if so, even that may not be patentable, because the applicant didn't create the inventive parts, the computer did.
TV stations need to broadcast a certain number of hours of public good programming. Online ads should show a percentage of ads for public good.
An algorithm like this could do good since it may have better sensitivity and specificity than self reported data but would need to be used by non-FB people to make sure that it’s really for public good rather than has the appearance of public good.
Of course, you can pad it in weasel words and boring facts. Nobody will remember those parts of the message anyway.
Certainly, you could classify these groups in a closed process and operate to exploit their individual wants and desires, which is something existing models of capitalist industry engage in already. However, what if Facebook were to do this all transparently? For example, being sold something with the explicit revelation that your economic class is the primary consumer?
There's nothing wrong or useless about advertising based on W-2 income level; but that won't have greater sociological effects on economic class or whatever.
Of course via the magic of widely shared credit reports, everyone already knows actual class breakdowns based on class differences in personal balance sheets and other measures.
[1] https://en.m.wikipedia.org/wiki/In_re_Bilski
I would think they are classifying each individual into one of many groups, each group being an arbitrarily delineated social class. If that's true, than Mr. Buffet would indeed have the potential to be misclassified, because his behaviours ("features") are atypical of people as rich as him.
2. The title barely matters at all. The claims define what they’re trying to patent.
The advice from the IP lawyers at every company I’ve worked for (Microsoft, Dropbox, Amazon, Google) has been to never read patents or patent applications.
https://en.wikipedia.org/wiki/Treble_damages
When people have asked “how would they even know?”, there are usually two answers: 1) don’t underestimate what can come out in discovery, and 2) no lawyer is going to advise perjuring yourself
Yes. You are subject to triple damages if you read the patent, so it's foolish to read patents unless you have to. It's impossible to read all patents, and patents in almost all cases are useless, so "I didn't read the patent" is the normal case for software developers.
Patents make no sense for software, and should be abolished for software.
Does your profile picture contain anime/cat/dog features on your face?
If the anwer to both is no, you're clear.
It's like FB is trying to push us in the direction of China[1] and they don't care who knows it.
[1] http://www.scmp.com/week-asia/opinion/article/2131737/chinas...
All the big credit agencies (Experian, Equifax, Transunion, etc) have products that cluster people into socioeconomic groups, with ridiculous names.
https://www.experian.com/assets/marketing-services/brochures...
Examples from that brochure:
"American Royalty" "Small Town Shallow Pockets" "Full Pockets, Empty Nests"
This entire surveillance industry is an escalating crime against humanity.