Google undeleted whocalled.us after a front page article on Hacker News
I appreciated reading your thoughts, and it made me feel better because the worst part of it all was feeling like nobody could hear my protests that they made a mistake.
I made 8 reconsideration requests, which are messages you send Google to ask for a human to manually review the penalty. All of them were denied with the same automated response.
It did not feel like any humans actually read or thought about the situation, so I felt voiceless.
As usual, if you make a public scene, a large corporation will often notice, and look closer at that individual's issue. I think that's what happened in this case.
I happened to notice today that whocalled.us was back in Google, and the "Pure Spam" manual action had disappeared. There was no notice or explanation, and it feels like someone at Google saw my post, and quietly fixed it.
I thought it was important to notify HN about this.
I don't know how to feel about this. I already removed AdSense from the site, and gave up on it. From a shortsighted view, I should be happy, and thank Google.
But this experience showed me that Google has more power over my website than I do.
44 comments
[ 1.6 ms ] story [ 53.4 ms ] threadHaving been on the other side a few times (the one who quietly fixed an error without acknowledgement), there are a number of other factors at work as well:
1. Sometimes, fixing the error is within my power but talking to the customer is not. For example, when I was at Google, I was an engineer - fixing a bug was something I could do merely with a code review, but talking to the outside world was forbidden by company policy, and I didn't even know who the people were that were authorized to speak to the outside world on company behalf.
2. Very often, the error is one of several dozen in a bug queue, and you just want to fix it and move on. Talking to someone - particularly a customer - is a big mental context switch; it means that 5 other people won't get their errors fixed at all.
3. Sometimes the error is a distraction from your normal job duties, you feel like you can do a good deed by taking 5 minutes of your day to tweak a config file, but you don't want it to blow up any larger than that, and usually once a user has your attention they feel free to ask you to fix all their other annoyances. This is a big problem with working on open-source software; I've never yet had a good deed take less than 5x the amount of time I budgeted for it, and usually involve a few people mad at me. (I often find out later that many other people are very appreciative, but the latter never seem to speak up).
I think the fundamental problem is a mismatch between our expectations as human beings, which are shaped by millenia of face-to-face interactions, and the reality of modern society, where we are just a ticket number to a faceless corporation. Internet companies like Google and Facebook have roughly a million users per engineer working on the product; Whatsapp has 50 million. Imagine the scale of insignificance of any one problem; by the numbers, a user of a consumer product is roughly as consequential as a hair on your head. That could be why we get such shitty service from basically every major consumer company out there.
"fixing the error is within my power but talking to the customer is not."
It may have also changed google's view on which people are searching for and visiting the site. Before, its search traffic was people searching for phone numbers, a random cross section of people who get spam phone calls. After, its a specific name brand being searched for by possibly well connected tech workers who are logged into google+.
In this particular case and specifically with respect to google (and their resources and profitability and for lack of a better way to put it "power") as well as how difficult it would be for those who are wronged to bring a lawsuit (and prove damages) I somehow strongly doubt that has anything to do with it.
The only thing that I think that google would fear is regulatory action (if even possible) or perhaps (once again if possible) a class action lawsuit.
For the most part, the people complaining about lawsuits have something to lose. I think there's a reason for that. Lawsuits are the first resort when the track record of the people with power is such that trying to convince them to act ethically does not seem plausible. If problems got resolved without having to go to the mat with powerful entities much, much bigger and with many more resources than you have, you really think this'd be a thing?
> As usual, if you make a public scene, a large corporation will often notice, and look closer at that individual's issue. I think that's what happened in this case.
> I made 8 reconsideration requests .. all of them were denied.
Probably because you did not show a good will effort to clean up your act. At least you do not tell us what were the contents of these reconsideration requests. For all we know it was: "Reconsider me!"
From your previous post I gather that you were heavily annoyed with the unnatural links actions and warnings. Instead of cleaning up your act for Google you focused on a suggested unnatural link to claim it was all BS.
> As usual, if you make a public scene, a large corporation will often notice, and look closer at that individual's issue. I think that's what happened in this case.
I do think that the people at Google notice a prominent post on HackerNews. But I do not think that they manually removed a spam penalty to avoid bad publicity. If anything: allowing spammy sites in the index without even a slap on the wrist is not good for publicity at all (and very visible to the users). I think the pre-set penalty period was over, or a recrawl found a cleaner site.
> But this experience showed me that Google has more power over my website than I do.
Google has more power over their search engine index than you do. You are free to do whatever you want to do with your website.
I do have a question: The DuckDuckGo widget you had on your site (now changed to a general link), was that an official widget? Did money exchange hands for placing such a widget/link on every page of your site? I am wondering why a site-wide link to a commercial page is not 'nofollow'-ed, and if that may have brought you unwanted quality guidelines attention.
Further, the whole point of the Web is to link pages together. That Google penalizes one site author for what other site authors do is a problem with Google, not a problem with the author. In the previous posting he indicated that Google asked him to contact the various site authors and ask them to remove their links. Why should he have to do this?
It is not the site structure that is entirely at fault here. It would not make sense to aggregate phone numbers and discussions about these numbers on a single page. A "thin content" penalty is speculative and Google even gave an "unnatural links" warning, telling us where to look first.
I think Google understands the power of linking pages together and weighing these links in ranking :). Reverse SEO is murky though, and in principle I could agree that other webmasters devaluing your property is a problem with Google. On the other hand: The fact that spammers complained a lot (and still complain) and were being re-purposed by Google to help clean up the web, tells me that Google is winning this battle. But we also know that collateral damage is possible in war.
Finally: Google does make mistakes. And a mistake is between algorithmic superiority and malicious intent by Google.
> In the previous posting he indicated that Google asked him to contact the various site authors and ask them to remove their links. Why should he have to do this?
Because else he will be slapped with an unnatural links penalty, and he clearly doesn't want that. Again, he is free to ignore these warnings and see his site removed from Google's index. Google can not force him to do this. They can however enforce quality on their own turf.
Question: Could you clarify some of the currrently spammy practices which are encouraged by the standards which define how the Web operates?
He shouldn't have to do that. It's incompetence on Google's part. The solution to spammy links, is to drop their value to zero, not to generate a penalty for the site that is the target of said spammy links. This is a flaw in how Google has chosen to handle low quality sites and spammy links. The incompetence aspect is that they failed to be creative enough to find a better solution, and fell back to using a hammer approach.
Google's creative solution was to make sure to webmasters that: yes, these links do hurt your rankings. Instead of linkbuilding and diluting the precious link-signal, these spammers now offered link-profile-cleaning services (Mission. F-cking. Accomplished. http://xkcd.com/810/ ).
To penalize Good Site A, because Bad Sites B/C/D/E are sending spammy links to it, is an inherently morally bankrupt premise.
This is insane.
Spammers should now be linking to a site and then telling the site owners, "If you want to get your Google rank back, pay us $1000 to take our links down."
https://support.google.com/webmasters/answer/2648487?hl=en
They do not seem to have anything to gain, and actually, it sounds like it might be highly gameable as a form of negative SEO.
At best, it seems to me that there would be an inverse ratio between the likelihood of the link being removed and the spamminess of the linking site.
If someone could explain this, I would be grateful.
[alternately, I'll delete to reduce clutter if I get bumped down some more.]
When you are dealing with a monopoly, which Google has on many large segments of traffic type (i.e., Bing and Yahoo are non-relevant in those segments), you are at the mercy of that monopoly. And hence they have the power over you. Which is often abused by being dismissive towards you.
Google keeps forgetting that the website owners provide the content that Google indexes and monetizes-on to sells ads (via search and other channels), and that they are in a relationship.
Except that relationship is often abused by treating webmasters like they are garbage.
That Google abuses their monopoly to be dismissive towards webmasters and treating webmasters like they are garbage is, as it stands, unfounded. Which other search engine has an active webmaster forum, webmaster education and webmaster tools? Which other search engine warns you about spam or technical problems on your sites?
> Google keeps forgetting that the website owners provide the content that Google indexes and monetizes-on to sells ads
Google does not forget this. It just hails quality over making a buck, shown by banning ads on websites that do not conform to the quality guidelines.
On the rest, if you believe that, then you must have been absent for the other million times when an individual was thrown into the garbage bin by Google, and told "you did something wrong (maybe), but we won't tell you what, nor will we ever respond to you again."
> It just hails quality over making a buck, shown by banning ads on websites that do not conform to the quality guidelines.
While this is not true for every category, in my personal experience and in many reported other cases that analysed the traffic sent by Adwords' "partner network" (that Google derives a large part of their profits from) is half made up of auto-generated sites, links farms, and automated fraud clicks, and has been so for the last decade. This, and other shenanigans (like the 500MM pill ad settlement) goes against what you are claiming.
> Which other search engine has an active webmaster forum, webmaster education and webmaster tools? Which other search engine warns you about spam or technical problems on your sites?
Bing has many of those.
I've seen this a lot (too much). In fact this attitude of "Google sandboxed us and we have no clue why!" is as old as SEO forums. I've helped people fix their on-page and backlink issues. I've submitted successful reconsideration requests. I've made ads cheaper by linking them to higher quality pages. I did not fix this by picking them out of some hypothetical garbage bin. I fixed this by fixing their honest and dishonest mistakes and making them compliant with the quality guidelines.
Here at HN we have hellbanning. Do people get hellbanned by mistake (probably, but hopefully rare). Should we respond to every single person hellbanned, and explain to them what they did wrong, while they continue to be oblivious haters? It is a matter of how you view it I suppose.
I do not think that half-made-up fact is true, but I will not challenge you on this.
The original post made it sound like there was no act to clean up. If there was spam link building on their part, it changes the story.
> The original post made it sound like there was no act to clean up.
That seems standard: from innocent to the most hardcore spammer, of course they didn't do anything wrong, Google made a mistake and abused its power.
> If there was spam link building on their part, it changes the story.
It could change this story. But I do not want to point any fingers, and I think Google is smart not to reply on this case (which is kind of a shame. I miss Matt Cutts and I miss the time when HN allowed for these open discussions. It just seems too much of a PR risk these days.)
There was nothing to clean. Lots of websites link to whocalled.us, but I don't pay attention to them, and I certainly had nothing to do with any links to the site.
"Pure Spam If you see this message on the Manual Actions page, it means that Google has detected that some of your pages may be using techniques that are outside our Webmaster Guidelines. The site appears to use aggressive spam techniques such as automatically generated gibberish, cloaking, scraping content from other websites, and/or other repeated or egregious violations of Google’s quality guidelines."
My reconsideration request was usually, "You're idiots."
There was a little box I could write in and mail back to request they restore access from the road. I made sure the shop wasn't doing any of those things, I cleaned it up a bit, and spoke with the Mayor. He said he didn't know why people would want to eat sandwiches, and my shop sucked. My form was mailed back with a "Denied" stamp and the same generic paper about how my shop is "Pure Shit."
"You're idiots." is a reasonable response of someone forced into a situation where their words have no effect, and nobody appears to be reading them. Why waste effort reasoning to those who refuse to listen or acknowledge what you say? Nobody said, "Your tomatoes are tainted because your supplier is a known fraudster." It just said, "Pure Shit."
There is no facade. Google search is algorithmically driven, and no one has ever shown that its algorithms discriminate unfairly.
Edit: Another recent similar incident: https://news.ycombinator.com/item?id=8873149
"Don't be evil" at this point is a punch line
Someone mentioned here there's a million to 1 user to engineer ratio. As much as I would want Google to fix the issue, I don't expect that happening anytime soon. If all of us can collectively help the community fix bugs then why not? Just like countless other crowdsourced intelligence tools (e.g. wot browser extension, ad blockers etc.).
The alternative solution is that google takes responsibility for the quality of their search results and actually pays people to work on it. I know they like to pretend that everything is automated but we all know it clearly isn't.
And no, they don't need to hire a $300,000 a year engineer to do this work. You don't need advanced programming knowledge or experience to be able to judge whether a website has a real case when they submit a reconsideration request.
Maybe they reset your penalty as a "thank you" for bringing it to their attention?