153 comments

[ 0.24 ms ] story [ 50.6 ms ] thread
(comment deleted)
The end is really hilarious. Google had a stupid frontend-only validation, it seems.
Since Google themselves claim that's a security check, there's a bug bounty here.

The author of that article missed their chance making Google eat their words.

Or he missed the chance to get Google to move that check to the back end and then when it is time to renew find out that he cannot, if he’s lucky enough for it to not break earlier.
I was under the impression Google engineers went through a rigorous hiring process, yet this is the sort of thing you get from lowest bidder consultants who have inexperienced devs.
Nah Google and Microsoft have been offshoring to India for years. And sorry, but the developers there suck.
All that leetcode, whiteboarding, and Googly-style interview questions just to put front-end validation for security.
This seems like something more intended to avoid a bunch of pointless attempted signups from people who don't understand what having a domain means who then won't be able to do the later step where you verify that you actually own it.

A client-side check's not so unreasonable for that kind of thing.

Of course then you still want the list to be accurate and/or actually have some working support flow that results in an overzealous filter getting fixed. The code suggests that they do or did have a process at some point: the list of specific domains is an override that allows domains that would otherwise match one of the regexes and get blocked.

Yeah but they said it was important security.
alice.it is indeed an email provider's domain; based on the code snippet it seems like they are active in other countries.

alice.app however isn't registered anywhere.

I would hope that somewhere at Google there is a policy that says you can't do anti-fraud and security checks in frontend only...
But isn't the web so much better now that everything is client side instead of server side?

I still think client side JS apps are the biggest mistake this industry ever made.

This was a fun read. Absolutely baffling behaviour from Google.
Not baffling at all. Google could not care less about individual users. (lots of horror stories about account getting disabled here and on reddit.) They only care about large enterprise customers. Not even the smaller ones, only the largest. Speaking from first hand experience.
A division of the Ukranian government seems to come pretty close to a "large enterprise".

Maybe there are politics involved, but fixing a broken regex seems well worth the time to convince a foreign government to rely on your tech.

Of course, the support request never reached anyone who knows what a regex is, so bugs get confused for policy and nobody cares to fix it.

I get it, they want to stop scammeers to sign up with domains that look close like a real email provider. In this case web.de
If you could just change your company's domain name that'd be swell!

Surprising Google is happy to lose a paying company over this.

Although the author is taking quite the risk bypassing Google's validation like that. Not sure I'd be risking my company's workspace to do it in case Google wakes up ban hammer happy one morning.

Google would rather cheap out on offshore support than waste their engineers' time talking to real customers.

Plus, any entity large enough probably has some kind of account manager or contact in Google that could hopefully escalate to the right person.

I wonder how this list ended up being created anyway. Was it a long standing issue, or just some ai slop? web.com, web.org, web.net don't look like an email provider.
web.net, at least, absolutely is an email provider.
web.de is also a big email provider in Germany.
Yes and gmx (listed next to it) as well, and I’m pretty sure that gmx offered/offers multiples TLDs (gmx.net, gmx.de, gmx.at, …)

I think the same goes for Alice (big ISP, offering mail addresses, in multiple countries)

It looks like some of these wildcards are for mail providers who use multiple TLDs.

The rationale probably was that end users primarily identify the email provider by the subdomain, not the TLD, and therefore to prevent spoofing they block all domains where the subdomain corresponds to an email provider, regardless of the TLD. Like, they don’t want to allow gmail.<anything>, and the same for all other email providers they know of.
scroll through a list of known email providers and you will notice they registered tlds for the countries they operate in, very typical for the old ones like yahoo yandex Freemail Hotmail etcpp

web.de is an oldschool German provider, as is gmx.de (and .at, .fr, .com, ...)

the regex smells like an inexperienced developer trying to be clever

Or an pretty old regex from before all those new TLDs
Just wait for someone at Google to read this post and then block the domain retrospectively.
Smells like „product engineering“. So a product or an engineering lead gets a task to reduce risks of specific abuse by preventing someone from sending email from yahoo or web.de clone. As a quick solution they add this filter without „overthinking“ it. The impact is low, a few customers in a million, so its stupidity gets unnoticed and, once first complaint reaches them, quietly deprioritized to death. Removing it is cheap: the justification for taking that work is likely the show stopper. Google is an old large corp that hires and fires at a scale. Owning removal of abuse filter to increase revenue by Planck-sized amount is an impossible thing.
I get this sort of thing constantly because my domain, 3e.org, which I have had for 30 years, is apparently impossible. It's either too short to be real, or starts with a number (obviously impossible).

And like the author, 90% of the time I can just disable their front-end validation and go on my merry way.

My friend has a short last name, and they still have many websites be like "must be longer then 3 letter"
Has your friend tried clearing their cookies?
I was trying to activate Zelle with my bank and since Zelle is used for scams so often I had to do a bunch of identity verification steps while on the phone with my bank.

One of them was to submit a photo of my drivers license. After I did that it OCRed out some details and prepopulated a form with my information. Hitting submit gave me an error saying to use my full middle name, not an initial. My full middle name is a single letter though.

The person on the phone with my bank had no idea what to do and just kept asking me try again.

I busted out my elite hacker skills though and added a space to the end of the middle name field and was able to steal my own identity.

> My full middle name is a single letter though.

I guess you could follow the Simpsons joke and spell the letter's name. I'm adding this one to my personal list of falsehoods programmers believe about names.

Super cool website btw.. cheers!
ahaha I still remember when 3com forced icann to allow leading numbers and that was some shitstorm
Huh? From RFC1123:

<quote>

2.1 Host Names and Numbers

      The syntax of a legal Internet host name was specified in RFC-952 [DNS:4].  One aspect of host name syntax is hereby changed: the restriction on the first character is relaxed to allow either a letter or a digit.  Host software MUST support this more liberal syntax.
</quote>

It's from 1989. ICANN was founded in 1998.

It's all ancient history, but before 3com domains with a leading digit 'just weren't done'. When they forced that through there was a general consternation on what crap internets are becoming.
I use a .one for a project where it makes perfect sense. Brevo, who are a huge email delivery platform, told me they don't support signing up with a .one domain. Fortunately, after a couple of weeks going back-and-forth one of their developers eventually saw sense and fixed it.

Sadly, with Google, I don't think you'll ever get the issue that far up the chain.

I've got a .email domain which various UK based retailers insist isn't a real domain from which email can be sent. I've been trying to convince Argos that it is real for about seven years.

To their credit, my building society actually took it all on board and fixed their system within a few months. To my incredible surprise, so did a major insurer.

It probably made its way onto a Jira backlog somewhere, and some engineer thankfully took it as a 1 story point task.
I wonder whether you could use GDPR to force compliance with this. You have the right to correct the record, after all.
Somehow I suspect GDPR isn't engaged there as they forbid the creation of an account in the first place, so they don't store the data. Maybe I could create an account with a different email address and try it then.
ooof that's bad, all levels of support missed the frontend validation and blamed you and an opaque non-existent process instead
Since the author asked about Alice: it was an Internet provider in France in the early 2000's.

Some domains in that list are truly ancient. That was a trip down memory lane.

same in italy btw, it was an italian provider with some european presence, since then they rebranded (several times actually)
I think ditching google would've been a better choice.
Well, if the alternative was going to be Microsoft 365... not so sure :)
(comment deleted)
Or just ditch both. These companies have nothing but contempt for their users and signing up for their services is just asking for trouble. There are alternatives for email and whatever else is needed from these services.
> Just for context, this is a premium domain with a very high premium renewal fee, no history of abuse obviously.

The registry premium domains on the new TLDs have several issues. The biggest IMO is a lack of price protection. Non-premium domains at least get the cohort based protection from section 2.10c of the registry agreement.

So, in addition to being treated as a 2nd rate domain, there’s nothing stopping the registry from cranking up the price if a domain gets popular. I don’t think it’s ever happened, but have never found contractual terms that forbid it.

I made a website about it a while ago after a registry reclassified one of my domains from standard to premium.

https://tldrisk.com/beyond-basics/premium-domains/

Do you have a list of TLDs that don’t charge for premium domains? E.g. I have never seen a Registry Premium .com domain.
Both .com and .net are price controlled. I think for the rest of the gTLDs it would be allowed. There’s a lot of nuance to it. The registry agreement never mentions premium domains, only pricing rules, so being accurate about the rules takes a long explanation. That’s why I made the site I linked.
We really need to replace ICANN.
All more reason to stick with standard TLDs like .com, .org, .net, and your country’s TLD when you can.
the last paragraph was probably most important one here, and the lesson is If you truly want to enforce a validation then it has to be in the backend, the client side validation is just additional luxury if you can afford it.

On a different note, the validations were added for genuine reasons and most likely there would be some discussions/debate on the scope/cost/benefits. I would imagine if some one were to do it a a business seriously then they would have some way to override it on use case basis.

In this case I think the validation is the next step when they ask you to set up a DNS record on the domain you typed in, and have their system match it.

Obviously if you typed Outlook.com this would be a challenge for you.

Unfortunately that may mean a support ticket and explanation and whatnot, and wasted time. Charitably, it might even mean the customer experiencing friction and going to another provider.

So in this case, front ending it seems to make a bit of sense, it’s just really clumsily done.

My business Workspace account got suspended recently, no reason given, can’t even login to contact support. I’m a solo user so I only had one admin account and that was the one locked out. There was just one text field to submit an appeal, so I did. I never got any email confirmation or tracking number for my appeal, it’s been a week now with no contact from Google. This happened about a week after they charged my credit card for the subscription.

I’m now in the process of switching to Fastmail. Google doesn’t give a shit about anything besides for their golden goose, I would encourage everyone to move away from their services before they just screw you with no warning or recourse just because they can.

I ditched Google Workspace for Proton earlier this year and haven't looked back. Yes, the Proton apps don't integrate with everything and E2E encrypted data isn't as accessible as the data held in Google apps, but that's a bonus at this point.
I learned recently that there is controversy around Proton and (surprisingly to me) far-right. Previous HN discussion https://news.ycombinator.com/item?id=48446899
Some people understand that there is naunce in the world. This is literally just the view of a single sponsor.

The way everyone gets so up-in-arms about the political views of a person three levels detached from the company is insane.

"Oh no, an individual with different views than me offhandedly mentioned Proton, the horror! I can't possibly differentiate between the views of a company and a separate individual!

Let's go grandstand about canceling our service because a random person thinks differently than me, and talked about the company."

I believe when the views of that person who has influence on the product, and it does not align with the services they say they desire to provide, it’s an issue.

It also can purely be choosing to not support an organization that doesn’t align with your world view. The money in our pockets is the power to change things.

If I’m reading this right, it was a failure at due diligence before sponsoring a YouTube channel. That doesn’t sound at all like what you wrote so maybe you could expand on what the controversy was?
Admitted it was a mistake, fixed it. Meanwhile google is actively platforming and funding the far right, and has no issue with it. What is the issue with Proton here exactly? This is a complete nothing burger.
I’m also worried that this is just the future of SaaS where everything is a Kafkaesque nightmare or automated processes no one even understands anymore, and even these incidents are lost in so much complexity the businesses either don’t care or don’t even know it’s happening.
That's pretty much the way the work did now if you're dealing with the "right" companies. The future isn't evenly distributed.
It already is, that’s why I prefer companies I can physically visit. My hosting, email, payments for my company are now places I can reach within hours and just have a chat. In person, people are a lot less nasty and they cannot yet (…) fob me off with an AI.
To be fair, the last time I had an issue with Google I just drove up to the Googleplex, and the front desk was very helpful routing me to the right real person. Proper support otherwise was impossible.
I think the AI dystopia will save us from the SaaS dystopia and ultimately win.

Dark patterns? AI doesn't care about dark patterns. It will instantly navigate around them.

10% annual price increases for absolutely no reason? No problem! Just build a replacement. 98% of SaaS applications out there no longer have a moat. My friend just contracted out a CRM replacement for Salesforce for a small company for $65k. He built it in a few days for a few hundred dollars. Obviously it's much less feature rich, but this company never used 99% of the features in Salesforce anyway. If anything, a light weight and bespoke CRM was what they always needed and wanted anyway. SaaS just wasn't viable for bespoke.

Ads killing the experience? AI will hunt down every explicit and hidden ad and eradicate it. The entire ad model is about to die.

Is this particular problem really SaaS behavior, or is it "market share too large to care" behavior?
I switched over to Zoho, has a lot of the same tools (mail/users/office) but UI is much more tech-y / old-school it e.g. more dense. Gets to the point.

I also use it with my own domain registered outside Zoho, so Zoho cannot actually lock me out of my email ever, only the data they host, though this is true for external domains in Google Workspace also.

Dispute the credit card charge and you might be able to get in touch with someone.
Or get your personal Google account permanently banned.
Exactly, if you think charging back against Google will result in a human reaching out to actually resolve the problem you are sorely istaken.
I got into self hosting in 2021.

A cheap 2.5Gb how from racknerd, $20-22/year, + domain.

It's been as smooth sailing as any other email provider.

Very satisfied.

Try it

How do you back up? What stack are you using?
Not OP but I backup with a scheduled rclone to B2 and rsync to my local storage at home so I have the required three copies.
Exactly. B2 gives 10gb free so I haven't paid for backups yet.
I can give racknerd a +1 by the way (compute rental in my case, not email). Prices are good, machines are machines, support exists and is helpful even for off-the-beaten-path issues, and so far they still exist despite seemingly being a small player. I'd use them again (I don't have many points of comparison though, so take this review with a grain of salt).
I have the same issue but just for Google Cloud thankfully. Never got a response when I filled in the text field. When I contacted support they kept asking me do go to things in the Google Cloud dashboard (that I was banned from). Then eventually the person said they'd escalate and I'd get an email but I never got anything. Maybe I'll try calling a sales number.
> Maybe I'll try calling a sales number.

It's your sign to move on, there are hundreds of other cloud providers who will actually provide meaningful human support because they need your business unlike Google.

Yea I really resonated with the messaging and mission of Migadu. Super reliable hosting. Have had it for nearly 5 years now. (of course now that I recommend it, I bet they're going to have an outage...)
So much for my theory that they only did this to the free personal accounts.
Thankfully you have a domain you can switch. I feel bad for people with Gmail addresses who are really fucked when they're banned.
that's a trip. nice catch!
The engineer that implemented this probably used it to justify promotion.

"Reduced fraudulent signups by <made up metric>. Reduce business risk exposure."

Google engineering has certainly taken a nosedive.

As usual, this is more than just an honest mistake from Google. Not only is the given justification complete gibberish, it has AI written all over it. They have zero respect for users and it shows.
> I was about to ditch Google completely and head over to Microsoft

That is the obvious thing to do. Don't understand why you even waste time there. You are digging a deeper hole for yourself.

If they cannot even provide proper support for sign up, what will happen when your account gets disabled for no obvious reason, and you potentially lose years of emails?

Google Workspace has one of the most perplexing interfaces I've ever had the displeasure of getting to know and use.

Namely, it seems impossible to archive users despite the fact that we have a business account and have already archived numerous former employees.

I was about to say that the response was pretty clear, e.g, “your domain sounds like spam”, and you can’t give a more clear reasoning for “exactly why” than any other spam filter can give you an “exactly why reason”.

But then I saw the work around at it turned out it was just incompetence compounding.

> 3.) Fictitious Domain Considerations: As you may know, domains that has ".web" have faced issues related to fictitious domain name usage. While ".one" is not ".web" the combination of the subdomain and TLD triggers similar security protocols.

This is an LLM response. It's the classic pattern where the LLM says something completely unrelated to the topic at hand, realizes that it doesn't have a backspace key, and tries to hedge it in.

There needs to be a Hanlon’s razor but for suspecting something is LLM generated. The typo and grammar mistakes in the response lead me to think it’s a human, but no way to really know.
I GUARANTEE that was written by AI. This type of slop is unmistakable
> The typo and grammar mistakes in the response lead me to think it’s a human

People using LLMs to "spam" slop already caught up on this sentiment and are purposefully introducing grammar and spelling mistakes in the outputs now. I'm not saying yay/nay in this particular case, just sharing what I've seen in the wild. If a company get complaints that customer support is too robotic after starting to use LLMs for it, making it more concise and introducing subtle mistakes are two surefire approaches they'd get recommended.

I refuse to believe there are actual human beings so blatantly splitting a single concept into three artificial points.
Been happening for years. You are not talking to a Developer but someone employed to do "support" who 1) might not know much or 2) think they know a lot but they don't 3) can't tell you the actual reason so try and BS an answer that will make you go away.
There needs to be a Grey's law but for suspecting something is LLM generated.
This doesn't make sense, even if the LLM had access to the source code

But yeah I kinda understand why would they want to block stuff with 'web'

Strongly doubt that a LLM would say "domains that has .web". Maybe it's a human paraphrasing a LLM.
For what it's worth and I know it can't be trusted, one of the AI detectors reported that sentence as "Your most AI sentences"

In this case, the combination of "web" and ".one" triggers these security measures.

It also flagged the whole email as 100% AI.

Has anyone ever tried giving LLMs a backspace? I have long wondered if their responses could be better if they had the ability to correct earlier parts of their text. Imagine how much harder it would be for us to write coherently with no backspace!
Thinking mode is exactly this. The LLM is allowed to dump thoughts, correcting itself along the way, and only surfaces the cleaned-up final answer to the user
It's not exactly this. It's something like it. But it's not a token that erases a previous token. Not that I know how that would work or how you'd get training data (edit histories of internet comments seem too few).

(You could have a token that hides previous tokens, but that'd be rather closer to CoT.)

I'm not sure how that would work. You'd need to be able to reverse the operations in the KV cache, and I'm not sure if it's doable or not. And then you'd need to pick another path, or "rebalance" the probabilities or you'd go the same token path. CoT is probably easier to implement (but not necessarily better).
You could set up checkpoints where you store off the current state, and roll back to those checkpoints?
ChatGPT does this. It will present an initial response, then change its mind partway through the thinking process and present a different response.
Oh wow, I'd like to see this. Any prompt which reliably triggers it? (Seahorse emoji comes to mind!)
It does it quite consistently on higher reasoning.

I believe they have made display answer a tool call so that it can keep updating its answer as it thinks, instead of doing all the reasoning up front, essentially inverting the usual flow. You can use this pattern with any model that supports tool calling.

Copilot does this too, kinda. It will give an initial response, realize that it might tangentially criticize Microsoft, then change that response to a refusal.
That's not a backspace, that's just a nanny filter. I think all bigco LLMs have something similar. e.g. Claude obviously uses this to prevent Fable from doing security work.
Chatgpt will erase text it wants to censor if you get near sensitive topics.
What sort of prompt would exercise this?
I inquired into a court case against a police officer who committed a sex crime. I only wanted to know the disposition of the case with no details. It briefly spit out a response involving the victim and wiped it away with a refusal to answer more questions. This was a year ago and the behavior may have changed by now.
That's just a standard nanny filter. The filter realized it was in the process of saying "sexual assault" or the like, and just shut the conversation down.
[delayed]
Why did you post the exact same comment three hours before this one?
To do this you need to run

    hallucinated command
but wait, this command only existe for aws cli, not for oracle cli, so you need to run

    actual command
Regularly happens to me in chatgpt.