Was this caused by changes rushed before a holiday code freeze? I know nothing about FB, but it's customary for companies to stop pushing new binaries in early-mid December and to leave ad systems alone a week before Black Friday or so.
Yep. When I was at Walmart the code freeze started in early November, with only critical bug fixes going in, then continued until the start of January.
At another big company we had a code freeze as well, but we found a bug in a new feature that we released.
We were not allowed to fix the bug, so we were reverting binaries of the data processing pipeline. The problem is that the data was already created and not backwards compatible, so we just created new problems... strict code freeze together with a huge feature push is always a nightmare.
It took weeks for the bug to be surfaced. I was working with conversions, which is rare and noisy data. The problem is that most policies are not adjusted for the subteams.
Facebook users, as a whole, like the Facebook ads I run for my clients. They click, share, comment and buy the products or services or advertise, which are all pretty solid.
There's almost no where else on the web where my products (SMB services, mostly) can be connected to my customers (business owners) at scale and at a reasonable cost, by the way.
The users were still seeing ads once Facebook, as a site, was back up. Just because campaign managers for ads couldn't use the Ads Manager, doesn't mean users don't see ads. For example, I had campaigns spending thousands of dollars, but I just had to guesstimate the cost because Ads Manager wasn't showing the data. That means I could be underspending or overspending because I couldn't optimize. It's a real headache for ad buyers, but once again, users still see ads.
I would rather give money to the mob than fb, at least those guys are more honest. I can't understand why anyone still thinks it's a good idea to give money to this monstrosity of a website.
I work in an Ad Tech company and this week is crazy. We also try to make a code freeze but the reality is many deploys in production to fix things thursday evening...
22 comments
[ 45.3 ms ] story [ 1253 ms ] threadhttps://www.nbcnews.com/tech/tech-news/outages-hit-facebook-...
There's almost no where else on the web where my products (SMB services, mostly) can be connected to my customers (business owners) at scale and at a reasonable cost, by the way.