Facebook — and all the major services that Facebook owns — are down today. ArsTechnica: We first noticed the problem at about 11:30 am Eastern time, when some Facebook links stopped working. Investigating a bit further showed major DNS failures at Facebook: “Google anycast DNS returns SERVFAIL for Facebook queries; querying http://a.ns.facebook.com directly times out.”
The problem goes deeper than Facebook’s obvious DNS failures, though. Facebook-owned Instagram was also down, and its DNS services — which are hosted on Amazon rather than being internal to Facebook’s own network — were functional. Instagram and WhatsApp were reachable but showed HTTP 503 (no server is available for the request) failures instead, an indication that while DNS worked and the services’ load balancers were reachable, the application servers that should be feeding the load balancers were not.
A bit later, Cloudflare VP Dane Knecht reported that all BGP routes for Facebook had been pulled. With no BGP routes into Facebook’s network, Facebook’s own DNS servers would be unreachable — as would the missing application servers for Facebook-owned Instagram, WhatsApp, and Oculus VR. UPDATE 10/4/2021 22:15 UTC: Facebook is coming back online after a six-hour outage due to DNS routing problems.
“Inside Facebook, the outage broke internal systems as well, leaving employees unable to get into offices and communicate easily with each other,” reports The Verge. “Some told The Verge they were using work-provided Outlook email accounts, allowing Facebook workers to email each other but unable to send or receive emails from external addresses.”
Not only was it a rough day for Facebook and their stockholders, but it was especially hard on CEO Mark Zuckerberg. According to Bloomberg, Zuckerberg’s personal wealth has fallen by more than $6 billion in just a few hours.
Read more of this story at Slashdot.