椒盐豆豉剪报
https://blog.cloudflare.com/october-2021-facebook-outage/ Facebook 今天是如何从互联网上”消失“的——Cloudflare blog (Cloudflare 写博客/自夸/给自己打广告的速度真是惊人……) 简而言之: FB 自己把自己跟外界接轨的“路由器”的“网线”给拔了,把自己手下星系的子星系(WhatsApp, Intagram, Messenger 以及千千万万组成这些“星系”的星星——单个服务器)每个单独开了一个”黑域“,外界找…
More on Facebook outage: https://engineering.fb.com/2021/10/05/networking-traffic/outage-details/
所以一切传闻都是真的,有 Facebook engineer 去现场(因为要用很多电八成在某个鸟不拉屎的大荒地)physically debug,前阵子我还在吐槽 #FreeGuy 里拿斧子砍服务器的设定太瞎,结果就(sorta)发生了!好刺激
Our primary and out-of-band network access was down, so we sent engineers onsite to the data centers to have them debug the issue and restart the systems. But this took time, because these facilities are designed with high levels of physical and system security in mind. They’re hard to get into, and once you’re inside, the hardware and routers are designed to be difficult to modify even when you have physical access to them. So it took extra time to activate the secure access protocols needed to get people onsite and able to work on the servers. Only then could we confirm the issue and bring our backbone back online.
#reading #indieblog #tech #news #fun #FB
所以一切传闻都是真的,有 Facebook engineer 去现场(因为要用很多电八成在某个鸟不拉屎的大荒地)physically debug,前阵子我还在吐槽 #FreeGuy 里拿斧子砍服务器的设定太瞎,结果就(sorta)发生了!好刺激
Our primary and out-of-band network access was down, so we sent engineers onsite to the data centers to have them debug the issue and restart the systems. But this took time, because these facilities are designed with high levels of physical and system security in mind. They’re hard to get into, and once you’re inside, the hardware and routers are designed to be difficult to modify even when you have physical access to them. So it took extra time to activate the secure access protocols needed to get people onsite and able to work on the servers. Only then could we confirm the issue and bring our backbone back online.
#reading #indieblog #tech #news #fun #FB
Engineering at Meta
More details about the October 4 outage
Now that our platforms are up and running as usual after yesterday’s outage, I thought it would be worth sharing a little more detail on what happened and why — and most importantly, how we’re lear…