AWS Outage
A Brief Summary of what we know
Yesterday AWS East experienced an outage, here are notable points:
Outage started around 12 PM EST affecting US-EAST-1
Increased API error rates for AWS Services in the region
Amazon also noted that attempting login using root credentials, even via console endpoint not in US-EAST-1 were affected
Initial blame went to several network devices
This included Elastic Compute Cloud and DynamoDB
Disrupted multiple companies including Netflix, Amazon Prime, Roku, Ring, Tinder and Disney+
Also affected Amazon delivery as employees were not able to scan packages, access delivery routes or see schedules
Internal Slack messages show that activity from Amazon's real-time digital advertising auction may be responsible for much of the traffic overwhelming the firewall
One AWS employee speculated that the outage was caused by an "orchestrated DNS attack,"
AWS manager described it as the fog of war
References:
https://news.ycombinator.com/item?id=29479357
https://www.bleepingcomputer.com/news/technology/aws-outage-impacts-ring-netflix-and-amazon-deliveries/
https://www.reuters.com/markets/commodities/amazons-prime-ring-other-apps-down-thousands-users-2021-12-07/
https://status.aws.amazon.com/
In October Facebook was down due to a BGP and DNS issue
In November Google experienced an outage caused by a bug in the process that propagates configuration rules to GCLB
References:
https://status.cloud.google.com/incidents/6PM5mNd43NbMqjCZ5REh
https://www.facebook.com/business/news/update-about-the-october-4th-outage