
Cloudfare, a leading content delivery network (CDN), experienced a global outage on July 22, 2021, affecting millions of websites worldwide.
The outage was caused by a software update gone wrong, which led to a cascading failure of Cloudfare's edge servers.
Websites that rely on Cloudfare for content delivery and security were left without protection, making them vulnerable to cyber threats.
This was a major concern for website owners, as Cloudfare's services are used by 20% of the top 10,000 websites globally.
Cloudfare's outage lasted for several hours, causing widespread disruptions and impacting online businesses.
A different take: Crowdstrike Outage Azure
Cloudflare Issues Reports
Cloudflare's dashboard and API issues were caused by a power outage at multiple data centers. This is the second major outage to hit the company in a week.
The power outage was first reported two hours after the issues began. Cloudflare explained that they were assessing the loss of power and failing over services.
The first outage of the week, which occurred on Monday, October 30, was caused by a misconfiguration in the tool used to deploy a new Workers KV build. Workers KV is a tool used by both customers and Cloudflare teams to manage configuration data and other low-latency access needs.
Cloudflare's Matt Silverlock and Kris Evans explained that the Monday outage was caused by a misconfiguration in the tool used to deploy a new Workers KV build.
Causes of the Outage
Cloudflare's outages have been caused by a mix of technical issues and power outages. The company's data centers have experienced power outages, leading to dashboard and API issues.
A misconfiguration in the tool used to deploy a new Workers KV build was behind the first large outage on Monday, October 30. This tool is used by both customers and Cloudflare teams to manage configuration data.
The power outage at multiple data centers was the cause of the second outage, which affected multiple products, including Cloudflare Sites and Services.
Data Center Power Outage
Cloudflare has experienced a data center power outage that has caused issues with their dashboard and API. This is not the first time the company has faced a large outage, with the first one happening on Monday, October 30.
The Monday outage was caused by a misconfiguration in the tool used to deploy a new Workers KV build, which is a critical component of Cloudflare's services. Workers KV is used by both customers and Cloudflare teams to manage configuration data, routing lookups, static asset bundles, authentication tokens, and other data that needs low-latency access.
The power outage at multiple data centers has resulted in a loss of power impacting data centers, which is causing the ongoing issues. Cloudflare is working to mitigate the problem and provide regular updates until the issue is resolved.
Here are some of the impacted services due to the power outage:
- API
- Cloudflare
- Data Center
- Outage
- Power
It's worth noting that the power outage has caused issues with multiple services, including Cloudflare's dashboard and API.
Other Possible Causes
Another possible cause of the outage is a surge in demand for electricity, which can put a strain on the grid. This can be particularly true during hot summer months when people rely more heavily on air conditioning.
The grid's infrastructure may not be equipped to handle the increased demand, leading to power outages. For example, the article notes that the grid's transmission lines and substations can become overloaded during periods of high usage.
Aging infrastructure can also contribute to power outages. The article mentions that many of the grid's components are nearing the end of their lifespan, making them more prone to failure.
In some cases, human error can also be a factor in power outages. The article cites an example where a utility company's employee accidentally cut a power line, causing a widespread outage.
A fresh viewpoint: Microsoft Azure Security Infrastructure
Affected Services
Cloudflare's outage affected multiple websites hosted on its server, leaving thousands of users without access.
The issue was reported to be with the 1.1.1.1 public resolver, which is used by Cloudflare for its DNS service.
As many as 4,071 users reported an outage on DownDetector, a platform that tracks internet outages based on user reports.
The number of reports on DownDetector has since decreased to the 400s, suggesting that the issue is being resolved.
98% of users who reported an issue on DownDetector said it was related to DNS, while 1% reported a problem with hosting.
Some users even claimed that the outage was not limited to Cloudflare's DNS, but also affected other hosting services like Google.
Timeline of Events
Cloudflare's outage on October 20, 2022, lasted for about an hour.
The incident was reported around 12:00 PM UTC.
Cloudflare's system experienced a failure due to a software bug.
This bug caused a cascading effect, affecting multiple data centers.
For another approach, see: Cloudflare Inc San Francisco
Cloudflare's engineers worked to resolve the issue, which they did by 13:00 PM UTC.
The company's systems were restored to normal operation shortly after.
The outage was resolved, but not before it had a significant impact on the internet.
Many websites and online services were affected, including some major brands.
Cloudflare's team investigated the cause of the outage and implemented changes to prevent it from happening again.
The company took steps to improve its systems and processes.
Cloudflare's outage on October 20, 2022, served as a reminder of the importance of robust systems and processes.
It also highlighted the need for rapid response and resolution in the event of an outage.
Featured Images: pexels.com


