Skip to main content
azuredown
criticalStorageCentral US

Azure Central US Outage (July 18–19, 2024): The Storage Allowlist Failure, Explained

AzureDown Research · Incident analysisPublished July 23, 2024Updated June 18, 20269 min read

Timeline

  1. Impact begins

    Availability drops for Azure Storage in part of the Central US region. Virtual machines with disks on the affected storage scale units begin failing, taking application workloads and dependent services with them.

  2. Investigating

    Microsoft acknowledges customer impact for Virtual Machines and storage in Central US and begins investigating. Microsoft 365 services with dependencies in the region start reporting degradation.

  3. Identified

    Root cause identified: a configuration change containing an incomplete allowlist was applied to storage scale units, causing them to reject legitimate traffic. Engineers begin backing out the change and restoring storage partitions.

  4. Mitigating

    Storage availability is largely restored. Virtual machine recovery proceeds more slowly - VMs must reconnect to their disks, and some require manual remediation.

  5. Resolved

    Virtual machine recovery is substantially complete, roughly 14 hours after impact began. Residual impact for individual services is worked through separately.

Root cause

At around 21:56 UTC on July 18, 2024, a configuration change was applied to a set of Azure Storage scale units in the Central US region. The change included an incomplete allowlist - the mechanism that determines which callers a storage scale unit will accept traffic from. With legitimate sources missing from the list, the affected scale units began rejecting the very traffic they existed to serve, and storage availability across an availability zone dropped.

What turned a storage misconfiguration into a region-scale event is Azure's dependency chain. Virtual Machines do not hold their disks locally - OS and data disks live on Azure Storage. When storage rejects requests, VMs don't degrade; they fail. And when VMs fail, everything above them fails: application workloads, databases running on IaaS, platform services with compute in the zone, and - most visibly - Microsoft 365 services with dependencies in Central US. Users saw Teams, and other M365 experiences degrade while the root cause sat two layers below anything they could see.

The recovery asymmetry is worth noting. Backing out the configuration change and restoring storage took a few hours. Restoring compute state took the rest of the night: tens of thousands of VMs had to re-establish disk connectivity, some required manual remediation, and dependent services each had their own recovery tail. Storage was the root cause; VM recovery was the long pole.

Business impact

For enterprises, this outage was a business-continuity case study in three ways.

First, the blast radius crossed the IaaS/SaaS boundary. Organizations that had carefully planned Azure DR discovered that their productivity suite was coupled to the same regional storage they were insulating their workloads against. A BIA that lists "Microsoft 365" as an independent vendor misses this coupling - the BC/DR planning hub treats M365 dependency coupling as a first-class planning gap for exactly this reason.

Second, it was a single-zone storage failure with multi-zone consequences. Workloads that were genuinely zone-redundant - zone-redundant storage, VMs spread across zones behind a load balancer - rode through with degraded capacity rather than an outage. Workloads that were merely deployed in Central US, on locally-redundant storage in the wrong zone, went down. The difference between those two postures is configuration, not cost, and it is the central argument of our zones and region pairs guide.

Third, the calendar was brutal. The unrelated CrowdStrike Falcon incident began the next day, blue-screening Windows fleets worldwide. Enterprise incident teams spent that week running two major-incident processes simultaneously - a reminder that your continuity plan must assume concurrent crises, not one tidy incident at a time. Teams with a single on-call rotation and a single war-room process found both saturated.

Prevention and lessons

The uncomfortable lesson is that a customer could have done everything "right" inside a single zone and still gone down. The realistic mitigations:

  1. Make zone redundancy the default, not the upgrade. Zone-redundant storage and multi-zone VM deployments turned this event from an outage into a capacity blip. Audit which of your Central US-style single-region workloads are actually zone-redundant - the answer is usually "fewer than the architecture diagram claims."
  2. Test the storage-failure mode specifically. Most game days simulate VM loss. This event was disk loss: VMs alive but unable to read or write. Inject that failure in staging and watch what your applications, health checks, and auto-recovery actually do. The BC/DR hub's five-step process includes this as a named scenario.
  3. Map your Microsoft 365 coupling. If your incident bridge, documentation, and communication channels all live in Teams and SharePoint, a regional Azure event can take out your response tooling along with your workloads. Keep one communication channel and one runbook copy outside the Microsoft dependency tree.
  4. File the claim. Fourteen hours is well past SLA thresholds for affected resources. Azure credits are claimed, not granted - track the incident's tracking ID, gather your resource health evidence, and submit within the claim window. Watch the Storage status page rather than social media for the authoritative timeline.

SLA credit eligibility

Yes - affected Central US workloads fell well below monthly SLA targets. Roughly 14 hours of impact equates to ~98.1% monthly uptime if fully down, below the 99.99% zone-redundant VM SLA and Storage targets. Claims required a support case with evidence, filed within the SLA’s claim window.

Work out what your bill was owed with the independent Azure SLA credit calculator, or automate breach detection with Next Signal (sponsor). For the full claim process, see the Azure credit-recovery playbook.

Questions about this outage

What caused the Azure Central US outage in July 2024?

A configuration change applied to Azure Storage scale units contained an allowlist error, causing storage in an availability zone of Central US to reject legitimate requests. Virtual machines cannot operate without their disks, so VMs and everything running on them failed, cascading into dependent Azure services and Microsoft 365.

How long did the July 2024 Azure outage last?

Around 14 hours end to end: impact began at roughly 21:56 UTC on July 18, storage was restored within a few hours, and virtual machine recovery was substantially complete by around 12:00 UTC on July 19. Some individual services took longer to fully clear.

Was the July 2024 Azure outage related to CrowdStrike?

No - but it hit the same week. The Azure Storage configuration error (July 18–19) was an independent Microsoft incident; the CrowdStrike Falcon sensor update that blue-screened Windows machines worldwide began on July 19. Many enterprise incident teams had to work both at once, which is exactly why the two are often conflated.

Did the July 2024 Central US outage qualify for SLA credits?

Yes, for many affected customers. Fourteen hours of unavailability in a month is far below the 99.99% zone-redundant VM SLA and Storage’s committed targets, reaching meaningful credit tiers. Credits required filing a claim with evidence through Azure support.

Next time, hear it from us first

Instant alerts when Azure incidents are detected - services and regions included.

Get outage alerts

More post-mortems

Entra ID

The June 2023 Layer-7 DDoS Attacks on Microsoft: Portal, Outlook, and OneDrive Disrupted

Layer-7 DDoS attacks - attributed by Microsoft to the actor it tracks as Storm-1359 - flooded the web front ends of the Azure Portal, Outlook on the web, and OneDrive across several days in early June 2023. Authentication and portal access failed intermittently, showing how an attack on web tiers reads as an identity outage to the business.

Azure DNS

The May 2019 Azure DNS Outage: A Delegation Change Gone Wrong

A name-server delegation change made during a planned Azure DNS migration disrupted resolution for Microsoft services globally. Because DNS sits in front of everything, customers could not reach Storage, SQL Database, and Microsoft 365 even though those services were themselves healthy - for roughly three hours.