Gigalixir Status Page - Global Internet Issues – Incident details

All systems operational

Global Internet Issues

Resolved
Degraded performance
Started about 1 year agoLasted about 4 hours

Affected

Dashboard

Degraded performance from 6:10 PM to 8:23 PM, Operational from 8:07 PM to 10:06 PM

US-Central1 (Google Cloud)

Degraded performance from 6:10 PM to 8:23 PM, Operational from 8:07 PM to 10:06 PM

Europe-West1 (Google Cloud)

Degraded performance from 6:10 PM to 8:23 PM, Operational from 8:07 PM to 10:06 PM

US-East-1 (AWS)

Degraded performance from 6:10 PM to 8:23 PM, Operational from 8:07 PM to 10:06 PM

US-West-2 (AWS)

Degraded performance from 6:10 PM to 8:23 PM, Operational from 8:07 PM to 10:06 PM

Updates
  • Postmortem
    UTC
    Postmortem

    Postmortem from Google: Multiple GCP products are experiencing Service issues - https://status.cloud.google.com/incidents/ow5i3PPK96RduMcb1SsW

  • Resolved
    UTC
    Resolved

    It appears the multiple downstream incidents have been resolved. All services and components should be fully functional.

    As always, we'll keep monitoring and let us know if you see anything not behaving as expected so we can investigate.

  • Update
    UTC
    Update

    It appears we're seeing progress towards recovery, except for GCP US-Central1

    Per Google: Our infrastructure has recovered in all regions except us-central1.

  • Update
    UTC
    Update
    Cloudflare and GCP continue to try to get things back to normal, but no new updates providing a clear path to resolution yet.
  • Monitoring
    UTC
    Monitoring

    Per Google: Multiple GCP products are experiencing impact due to Identity and Access Management Service Issue

    https://status.cloud.google.com/incidents/ow5i3PPK96RduMcb1SsW

  • Identified
    UTC
    Identified
    AWS, GCP, and Cloudflare are showing large outages. These are all downstream providers for us. At the moment, new builds/deploys are not going out. Applications largely continue to run, but degraded performance can be expected. (Updated status with proper start date)