Gigalixir Status Page - Global Internet Issues – Incident details

Global Internet Issues

Resolved
Degraded performance
Started 11 months agoLasted about 4 hours

Affected

Dashboard

Degraded performance from 6:10 PM to 8:23 PM, Operational from 8:07 PM to 10:06 PM

US-Central1 (Google Cloud)

Degraded performance from 6:10 PM to 8:23 PM, Operational from 8:07 PM to 10:06 PM

Europe-West1 (Google Cloud)

Degraded performance from 6:10 PM to 8:23 PM, Operational from 8:07 PM to 10:06 PM

US-East-1 (AWS)

Degraded performance from 6:10 PM to 8:23 PM, Operational from 8:07 PM to 10:06 PM

US-West-2 (AWS)

Degraded performance from 6:10 PM to 8:23 PM, Operational from 8:07 PM to 10:06 PM

Updates
  • Postmortem
    Postmortem

    Postmortem from Google: Multiple GCP products are experiencing Service issues - https://status.cloud.google.com/incidents/ow5i3PPK96RduMcb1SsW

  • Resolved
    Resolved

    It appears the multiple downstream incidents have been resolved. All services and components should be fully functional.

    As always, we'll keep monitoring and let us know if you see anything not behaving as expected so we can investigate.

  • Update
    Update

    It appears we're seeing progress towards recovery, except for GCP US-Central1

    Per Google: Our infrastructure has recovered in all regions except us-central1.

  • Update
    Update
    Cloudflare and GCP continue to try to get things back to normal, but no new updates providing a clear path to resolution yet.
  • Monitoring
    Monitoring

    Per Google: Multiple GCP products are experiencing impact due to Identity and Access Management Service Issue

    https://status.cloud.google.com/incidents/ow5i3PPK96RduMcb1SsW

  • Identified
    Identified
    AWS, GCP, and Cloudflare are showing large outages. These are all downstream providers for us. At the moment, new builds/deploys are not going out. Applications largely continue to run, but degraded performance can be expected. (Updated status with proper start date)