acmestatus
History

Webhook deliveries are delayed

Delayed webhook deliveriesMonitoring

  1. MonitoringThe backlog is draining at about 40,000 events a minute and should clear by 15:10. New events are delivered within 30 seconds.
  2. IdentifiedOne of three relay workers stopped acknowledging after a config push. It has been rolled back.
  3. InvestigatingWebhooks are arriving up to 12 minutes late. We are looking into it.

Components

Uptime over the last 90 days: 99.99%

Scheduled maintenance

Postgres minor upgrade, eu-west-1Scheduled

Sat 18 Oct, 02:00 to 03:00 UTC

Runs will queue and resume after the window. The API stays up; writes may take up to 2 seconds longer for about 30 seconds during the switchover.

Past incidents

Full history
  1. No incidents reported.

  2. API errors in ap-south-1Postmortem

    1. ResolvedError rates are back to normal. 3.1% of requests in ap-south-1 failed between 09:12 and 09:41 IST.
    2. IdentifiedA database failover took longer than expected; connections are recovering.
    3. InvestigatingElevated 5xx responses from the API in ap-south-1.
  3. No incidents reported.

  4. Database maintenanceCompleted

    1. CompletedPostgres 17.4 upgrade on the primary cluster. No downtime.
  5. No incidents reported.

Get updates

Incident and maintenance notices for the components you pick.