Downtime on eu-west-1-a cell
Affected
- Resolved · UTC
This incident has been resolved.
Downtime started at 2:10pm CEST on Friday the 8th of August and was over by 2:35pm CEST on the same day, and only affected our eu-west-1-a tenants.
The cause of the downtime was an unavailability of the database caused by a sudden surge in the database usage, that occurred at an unexpected speed and magnitude. Our auto-scaling and monitoring systems failed to react in time.
We're improving our monitoring and auto-scaling to prevent such downtime to happen again and investigating the component that might be responsible for this unnecessary database load.
- Monitoring · UTCRemediation has been successfully applied. We are closely monitoring the status of the cell and investigating its root cause to prevent it from happening again.
- Identified · UTC
We are continuing to work on a fix for this incident. Remediation is being applied.
- Investigating · UTC
We're investigating reports of degraded performance across the Sifflet web applications.