Resolved -
We have worked thru all of the backlog from the incident. Thank you all for your patience during this incident.
May 17, 23:51 UTC
Update -
We are continuing to reduce the macOS backlog and are monitoring. We will update in 20 minutes.
May 17, 23:37 UTC
Update -
We are continuing to reduce the backlog of jobs. We will update again in 20 minutes.
May 17, 23:07 UTC
Monitoring -
We are continuing to work thru the backlog of jobs and are now monitoring. We will update again in 20 minutes.
May 17, 22:26 UTC
Update -
We are continuing to process Workflows jobs and will provide an update in 20 minutes.
May 17, 22:16 UTC
Update -
We are currently processing jobs in the Workflows queue and working on resuming normal service.
May 17, 21:54 UTC
Update -
We are processing Workflows jobs again in small numbers and continuing to work on a fix to resume normal services.
May 17, 21:27 UTC
Update -
We are continuing to work on implementing a fix and will provide an update in 20 minutes.
May 17, 21:15 UTC
Update -
We are continuing to work on implementing a fix and will provide an update in 20 minutes.
May 17, 20:53 UTC
Update -
We are still working on a fix for our databases and will provide another update in 20 minutes.
May 17, 20:29 UTC
Update -
We are continuing to work on implementing a fix with our databases and will provide an additional update in 20 minutes.
May 17, 20:08 UTC
Update -
We are continuing to work on implementing a fix with our databases and will provide an additional update in 20 minutes.
May 17, 19:47 UTC
Update -
We are working to increase capacity on one of our databases. Until this work is complete, we shall endeavour to process queued Workflows at a degraded rate.
May 17, 19:25 UTC
Update -
We are continuing to work on implementing the fix and will provide another update in 20 minutes.
May 17, 19:02 UTC
Update -
We are continuing to work on implementing the fix and will provide another update in 20 minutes.
May 17, 18:41 UTC
Update -
We are temporarily stopping the processing of Workflows jobs and will provide an update within 20 minutes.
May 17, 18:20 UTC
Identified -
We have identified the cause of the issue and are currently working on implementing a fix.
May 17, 18:02 UTC
Update -
We are continuing to investigate the cause of this issue with Workflows and will provide further updates in 20 minutes.
May 17, 17:45 UTC
Update -
We are continuing to investigate the cause of this issue with Workflows and will provide further updates in 20 minutes.
May 17, 17:25 UTC
Update -
We are continuing to investigate a problem with executing Workflows and will provide an update in 20 minutes.
May 17, 17:06 UTC
Investigating -
We are investigating a problem with Circle 2.0 Workflow execution.
May 17, 16:44 UTC