Once again we have enough capacity online, will be working on permanent fix now that peak demand is fading. Continuing to monitor but will have not post updates unless status regresses.
Posted Nov 09, 2015 - 23:48 UTC
Update
We’re seeing some anticipated queueing during our peak period. We’re working on resolving the issue without taking too much capacity offline in the short term. We’re monitoring closely and will update in 1 hour.
Posted Nov 09, 2015 - 23:01 UTC
Update
We are continuing to monitor and to add iOS capacity. We expect some intermittent queueing as the capacity is still reduced. We’ll update within 1 hour.
Posted Nov 09, 2015 - 21:52 UTC
Monitoring
The queue remains cleared but we are operating at reduced capacity and continuing to deal with the root cause. We’ll update in 1 hour.
Posted Nov 09, 2015 - 20:47 UTC
Update
We’ve manually cleared the OS X build queue, and are continuing to fix the root cause. We’ll post another update in an hour. Please reach out to support at sayhi@ or in-app if you’re seeing longer than minimal queue times.
Posted Nov 09, 2015 - 19:58 UTC
Update
We’re still working on the underlying issue, but we are keeping more capacity online and the queue is currently declining. Next update in 1 hour.
Posted Nov 09, 2015 - 18:48 UTC
Update
We are still working to keep builds moving as much as possible, work on the fix continues. Next update within 45 minutes.
Posted Nov 09, 2015 - 17:57 UTC
Update
There is an issue with recycling new VMs which is draining capacity. We're working on keeping builds moving as much as possible while also working on a fix. Next update within 45 minutes.
Posted Nov 09, 2015 - 16:59 UTC
Update
We've identified the root cause for the drop in iOS capacity and are working to a resolution.
Posted Nov 09, 2015 - 16:13 UTC
Update
The iOS build queue has been cleared but some secondary effects are preventing us bringing our full capacity online. We are working though and fixing these now.
Posted Nov 09, 2015 - 15:35 UTC
Identified
Some bad iOS build machines are causing iOS builds to queue. We have identified these machines and are bringing up replacements now.