We're happy this incident is now resolved - we sincerely apologise for any impact experienced.
Our teams are continuing to investigate the root cause and trigger, please contact [email protected] to request an RFO
A potential fix has been implemented and our engineering team is now testing the system to make sure the issue has been successfully resolved.
We have started to see services recover since 17:53.
The cause of this incident has been identified and our engineers are working to resolve the issue as quickly as possible.
We have identified that an upstream device has had an issue following routine work, we are now applying an emergency upgrade to the affected device.
This incident has been logged and our team is now working to diagnose and fix the problem.