Loose ends - this from the report at https://www.google.com/appsstatus/dashboard/
Incident affecting Admin Console
Incident began at 2025-01-28 15:26 and ended at 2025-01-28 17:34 (times are in Coordinated Universal Time (UTC)).
Date Time Description
Jan 29, 2025 12:59 AM UTC
Mini Incident Report
We apologize for the inconvenience this service outage may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Workspace Support using the help article https://support.google.com/a/answer/1047213.
(All Times US/Pacific)
Incident Start: 28 January 2025, 07:26
Incident End: 28 January 2025, 09:34
Duration: 2 hours, 8 minutes
Affected Services and Features:
Workspace Admin Console and Help Assistant
Workspace Support
Regions/Zones: Global
Description:
Workspace Admin Console and Workspace Support experienced availability issues intermittently for a duration of 2 hours, 8 minutes. Based on preliminary investigation, the incident was caused by an overloaded metadata service that led to issues with fetching the customer metadata.
The issue was mitigated by re-directing traffic away from the impacted metadata service to an alternate service. The traffic will be served from the alternate metadata service until we complete the root cause analysis and fix the underlying issue.
Google will complete a full investigation in the following days that will provide a full root cause.
Customer Impact:
Workspace Admin Console and Help Assistant:
Some customers experienced elevated latency and ‘500’ errors when accessing the Admin console.
Some customers could access Admin Console normally, but experienced issues launching ‘Help Assistant’.
Workspace Support:
Some customers experienced issues attempting to open new support cases via Workspace support portal and chat.
Customers that had issues with opening cases via the support portal were redirected to our backup Contact Us Form (CUF).
Customers that had issues opening cases via chat were redirected to the support portal to create email based cases.