Operations grimoire/Incidents/2017-03-01-Eglide: Difference between revisions
From Nasqueron Agora
(Created page with "Tracked at https://devcentral.nasqueron.org/T1162. == Incident timeline == * 03:18:56 amj weechat client timeouts on Freenode * 03:19:05 Odderon timeouts too * 04:22:47 tomje...") |
(No difference)
|
Revision as of 12:53, 6 March 2017
Tracked at https://devcentral.nasqueron.org/T1162.
Incident timeline
- 03:18:56 amj weechat client timeouts on Freenode
- 03:19:05 Odderon timeouts too
- 04:22:47 tomjerr asks if it's down
- 19:52:41 Sandlayth rebooted the server
After the incident, it was noticed Odderon didn't automatically connect:
- 21:08:05 Odderon joins channel
Analysis
Outage root cause isn't known, logs doesn't contain any relevant information.
A simple reboot was enough to resume service, but 16 hours was needed to reach Sandlayth, alone with credentials to do it.
Actionables
- Get Sandlayth contact information on file
- Ensure Scaleway account is accessible
- [DONE] Enable Odderon service (D934)
