Operations grimoire/Checklist router post-restart

From Nasqueron Agora
Revision as of 21:33, 12 May 2023 by Dereckson (talk | contribs) (Created page with "A router-001 restart severes GRE tunnels and their existing TCP connections. As such, this checklist notes the known issues when private network is disrupted. To partially prevent this, a blue/green deployment or immutable artifacts should be encouraged. It's recommended for the next non urgent upgrade to create router-002 and move GRE connections to it. The checklist should still be checked. == IRC eggdrops == * Dæghrefn: MySQL is normally at periodic interval reco...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

A router-001 restart severes GRE tunnels and their existing TCP connections.

As such, this checklist notes the known issues when private network is disrupted.

To partially prevent this, a blue/green deployment or immutable artifacts should be encouraged. It's recommended for the next non urgent upgrade to create router-002 and move GRE connections to it. The checklist should still be checked.

IRC eggdrops

  • Dæghrefn: MySQL is normally at periodic interval reconnected, but you can trigger this with .tcl sqlrehash
  • Wearg: MySQL does NOT reconnect, and that will probably exit from the timer
    • .tcl sqlrehash to reconnect to MySQL
    • .tcl broker::on_tick to reconnect to broker and start timer to get message
    • .tcl utimers to ensure timer is good, you should see a :broker::on_tick timer

T1862 offers to detect MySQL issues and reconnect.