Operations grimoire

The Nasqueron operations grimoire tries to document the more arcane aspects of our complex infrastructure.

Welcome to the Nasqueron operations grimoire (NOG).

This grimoire is a reference about our infrastructure and services hosted with procedures we follow to build, maintain and deploy.

Our infrastructure is open, mainly documented in operations repository, and we actively encourage contributions from the community.

Infrastructure

• /Environments
• /Kubernetes
• /Docker engine
• /Salt

OS-specific

• /FreeBSD
• /RHEL
• /Packages repository

Storage

• /ZFS

Network

• /Network
• /DNS
• /Firewall
• /IPv6
• NetBox

Services

Core services

Messages queues

• /Kafka
• /RabbitMQ

Databases

• /MySQL
• /PostgreSQL

Ops

• /NetBox

Identity management

• /Login (Auth Grove)

Collaborative tools

• /DevCentral (Phabricator)
• /Etherpad
• /Mumble
• /Mastodon (social.nasqueron.org)
• /Openfire (XMPP)

IRC bots

• /Dæghrefn (eggdrop)
• /Odderon (darkbot)

Mail

• /Mail
• /Mail/DKIM
• /Mail/Sympa

Web

Common documentation for all webserver roles

• /Web/Headers

Where to host?

• /Docker engine for Docker containers front-end
• /Alkane for PHP and static sites

SaaS for common applications

• MediaWiki SaaS
• /WordPress

Other sites

• /Sites on Eglide
• /Sites on Ysul (currently migrating to Alkane)

Services for web applications

• /Orbeon

CI/CD

• /Broker
• /Docker registry
• /Jenkins
• /Notifications center
• /Sentry
• /Vault

Shellserver

• /Eglide/Vault

Observability

• /Grafana
• /Prometheus

Services configuration

This section contains general information not related to a specific service.

• /TLS certificates (Let's encrypt / letsencrypt)

Checklists

Infrastructure

• /How to add a server to the Nasqueron servers pool
• /How to attach a new virtual disk
• /Reboot checklist

Network

• /Checklist router post-restart

Docker

• /Restart a Docker engine
• /Dwellers to DevCentral
• /Git operations in production containers
• /Add a service to Docker PaaS
• /Docker Hub

Salt

• /Operations repository
• /Deploy with Salt
• /Create and revoke user accounts on Salt servers
• /Provision user homefiles

SIG

• /Onboarding

Appendices

• /Changelog
• /Contacts
• /Contribute
• /Evaluated products
• /External services
• /Incidents
• /Policies
• /Old content report