GOV.UK
Manual
Top tasks
- Deploy an application to GOV.UK
- Deploy emergency publishing banners
- Purge a page from cache
- Reboot a machine
- Run a rake task
- Useful Kibana queries
Manual
- Documentation style guide
- Monitor docs traffic
- Review a page in this manual
- Where to find what documentation?
Expired pages
- Redis alerts
- publisher app healthcheck not ok
- Tools: Icinga, Grafana and Graphite, Kibana and Fabric
- Error reporting with Sentry
- Add sidekiq-monitoring to your application
- Get access to CI (Jenkins)
- Set up PostgreSQL replication
- Generate a Certificate Signing Request (CSR) for GOV.UK
- Set up a new mirror for GOV.UK
- Graphite and deployment dashboards
- RabbitMQ
Pages due for review this week
- Remove a machine
- ClamAV definitions out of date
- Benchmark search queries failed
- Check for spelling suggestions failed
- MongoDB rollback
- Documentation style guide
- Where to find what documentation?
- Upload an asset to asset-manager
- Monitor docs traffic
Icinga alerts
- App healthcheck failed
- App isn't running the expected Ruby version
- Asset master and slave disk space comparison
- Asset master attachment processing
- AWS SES quota usage higher than expected
- Backup passive checks
- Benchmark search queries failed
- Check for spelling suggestions failed
- Check that correct users have access
- ClamAV definitions out of date
- Data sync
- Defined CPU type does not match
- duplicate SSH host keys
- Elasticsearch cluster health
- Elasticsearch: not receiving Syslog from Logstash
- Email alerts not sent
- Enhanced ecommerce data export
- es-rotate
- Fastly error rate for GOV.UK
- Fetch analytics data for search failed
- Fix stuck virus scanning
- Free memory warning on backend
- GitHub Enterprise connectivity
- Gor
- high disk time
- High memory for application
- high zombie procs
- Logs are not being received from the CDN
- logspout running
- Low available disk inodes
- Low available disk space
- mongod replication lag
- MongoDB rollback
- MySQL Xtrabackups to S3
- MySQL: replication lag
- MySQL: replication running
- Nginx 429 too many requests
- Nginx 5xx rate too high for many apps/boxes
- Nginx high conn writing -- upstream indicator Check
- Nginx requests too low
- ntp drift too high
- Offsite backups
- Onsite backups
- Outstanding security updates
- PagerDuty drill
- Pingdom check for homepage failing
- Pingdom search check
- PostgreSQL: replication too far behind
- PostgreSQL: S3 Backups
- Prolonged GC collection times
- publisher app healthcheck not ok
- Puppet last run errors
- RabbitMQ: high watermark has been exceeded
- RabbitMQ: No consumers listening to queue
- reboot required by apt
- Redis alerts
- rkhunter warnings
- root filesystem is readonly
- Unicorn Herder
- Varnish port not responding
- VPN down
- Whitehall app healthcheck not ok
- Whitehall scheduled publishing
Assets
- Assets: how they work
- Remove an asset
- Rescan an "infected" file in Whitehall
- Upload an asset to asset-manager
Backups
- Attachment backups
- Backup and restore Elasticsearch indices
- MongoDB backups
- MySQL backups
- PostgreSQL backups
- Replay search indexing traffic after restoring a backup
- Restore from offsite backups
- Rotate offsite backup GPG keys
Basics
CDN & Caching
DNS
Databases
- Clone a MySQL instance from one slave to another
- Resync a MongoDB database
- Set up PostgreSQL replication
- Upgrading MySQL
- Using Database GUI Tools
Deployment
- Block apps from being deployed
- Deploy an application to GOV.UK
- Deploy fixes for a security vulnerability
- Deploy Puppet
- Deploy when GitHub is unavailable
- Fall back to the static mirrors
- Handle encrypted hieradata
- Monitor your app during deployment
- Restart an application
- Run a rake task
- Set up Heroku review apps for pull requests
Development VM
- Fix problems with Vagrant
- Replicating application data locally for development
- Running out of disk space in development
Environments
- Add a disk to a vCloud machine
- Create a new environment for GOV.UK
- Generate a Certificate Signing Request (CSR) for GOV.UK
- GOV.UK's environments (training, integration, staging, production)
- Reboot a machine
- Remove a machine
- Reprovision a machine in vCloud Director
- Set up a new mirror for GOV.UK
- Update Pingdom IP Ranges
Frontend
Logging
Monitoring
- Add an Icinga passive check to a Jenkins job
- Add sidekiq-monitoring to your application
- Error reporting with Sentry
- GOV.UK and Virtual Private Networks (VPNs)
- Monitor sidekiq queues for your application
- Nagios NRPE connection failures
- Pingdom Bouncer canary check
- Upgrade to Sentry
- Uptime Metrics
Packaging
- Add a deployment dashboard for an application
- Create a new open source project for ops
- Debian packaging
- Packer Vagrant Dev VM / Image Creation
- Publish to Puppet Forge
- Retire an application
- Set up a new Rails app
- Switch an app off
- Upgrading Rails
Publishing
- Content that doesn't show up correctly in search or list pages
- Deploy emergency publishing banners
- How the draft stack works
- Taxonomy
- Upload HMRC PAYE files
Routing
- Change an organisation's slug
- Check for a `gone` route
- Edit an existing route in the Router
- Redirect a route
Support
Testing
- Get access to CI (Jenkins)
- Jenkins CI infrastructure
- Patching Jenkins
- Smoke testing with smokey
- Test & build a project on Jenkins CI
Tools
- Access apps on the shared Heroku account
- Add a new Ruby version
- GitHub Enterprise
- Graphite and deployment dashboards
- How we use GitHub
- Monitoring screens
- Pact Broker
- Policy on keeping software current
- RabbitMQ
- Run an A/B test
- Sidekiq
- Tools: Icinga, Grafana and Graphite, Kibana and Fabric
- Update Hubot (Slack bot)