Table of contents
This page describes what to do in case of an Icinga alert. For more information you could search the govuk-puppet repo for the source of the alert

Icinga alerts

Onsite backups failed

The backup machine (e.g. collects backups from the various data stores at 9am every morning.

The location of the backups is defined in govuk-puppet.

It’s likely that this is failing because one of the backups it’s trying to collect is not ready yet when the process runs. We have an example of running the PostgreSQL backup earlier to deal with this situation.

To rerun an individual backup:

sudo su - govuk-backup
cd /etc/backup/
./001_directory_backup_postgresql_backups_postgresql_primary_1 # Or whichever script is relevant

If after running the script you find that you get some “Permission denied” errors on the files that the script is trying to copy, this probably means that the backup on the machine that the script is trying to copy from hasn’t finished yet. Only after that has finished will it change permissions to the govuk-backup user.

This page was last reviewed on 17 April 2019. It needs to be reviewed again on 17 October 2019 by the page owner #govuk-2ndline .
This page was set to be reviewed before 17 October 2019 by the page owner #govuk-2ndline. This might mean the content is out of date.