Table of contents
This page describes what to do in case of an Icinga alert. For more information you could search the govuk-puppet repo for the source of the alert

Icinga alerts

Unicorn Herder

‘app unicornherder running’

This alert means the Unicorn Herder process has disappeared for the named app, so the app is still running but we don’t know about it and can’t control it.

At the moment, the fix is to run the Fabric task vm.bodge_unicorn for that app. (The name of the task should give a clue as to why I say “At the moment”.)

Configure and activate your fabric environment as described in the fabric-scripts README.

Then run the vm.bodge_unicorn task for the affected machine and application:

fab $environment -H whitehall-backend-1.backend vm.bodge_unicorn:whitehall

Job done. The Nagios alert should clear within a few minutes.

This page was last reviewed on 13 March 2019. It needs to be reviewed again on 13 September 2019 by the page owner #govuk-2ndline .
This page was set to be reviewed before 13 September 2019 by the page owner #govuk-2ndline. This might mean the content is out of date.