Table of contents
This page describes what to do in case of an Icinga alert. For more information you could search the govuk-puppet repo for the source of the alert

Icinga alerts

Root filesystem is readonly

When Ubuntu is unable to write to disk, it switches the filesystem to be read only. This could be caused by a cloud hosting provider having problems with their Storage Area Network (SAN). It is possible for a machine to operate in a degraded way with a read only file system so this check serves as an early warning if that happens.

The machine will need to have a filesystem check forced on reboot. To do this, you will need access to the vCloud Director instance for the environment. If you do on-call, you should have access to the vCloud Production environment.

In the vCloud Director instance:

  • Find the affected machine
  • Click on the ‘console’ image to bring up a web based console
  • Click the 'reset’ icon in the top bar and then click to focus on the console
  • Press the 'f’ key when prompted (or repeatedly if there’s no output) to force a filesystem check.
This page was last reviewed on 10 February 2019. It needs to be reviewed again on 10 August 2019 by the page owner #govuk-2ndline .
This page was set to be reviewed before 10 August 2019 by the page owner #govuk-2ndline. This might mean the content is out of date.