Table of contents
This page describes what to do in case of an Icinga alert. For more information you could search the govuk-puppet repo for the source of the alert

root filesystem is readonly

When Ubuntu is unable to write to disk it switches the filesystem to be read only. This could be caused by a cloud hosting provider having problems with their Storage Area Network (SAN).

The machine will need to have a filesystem check forced on reboot. To do this you will need access to the vCloud Director instance for the environment, this access is typically only available to members of the GOV.UK Infrastructure team. However, if you do on-call, you should have access to the vCloud Production environment.

In the vCloud Director instance:

  • Find the affected machine
  • Click on the ‘console’ image to bring up a web based console
  • Click the 'reset’ icon in the top bar and then click to focus on the console
  • Press the 'f’ key when prompted (or repeatedly if there’s no output) to force a filesystem check.
This page is owned by #2ndline and needs to be reviewed