Table of contents
This page describes what to do in case of an Icinga alert. For more information you could search the govuk-puppet repo for the source of the alert

Icinga alerts

RabbitMQ: high watermark has been exceeded

The RabbitMQ server detects the total amount of RAM installed on startup. By default, when the RabbitMQ server uses above 40% of the installed RAM, it raises a memory alarm and blocks all connections. Once the memory alarm has cleared (e.g. due to the server paging messages to disk or delivering them to clients) normal service resumes.

If this alert is regularly triggered it is a sign that it is time to beef up the Rabbit boxes with more RAM. Alternatively, if you don’t care about messages, you can try to purge messages or remove unused queues.

Further information can be found in the RabbitMQ docs

This page was last reviewed on 1 April 2019. It needs to be reviewed again on 1 October 2019 by the page owner #govuk-2ndline .
This page was set to be reviewed before 1 October 2019 by the page owner #govuk-2ndline. This might mean the content is out of date.