This page describes what to do in case of an Icinga alert. For more information you could search the govuk-puppet repo for the source of the alert

Warning This document has not been updated for a while now. It may be out of date.

Last updated: 5 Apr 2022

High Search API Sidekiq queue latency

Search API uses Sidekiq to offload indexing work.

This alert triggers when there are jobs in the Sidekiq queue that are waiting too long to be processed. This could result in documents being published not appearing in search results.

Investigating the issue

The issue could be caused by a temporary spike in publishing activity, or something being wrong with Search API.

You can check the Sidekiq Grafana dashboard for Search API (integration, staging, production). Take a look at the “Retry set size” - this could mean that jobs are failing. You can then look at Sentry or Sidekiq web to see what’s going on.