Monitor Sidekiq queues for your application
There are two approaches for monitoring Sidekiq, via the Sidekiq Web interface, or the Grafana dashboard.
Sidekiq comes with a web application,
that can display the current state of a Sidekiq installation. We
have configured this
to monitor multiple Sidekiq configurations used throughout GOV.UK.
We have restricted public access as the Web UI allows modifying the state of Sidekiq queues.
To gain access you should setup SSH port forwarding to a backend box belonging to the environment you wish to monitor when connected to the Bardeen wireless network or the VPN:
$ ssh backend-1.backend.staging -CNL 9000:127.0.0.1:3211
Or on AWS:
$ ssh $(ssh integration "govuk_node_list --single-node -c backend").integration -CNL 9000:127.0.0.1:3211
To view your local Sidekiq queue, go to the sidekiq-monitoring
app in the vm and run
./bin/foreman start for all applications, or
run <app_name> for a specific app.
http://sidekiq-monitoring.dev.gov.uk:3211/to see a list of all the GOV.UK applications whose Sidekiq status you can monitor
http://sidekiq-monitoring.dev.gov.uk/<app_name>to directly monitor a specific app
Sidekiq Grafana Dashboard
You can also monitor Sidekiq queue lengths using this Grafana dashboard. It is available in all environments.
See also: Add sidekiq-monitoring to your application.
More about Monitoring
- Add a deployment dashboard for an application
- Add an Icinga passive check to a Jenkins job
- Add sidekiq-monitoring to your application
- Error reporting with Sentry
- GOV.UK and Virtual Private Networks (VPNs)
- Graphite and deployment dashboards
- How to deal with errors
- Monitoring screens
- Nagios NRPE connection failures
- Pingdom Bouncer canary check
- Tools: Icinga, Grafana and Graphite, Kibana and Fabric
- Uptime Metrics
- Use AWS X-Ray to trace app requests
- Use Terraboard to monitor Terraform state