Table of contents

Monitoring for data.gov.uk

Prometheus

Container metrics are scraped using the PaaS Metric Exporter and sent to Grafana. In a nutshell, the metric-exporter app exposes a /metrics endpoint listing all of the stats for each container.

Pingdom

Pingdom monitors https://data.gov.uk uptime and alerts PagerDuty when downtime is detected. Maintenace of this service forms part of #govuk-2nd-line.

Sentry

Sentry monitors application errors. The Sentry pages for each app can be found on the Find and Publish app pages.

Log.it

Each application sends logs to Logit. Publish and Find use the corresponding PaaS Service. Example query: source_host: "gds-data-discovery.data-gov-uk.find-data-beta" && access.response_code: 500.

Sidekiq (Publish)

Sidekiq is only accessible to the localhost domain, so you’ll need an SSH tunnel to see it on staging/production.

cf ssh -L 9000:localhost:8080 publish-data-beta-staging

Then go to localhost:9000/sidekiq in your browser to see active jobs, retries and to manually modify the schedule.

Analytics

Google Analytics records traffic for Find and CKAN. Ask for ‘read’ access to all 'properties’ in your request.

This page was last reviewed . It needs to be reviewed again by the page owner #govuk-datagovuk.