Skip to main content
Last updated: 28 Jun 2021

How logging works on GOV.UK

Source diagram.

Logit

GOV.UK is following The GDS Way guidance on logging by using the approved vendor Logit.

For information on how to log in and view stacks, please see the GOV.UK Logit documentation.

Note: although Logit is where we currently store logs, the GDS Way suggests we are migrating towards Splunk and therefore some logs are currently available in Splunk.

Kibana

Kibana is the interface for viewing logs in Elasticsearch. Use the Logit interface to log into Kibana.

There’s some documentation on useful Kibana queries for 2nd line.

Filebeat

Each machine runs Elastic Filebeat, and independently ships logs to the Logit-provided logstash endpoint.

Filebeat tails logs every 10 seconds and can output to a variety of sources. It is fully incorporated into the Elastic ecosystem.

We use the filebeat::prospector defined type to create the filebeat configuration on each instance.

Logstream and Logship

We have a defined type in our Puppet code which uses logship to tail logfiles. We only use Logstream to send nginx metrics, via statsd, to Graphite.

In the future this will be replaced.

Fastly

Fastly sends logs to S3 for the www, assets and bouncer services. These can be queried through Athena.