Skip to main content

Repository: search-v2-infrastructure

IaC definitions for GOV.UK Search v2

README

IaC definitions for GOV.UK Search v2

This repository contains Terraform resource definitions to provision Google Cloud’s Vertex AI Agent Builder Search (also previously known as “Vertex AI Search and Conversation” or “Gen App Builder” or in the APIs as “Discovery Engine”) for use as a search engine for GOV.UK through search-api-v2, and to set up a data pipeline for analytics events to feed into the search engine model.

To that end, the following modules are part of this repository:

  • terraform/meta: Bootstrap Terraform Cloud project/workspaces, GCP projects, and workload federation between the two (applied locally with Terraform Cloud state)
  • terraform/environment: Set up Discovery Engine resources, service accounts and keys, and AWS Secrets Manager secrets consumed by the Kubernetes platform for an individual environment for search-api-v2 (i.e. integration, staging, production)
  • terraform/modules/google_discovery_engine_restapi: A helper module to abstract deployment of Discovery Engine resources through the REST API provider (as there are no first party Terraform resources available in the Google provider yet)

Working on this repository

The workspace can be run as a devcontainer, which includes terraform and gcloud CLI tooling enabling log in to these providers. This is useful for working on and applying the terraform/meta module, which is intended to be run locally by an engineer with the required Google and Terraform Cloud access to bootstrap the initial set of resources. You can also run plans for other modules locally.

Warning Gitignored .terraform.credentials.d and .google.credentials.d directories are included in the repository, which are mounted into the devcontainer’s home folder for terraform login/gcloud login to store credentials into (so they persist across container rebuilds). These directories will contain sensitive information, so do not stop them being gitignored or force any files within to be checked in.