Table of contents

Replay search indexing traffic after restoring a backup

If the index should fail and we need to restore from backup we can then replay this traffic rather than trying to resend from the source applications.

We are using GOR to store POST and DELETED requests made to the rummager servers.

Data for each of the rummager machine is stored locally on the machine at:

/var/log/gor_dumps

Traffic will needs to be replayed from each server using the command:

sudo GODEBUG="netdns=go" /usr/local/bin/gor --input-file "/var/log/gor_dump/*.log|1000%" --output-http http://localhost:3009 --output-http-timeout 30s

You can run the command with debug logging to get a better idea of progress using the below command:

sudo GODEBUG="netdns=go" /usr/local/bin/gor --input-file "/var/log/gor_dump/*.log|1000%" --output-http http://localhost:3009 --output-http-timeout 30s --verbose --debug

The above command replays the traffic at 10 times (1000%) the speed is was captured, this can be adjusted by changing the percentage value in the command.

This page is owned by #search-team and needs to be reviewed