Router error ratio too high
You can find the router request error rates on this dashboard:
You can also view the 500+503 error rates across all applications on this dashboard:
This alert will fire when the ratio of requests in an error state are above the threshold of 1 in 10. The configuration of the alert can be found here
Router deals with requests to the rails applications which means that both publishers and/or end users could be seeing errors depending on which application is returning errors. Use this dashboard to check which applications have been erroring recently then look in Kibana for more detailed look into the specific log messages.
Potential resolution steps
- If an application has been recently updated and is returning errors it may require a rollback using the app’s deploy github action
- If your application is currently dealing with a sudden increase in load it could be that you need to scale your application. You can check the following documentation in order to do this.