We frequently get people asking us for some best practice advice. Today I came across a Google article that is well written and gives some great advice on setting up monitoring. It’s available at:
https://landing.google.com/sre/sre-book/chapters/monitoring-distributed-systems/