Etcd

This section describes the alerts for the etcd service.


etcdInsufficientMembers

Severity

Critical

Summary

Etcd cluster has insufficient members.

Description

The {{ $labels.job }} etcd cluster has {{ $value }} insufficient members.

etcdNoLeader

Severity

Critical

Summary

Etcd cluster has no leader.

Description

The {{ $labels.node }} member of the {{ $labels.job }} etcd cluster has no leader.

etcdHighNumberOfLeaderChanges

Severity

Warning

Summary

Etcd cluster has detected more than 3 leader changes within the last hour.

Description

The {{ $labels.node }} node of the {{ $labels.job }} etcd cluster has {{ $value }} leader changes within the last hour.

etcdHighNumberOfFailedProposals

Severity

Warning

Summary

Etcd cluster has more than 5 proposal failures.

Description

The {{ $labels.job }} etcd cluster has {{ $value }} proposal failures on the {{ $labels.node }} etcd node within the last hour.

etcdTargetsOutage

Severity

Critical

Summary

Etcd cluster Prometheus targets outage.

Description

Prometheus fails to scrape metrics from 2/3 of etcd nodes (more than 1/10 failed scrapes).