Once you install the StackLight LMA components as described in Install the StackLight LMA components, verify that all components have been successfully deployed and all services are up and running.
To verify the StackLight LMA components:
Log in to the Salt Master node.
Verify that all the monitoring services running in Docker Swarm have their expected number of replicas:
salt -C 'I@docker:client:stack:monitoring' cmd.run 'docker service ls'
Example:
root@sup01:~# docker service ls
ID NAME MODE REPLICAS IMAGE
j0hrlth0agyx monitoring_server replicated 1/1 prometheus:latest
pqeqda711a69 dashboard_grafana replicated 1/1 grafana/grafana:latest
xrdmspdexojs monitoring_pushgateway replicated 2/2 pushgateway:latest
xztynkgfo1pu monitoring_alertmanager replicated 2/2 alertmanager:latest
i2xc7j9ei81k monitoring_remote_agent replicated 1/1 telegraf:latest
Verify the status of the containers:
salt -C 'I@docker:swarm:role:master and I@prometheus:server' cmd.run \
'docker service ps $(docker stack services -q monitoring)'
Inspect the monitoring containers logs for any unusual entries:
salt -C 'I@docker:swarm:role:master and I@prometheus:server' cmd.run \
'for i in $(docker stack services -q monitoring); do docker service logs --tail 10 $i; done'
Verify that the Fluentd service is running:
salt -C 'I@fluentd:agent' service.status td-agent
Verify Prometheus Relay:
salt -C 'I@prometheus:relay' service.status prometheus-relay
If deployed, verify Prometheus long-term storage:
salt -C 'I@prometheus:relay' service.status prometheus
Verify the Prometheus web UI:
Connect to the Prometheus web UI as described in the corresponding section of the MCP Operations Guide.
From the Status drop-down list, select Targets.
Verify that all targets are in the UP state.
Click the Alerts tab.
Verify that no alerts are active.
Verify the Alertmanager web UI:
Connect to the Alertmanager web UI as described in Use the Alertmanager web UI.
Click Alerts.
Verify that no alerts are active.
Verify the Grafana dashboards:
Enter the prx
VIP on port 3000 by default.
Authenticate using your credentials as described in Connect to Grafana. You should be redirected to the Grafana Home page with a list of available dashboards sorted by name.
Verify that all nodes are listed in the System dashboard.
Verify the Kibana dashboards by connecting to Kibana as described in the Connect to Kibana.