vmalert

Rule: EtcdWalFsyncSlowok

Expr

etcd:ins:wal_fsync_rt_p95_5m > 0.050

For

60 seconds

Labels

category=etcd level=2 severity=INFO

Annotations

description:

etcd:ins:wal_fsync_rt_p95_5m[cls={{ $labels.cls }}, ins={{ $labels.ins }}] = {{ $value }} > 50ms http://g.pigsty/d/etcd-instance?from=now-10m&to=now&var-cls={{ $labels.cls }}

summary:

INFO EtcdWalFsyncSlow: {{ $labels.cls }} {{ $labels.ins }}

Debug

false

Group

16422350404351705521

Warning: some of updates have "Series fetched" equal to 0.
It might be that either this data is missing in the datasource or there is a typo in rule's expression. For example, foo{label="bar"} > 0 could never trigger because foo{label="bar"} metric doesn't exist.
Rule's expressions without time series selector, like expr: 42 or expr: time() aren't fetching time series from datasource, so they could have "Series fetched" equal to 0 and this won't be a problem.
See more details about this detection here.

Last 20/20 updates:

Updated at	Series fetched	Duration	Execution timestamp	cURL
2026-04-17T14:28:08+08:00	0	0.000s	2026-04-17T14:27:30+08:00	curl -X POST -H 'Content-Type: application/json' 'http://127.0.0.1:8428/api/v1/query?query=etcd%3Ains%3Awal_fsync_rt_p95_5m+%3E+0.050&step=300s&time=2026-04-17T14%3A27%3A30%2B08%3A00'
2026-04-17T14:27:58+08:00	0	0.001s	2026-04-17T14:27:20+08:00	curl -X POST -H 'Content-Type: application/json' 'http://127.0.0.1:8428/api/v1/query?query=etcd%3Ains%3Awal_fsync_rt_p95_5m+%3E+0.050&step=300s&time=2026-04-17T14%3A27%3A20%2B08%3A00'
2026-04-17T14:27:48+08:00	0	0.000s	2026-04-17T14:27:10+08:00	curl -X POST -H 'Content-Type: application/json' 'http://127.0.0.1:8428/api/v1/query?query=etcd%3Ains%3Awal_fsync_rt_p95_5m+%3E+0.050&step=300s&time=2026-04-17T14%3A27%3A10%2B08%3A00'
2026-04-17T14:27:38+08:00	0	0.000s	2026-04-17T14:27:00+08:00	curl -X POST -H 'Content-Type: application/json' 'http://127.0.0.1:8428/api/v1/query?query=etcd%3Ains%3Awal_fsync_rt_p95_5m+%3E+0.050&step=300s&time=2026-04-17T14%3A27%3A00%2B08%3A00'
2026-04-17T14:27:28+08:00	0	0.000s	2026-04-17T14:26:50+08:00	curl -X POST -H 'Content-Type: application/json' 'http://127.0.0.1:8428/api/v1/query?query=etcd%3Ains%3Awal_fsync_rt_p95_5m+%3E+0.050&step=300s&time=2026-04-17T14%3A26%3A50%2B08%3A00'
2026-04-17T14:27:18+08:00	0	0.000s	2026-04-17T14:26:40+08:00	curl -X POST -H 'Content-Type: application/json' 'http://127.0.0.1:8428/api/v1/query?query=etcd%3Ains%3Awal_fsync_rt_p95_5m+%3E+0.050&step=300s&time=2026-04-17T14%3A26%3A40%2B08%3A00'
2026-04-17T14:27:08+08:00	0	0.000s	2026-04-17T14:26:30+08:00	curl -X POST -H 'Content-Type: application/json' 'http://127.0.0.1:8428/api/v1/query?query=etcd%3Ains%3Awal_fsync_rt_p95_5m+%3E+0.050&step=300s&time=2026-04-17T14%3A26%3A30%2B08%3A00'
2026-04-17T14:26:58+08:00	0	0.000s	2026-04-17T14:26:20+08:00	curl -X POST -H 'Content-Type: application/json' 'http://127.0.0.1:8428/api/v1/query?query=etcd%3Ains%3Awal_fsync_rt_p95_5m+%3E+0.050&step=300s&time=2026-04-17T14%3A26%3A20%2B08%3A00'
2026-04-17T14:26:48+08:00	0	0.003s	2026-04-17T14:26:10+08:00	curl -X POST -H 'Content-Type: application/json' 'http://127.0.0.1:8428/api/v1/query?query=etcd%3Ains%3Awal_fsync_rt_p95_5m+%3E+0.050&step=300s&time=2026-04-17T14%3A26%3A10%2B08%3A00'
2026-04-17T14:26:38+08:00	0	0.000s	2026-04-17T14:26:00+08:00	curl -X POST -H 'Content-Type: application/json' 'http://127.0.0.1:8428/api/v1/query?query=etcd%3Ains%3Awal_fsync_rt_p95_5m+%3E+0.050&step=300s&time=2026-04-17T14%3A26%3A00%2B08%3A00'
2026-04-17T14:26:28+08:00	0	0.001s	2026-04-17T14:25:50+08:00	curl -X POST -H 'Content-Type: application/json' 'http://127.0.0.1:8428/api/v1/query?query=etcd%3Ains%3Awal_fsync_rt_p95_5m+%3E+0.050&step=300s&time=2026-04-17T14%3A25%3A50%2B08%3A00'
2026-04-17T14:26:18+08:00	0	0.000s	2026-04-17T14:25:40+08:00	curl -X POST -H 'Content-Type: application/json' 'http://127.0.0.1:8428/api/v1/query?query=etcd%3Ains%3Awal_fsync_rt_p95_5m+%3E+0.050&step=300s&time=2026-04-17T14%3A25%3A40%2B08%3A00'
2026-04-17T14:26:08+08:00	0	0.001s	2026-04-17T14:25:30+08:00	curl -X POST -H 'Content-Type: application/json' 'http://127.0.0.1:8428/api/v1/query?query=etcd%3Ains%3Awal_fsync_rt_p95_5m+%3E+0.050&step=300s&time=2026-04-17T14%3A25%3A30%2B08%3A00'
2026-04-17T14:25:58+08:00	0	0.000s	2026-04-17T14:25:20+08:00	curl -X POST -H 'Content-Type: application/json' 'http://127.0.0.1:8428/api/v1/query?query=etcd%3Ains%3Awal_fsync_rt_p95_5m+%3E+0.050&step=300s&time=2026-04-17T14%3A25%3A20%2B08%3A00'
2026-04-17T14:25:48+08:00	1	0.000s	2026-04-17T14:25:10+08:00	curl -X POST -H 'Content-Type: application/json' 'http://127.0.0.1:8428/api/v1/query?query=etcd%3Ains%3Awal_fsync_rt_p95_5m+%3E+0.050&step=300s&time=2026-04-17T14%3A25%3A10%2B08%3A00'
2026-04-17T14:25:38+08:00	1	0.000s	2026-04-17T14:25:00+08:00	curl -X POST -H 'Content-Type: application/json' 'http://127.0.0.1:8428/api/v1/query?query=etcd%3Ains%3Awal_fsync_rt_p95_5m+%3E+0.050&step=300s&time=2026-04-17T14%3A25%3A00%2B08%3A00'
2026-04-17T14:25:28+08:00	1	0.000s	2026-04-17T14:24:50+08:00	curl -X POST -H 'Content-Type: application/json' 'http://127.0.0.1:8428/api/v1/query?query=etcd%3Ains%3Awal_fsync_rt_p95_5m+%3E+0.050&step=300s&time=2026-04-17T14%3A24%3A50%2B08%3A00'
2026-04-17T14:25:18+08:00	1	0.000s	2026-04-17T14:24:40+08:00	curl -X POST -H 'Content-Type: application/json' 'http://127.0.0.1:8428/api/v1/query?query=etcd%3Ains%3Awal_fsync_rt_p95_5m+%3E+0.050&step=300s&time=2026-04-17T14%3A24%3A40%2B08%3A00'
2026-04-17T14:25:08+08:00	1	0.000s	2026-04-17T14:24:30+08:00	curl -X POST -H 'Content-Type: application/json' 'http://127.0.0.1:8428/api/v1/query?query=etcd%3Ains%3Awal_fsync_rt_p95_5m+%3E+0.050&step=300s&time=2026-04-17T14%3A24%3A30%2B08%3A00'
2026-04-17T14:24:58+08:00	1	0.000s	2026-04-17T14:24:20+08:00	curl -X POST -H 'Content-Type: application/json' 'http://127.0.0.1:8428/api/v1/query?query=etcd%3Ains%3Awal_fsync_rt_p95_5m+%3E+0.050&step=300s&time=2026-04-17T14%3A24%3A20%2B08%3A00'