Observability & Monitoring · 35 min read · 2025-08-03
A production-engineering deep dive into recording rules are a cpu trade: compute once or query repeatedly, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
Observability & Monitoring · 36 min read · 2025-06-14
A production-engineering deep dive into why every target should not be scraped every 15 seconds, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
Observability · 1 min read · 2025-03-04
Labels make dashboards flexible, but uncontrolled label values multiply time series and memory cost quickly.
Observability & Monitoring · 35 min read · 2025-02-09
A production-engineering deep dive into 30-day retention and a 15 gb cap were capacity decisions, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
Observability & Monitoring · 1 min read · 2024-01-22
The hserver stack carried roughly twenty-seven thousand active Prometheus series, enough that label growth and exporter changes could materially change memory and storage cost.
Observability & Monitoring · 35 min read · 2023-05-04
A production-engineering deep dive into rule evaluation failures mean monitoring logic is broken, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
Observability & Monitoring · 34 min read · 2023-02-17
A production-engineering deep dive into prometheus is my metrics control plane, not just a scraper, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
Observability & Monitoring · 36 min read · 2023-02-09
A production-engineering deep dive into 27.5k active series on a small server: what that number actually means, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
Observability & Monitoring · 1 min read · 2023-01-12
Security logs contain useful source addresses, but promoting every IP to a Prometheus or Loki index label would create unbounded cardinality on an Internet-facing service.
Observability & Monitoring · 36 min read · 2022-03-15
A production-engineering deep dive into wal, head block and why prometheus memory does not equal stored data, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
Observability & Monitoring · 35 min read · 2021-03-19
A production-engineering deep dive into cardinality is usually a schema problem, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
Observability & Monitoring · 34 min read · 2021-01-28
A production-engineering deep dive into metric relabeling is resource control, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
Observability & Monitoring · 1 min read · 2020-10-31
Grafana, Loki and Alloy expose many internal metrics that are useful for development but unnecessary on a small production Prometheus.
Observability & Monitoring · 36 min read · 2020-10-06
A production-engineering deep dive into how much prometheus is too much for an 8 gb machine?, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.