Why “Up” Is One of the Weakest Signals in Production
A production-engineering deep dive into why “up” is one of the weakest signals in production, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
observability
Waiting Sessions Tell Me More Than CPU During Database Contention
A production-engineering deep dive into waiting sessions tell me more than cpu during database contention, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
A Network Map Should Show Boundaries Before Services
Topology is most useful when it explains packet movement across gateways, hosts, overlays and ingress first.
ArgoCD Green Does Not Mean Voiceware Is Healthy
The difference between desired-state convergence and application correctness.
The Device Is the Source of Truth for a Firmware Release
A new firmware image being uploaded to the server tells us the state of the server. The image actually running on a device is a different claim. A successful deploy command cannot prove the second one by itself.
The Minimum Telemetry I Want Around a Voiceware-Like Stack
A practical monitoring baseline derived from the workload types in the deployment graph.
Why My Monitoring System Needed Monitoring Too
A production-engineering deep dive into why my monitoring system needed monitoring too, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
Redis Eviction Means Policy Is Already Affecting Data
A production-engineering deep dive into redis eviction means policy is already affecting data, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
The Monitoring Stack Needs a Memory Budget Too
Observability was becoming one of the larger workloads on a small production server, which is dangerous when monitoring competes with the services it protects.
Observability Became Useful When Every Graph Had an Operational Question
Dashboards improved once I stopped collecting attractive metrics and started collecting evidence for specific failure modes.
One PostgreSQL Deadlock Is Worth Recording
A production-engineering deep dive into one postgresql deadlock is worth recording, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
Redis Fragmentation Can Look Like a Memory Leak
A production-engineering deep dive into redis fragmentation can look like a memory leak, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
Which Identity Should Follow a Call Through the System?
A phone call that crosses several servers leaves pieces of its story in several places. Endpoint logs, PBX logs, and trunk logs may all describe it differently. Time proximity alone is not enough to prove that two log entries belong to the same call.
Ask the Operational Question Before Building the Dashboard
Adding a graph is easy; deciding what action that graph should support is harder. A dashboard can contain every metric and still leave an operator unsure where to begin during an incident.
PostgreSQL Connection Utilization Needs a Denominator
A production-engineering deep dive into postgresql connection utilization needs a denominator, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
UNKNOWN Is Better Than a False FAIL When Metadata Is Restricted
A posture check should distinguish evidence it cannot read from evidence that proves the system is wrong.
What Production-Grade Means on Decade-Old Hardware
A production-engineering deep dive into what production-grade means on decade-old hardware, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
A Clean Checkout Is the Real Test of Infrastructure Reproducibility
Live files that are absent from Git are technical debt even when the service is currently healthy.
Metrics, Logs, Probes and State Checks Answer Different Questions
A production-engineering deep dive into metrics, logs, probes and state checks answer different questions, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
Why Filebeat Was Treated as a First-Class Voiceware Component
Making log shipping visible in the deployment model rather than treating logs as an afterthought.
The cAdvisor Disk Scanner Was More Expensive Than the Data Was Worth
The production monitoring stack measured roughly 428 MiB of cAdvisor memory with filesystem disk collection enabled on a small host.
Why Every Monitoring Component Had to Justify Its RAM
A production-engineering deep dive into why every monitoring component had to justify its ram, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
The Server Cannot Report Its Own Death
A production-engineering deep dive into the server cannot report its own death, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
The Observability Tax on a 7.1 GiB Linux Server
A production-engineering deep dive into the observability tax on a 7.1 gib linux server, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
Who Monitors the Monitoring System?
If monitoring stops, evidence of failures elsewhere can disappear too. Silence can then look like health. The monitoring system therefore needs evidence that its own collection and notification paths are still working.
Buffer Hits, Disk Reads and the Shape of PostgreSQL Cache Pressure
A production-engineering deep dive into buffer hits, disk reads and the shape of postgresql cache pressure, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
Observability Needs a Source of Truth and an Acceptance Artifact
A monitoring stack can drift through dashboard edits, local files and runtime tuning until nobody knows whether Git can reproduce what is currently trusted in production.
Audio Workloads Need Different Operational Questions
The checks I would apply to a voice-processing service beyond ordinary HTTP availability.
One Machine, Many Failure Domains: Mapping the 2014 Mac mini
A production-engineering deep dive into one machine, many failure domains: mapping the 2014 mac mini, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
A Successful TCP Connection Does Not Mean the Database Is Healthy
A production-engineering deep dive into a successful tcp connection does not mean the database is healthy, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
Temporary I/O Is a Query-Behavior Signal
A production-engineering deep dive into temporary i/o is a query-behavior signal, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
Desired State, Observed State and User-Visible State Are Three Different Things
A production-engineering deep dive into desired state, observed state and user-visible state are three different things, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
Observability Is Part of Delivery Definition
A feature is harder to operate safely when the team cannot tell whether it is healthy after release.
Monitoring Is a Failure-Modeling Problem, Not a Dashboard Problem
A production-engineering deep dive into monitoring is a failure-modeling problem, not a dashboard problem, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
Four Database Engines on One Small Server: Observability Without Exporter Sprawl
A production-engineering deep dive into four database engines on one small server: observability without exporter sprawl, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.
MySQL Slow Queries Belong in Infrastructure Monitoring
A production-engineering deep dive into mysql slow queries belong in infrastructure monitoring, grounded in the 2014 Mac mini hserver observability stack and its accepted runtime evidence.