Hserver Monitoring: Backup & DR · advanced

Restore Verification Needs Its Own Age

A restore drill that passed months ago does not prove that today's schema, credentials and backup format can still be recovered.

Current. Current production-engineering note derived from the hserver observability deployment, runtime measurements, alert rules, dashboards, and recovery work in September 2026.

A restore drill that passed months ago does not prove that today's schema, credentials and backup format can still be recovered. The monitoring mistake would be to read one metric in isolation. hserver_restore_verify_success and last-success timestamp is useful because it narrows the question, and recovery evidence decays as production changes, so the monitoring system needs to know both the last result and how old that result is.

In software operations this falls under evidence-freshness monitoring. A dashboard becomes much more valuable when the operator knows what a rising line can prove, what it cannot prove, and which second signal should confirm the hypothesis.

My prevention rule is: Set a restore-verification cadence, alert when evidence becomes stale, and rerun after major state-format or deployment changes. That keeps false positives lower without weakening visibility into real degradation.

The hserver source evidence is b65d5d4. Keeping that provenance matters because monitoring logic changes over time; the article should remain connected to the exact engineering decision it describes.

Quick navigationEsc