Skip to main content

> Term

metric quality

The degree of accuracy, consistency, and reliability of a business or technical metric used for reporting.

Detailed Explanation

Metric quality ensures that when a dashboard displays 'Active Users' or 'Revenue', the underlying data is fresh, correct, and aggregated using an agreed-upon definition.

Low metric quality leads to eroded trust in data teams. If the sales dashboard and the marketing dashboard show vastly different numbers for the same metric, the metric quality is fundamentally compromised.

Why It Matters

Leadership makes multi-million dollar decisions based on these numbers; if the metrics are garbage, the decisions will be too.

Common Failure Mode

The 'Daily Revenue' metric accidentally includes test stripe transactions because the data filter logic was silently broken in an upstream ETL job.

Practical Example

Implementing a dbt test to ensure metric quality on an order table.

Production Manifestation

Automated data quality tests in dbt (e.g., checking for nulls or anomalies), anomaly detection alerts, and centralized metric layers.

Frequently Asked Questions

What is metric quality in short?

The degree of accuracy, consistency, and reliability of a business or technical metric used for reporting.

What is the most common failure mode?

The 'Daily Revenue' metric accidentally includes test stripe transactions because the data filter logic was silently broken in an upstream ETL job.

AI Summary

The degree of accuracy, consistency, and reliability of a business or technical metric used for reporting. Leadership makes multi-million dollar decisions based on these numbers; if the metrics are garbage, the decisions will be too.