You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: observability/observability.md
+37-2
Original file line number
Diff line number
Diff line change
@@ -11,6 +11,41 @@ nav_order: 500
11
11
12
12
{% include banner-upgrade.md %}
13
13
14
-
OBSERVABILITY INTRO GOES HERE
14
+
Use observability to monitor data quality at scale across all your datasets.
15
+
Observability helps you catch unexpected issues without needing to define every rule up front.
15
16
16
-
## What is Observability?
17
+
Where data testing focuses on known expectations, observability helps you detect the unknown unknowns—like late-arriving records, schema changes, or sudden spikes in missing values. It offers broad, low-effort coverage and requires little configuration, making it easy to share data quality responsibilities across technical and non-technical teams.
18
+
19
+
## What is data observability?
20
+
21
+
**Data observability** is the practice of continuously monitoring your data for unexpected changes, anomalies, and structural issues. It involves collecting and analyzing metrics about your datasets to understand their health over time.
22
+
23
+
Instead of writing checks manually for each dataset, observability uses profiling and metrics to automatically detect problems such as:
24
+
- A spike in null values
25
+
- A drop in row counts
26
+
- Unusual value distributions
27
+
28
+
**Data Observability helps you:**
29
+
- Detect incidents faster
30
+
- Scale coverage across more data
31
+
- Reduce time spent on manual testing
32
+
- Empower more team members to spot and act on issues
33
+
34
+
35
+
## What is metrics monitoring?
36
+
37
+
**Metrics monitoring** is the foundation of data observability in Soda. Soda collects metrics from datasets—such as row count, null values, min/max, and value distribution—and tracks how those metrics evolve over time.
38
+
39
+
Soda then uses built-in anomaly detection to identify when metrics deviate from expected patterns. These deviations are surfaced in the **Metric Monitors** tab for each dataset.
40
+
41
+
You can use metric monitoring to:
42
+
- Spot problems without writing checks
43
+
- Establish baselines for normal behavior
44
+
- Alert data owners when something unusual happens
45
+
- Provide insight to business users without requiring code
46
+
47
+
## What's Next?
48
+
To get started with Soda observability, follow one of these guides:
49
+
50
+
-[Data observability quickstart]({% link observability/quickstart.md %}): Set up monitoring to detect anomalies in your datasets.
51
+
-[Data observability guide]({% link observability/observability-guide.md %}): Learn how to get the most out of Soda’s data observability platform.
0 commit comments