Skip to content

Commit 696ae89

Browse files
authored
Release notes soda-agent 1.1.21 soda-library 1.5.20 (#839)
1 parent 63017c1 commit 696ae89

7 files changed

+47
-2
lines changed

_includes/single-quotes.md

+3
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
**Problem:** Using an `invalid_count` check, the list of `valid_values` includes a value with a single quote, such as `Tuesday's orders`. During scanning, he check results in and error because it does not recognize the special character.
2+
3+
**Solution:** When using single-quoted strings, any single quote `'` inside its contents must be doubled to escape it. For example, `Tuesday''s orders`.

_release-notes/soda-agent-1.1.21.md

+10
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,10 @@
1+
---
2+
name: "1.1.21"
3+
date: 2024-07-24
4+
products:
5+
- soda-agent
6+
---
7+
## 1.1.21
8+
9+
This release maps to [Soda Library 1.5.19]({% link release-notes/soda-library.md %}). <br />
10+
Access [Soda documentation]({% link soda/upgrade.md %}#upgrade-a-soda-agent) for instructions to upgrade a Soda Agent helm chart to use the latest version of Soda Library.

_release-notes/soda-library-1.5.20.md

+10
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,10 @@
1+
---
2+
name: "1.5.20"
3+
date: 2024-07-24
4+
products:
5+
- soda-library
6+
---
7+
8+
## 1.5.20 Fixes
9+
10+
* Fix: make sure labelling incorrect anomalies always returns something by @bastienboutonnet in #265

soda-cl/troubleshoot.md

+6-1
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,8 @@ parent: SodaCL reference
2020
[Failed row check with CTE error](#failed-row-check-with-cte-error)<br />
2121
[Errors with column names containing periods or colons](#errors-when-column-names-containing-periods-or-colons)<br />
2222
[Errors when using in-check filters](#errors-when-using-in-check-filters)<br />
23-
[Using reference checks with Spark DataFrames](#using-reference-checks-with-spark-dataframes)
23+
[Using reference checks with Spark DataFrames](#using-reference-checks-with-spark-dataframes)<br />
24+
[Single quotes in valid values list result in error](#single-quotes-in-valid-values-list-result-in-error)<br />
2425
<br />
2526

2627
<hr/>
@@ -236,6 +237,10 @@ checks for my_dataset:
236237
{% include reference-with-spark.md %}
237238

238239

240+
## Single quotes in valid values list result in error
241+
242+
{% include single-quotes.md %}
243+
239244

240245
## Go further
241246

soda-cl/validity-metrics.md

+6-1
Original file line numberDiff line numberDiff line change
@@ -52,6 +52,7 @@ checks for dim_customer:
5252
[Define checks with validity metrics](#define-checks-with-validity-metrics) <br />
5353
&nbsp;&nbsp;&nbsp;&nbsp;[Specify valid or invalid values](#specify-valid-or-invalid-values)<br />
5454
&nbsp;&nbsp;&nbsp;&nbsp;[Specify valid format](#specify-valid-format)<br />
55+
&nbsp;&nbsp;&nbsp;&nbsp;[Troubleshoot valid format and values](#troubleshoot-valid-format-and-values)<br />
5556
&nbsp;&nbsp;&nbsp;&nbsp;[Failed row samples](#failed-row-samples)<br />
5657
[Optional check configurations](#optional-check-configurations)<br />
5758
[List of validity metrics](#list-of-validity-metrics)<br />
@@ -193,7 +194,7 @@ checks for dim_customer:
193194

194195
<br />
195196

196-
#### Troubleshoot valid format
197+
### Troubleshoot valid format and values
197198

198199
**Problem:** You are using a `valid format` to test the format of values in a column and the CLI returns the following error message when you run a scan.
199200

@@ -209,6 +210,10 @@ Error occurred while executing scan.
209210

210211
<br />
211212

213+
{% include single-quotes.md %}
214+
215+
<br />
216+
212217
### Failed row samples
213218

214219
Checks with validity metrics automatically collect samples of any failed rows to display Soda Cloud. The default number of failed row samples that Soda collects and displays is 100.

soda/connect-troubleshoot.md

+9
Original file line numberDiff line numberDiff line change
@@ -11,6 +11,7 @@ Last modified on {% last_modified_at %}
1111
[SSL certificate error](#ssl-certificate-error)<br />
1212
[Snowflake proxy connection error](#go-further)<br />
1313
[Spark DataFrame object error](#spark-dataframe-object-error)<br />
14+
[ImportError during programmatic scan](#importerror-during-programmatic-scan)<br />
1415
[Go further](#go-further)<br />
1516
<br />
1617

@@ -32,6 +33,14 @@ Last modified on {% last_modified_at %}
3233

3334
**Solution:** Be sure to upgrade your version of PySpark to 3.4.0 or greater for compatibility with Soda packages.
3435

36+
## ImportError during programmatic scan
37+
38+
**Problem:** When importing Soda scan, you get an error that reads, `ImportError: cannot import name 'field_validator' from 'pydantic'...`.
39+
40+
**Solution:** This error typically emerges when your environment is using pydantic v1 instead of v2. Soda requires pydantic v2 to work and this is correctly set via installation requirements in the package, however Python allows you to override those requirements. Use `pip list | grep "pydantic"` to determine which version you are using and upgrade as necessary.
41+
42+
<br />
43+
3544
## Go further
3645

3746
* Access [Troubleshoot SodaCL]({% link soda-cl/troubleshoot.md %}) for help resolving issues running scans with SodaCL.

soda/new-documentation.md

+3
Original file line numberDiff line numberDiff line change
@@ -9,6 +9,9 @@ parent: Learning resources
99

1010
<br />
1111

12+
#### July 24, 2024
13+
* Added [release notes]({% link release-notes/all.md %}) documentation for Soda Library 1.5.20 and Soda Agent 1.1.21.
14+
1215
#### July 23, 2024
1316
* Added [release notes]({% link release-notes/all.md %}) documentation for Soda Library 1.5.19.
1417

0 commit comments

Comments
 (0)