Skip to content

Conversation

@kik-kik
Copy link
Contributor

@kik-kik kik-kik commented Oct 15, 2025

fix: add missing partition filter in the query

Without this filter the ETL task fails due to the result set containing data for partitions other than the specific partition it tries to write to.

@kik-kik kik-kik self-assigned this Oct 15, 2025
@kik-kik kik-kik added the bug Something isn't working label Oct 15, 2025
@dataops-ci-bot
Copy link

Integration report for "fix: add missing partition filter to fix ETL error with result set containing entries for different partitions"

sql.diff

Click to expand!
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/firefox_desktop_derived/enterprise_metrics_v1/query.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/firefox_desktop_derived/enterprise_metrics_v1/query.sql
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/firefox_desktop_derived/enterprise_metrics_v1/query.sql	2025-10-15 13:06:25.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/firefox_desktop_derived/enterprise_metrics_v1/query.sql	2025-10-15 13:03:28.000000000 +0000
@@ -6,5 +6,7 @@
   COUNT(*) AS client_count,
 FROM
   `moz-fx-data-shared-prod.firefox_desktop.enterprise_metrics_clients`
+WHERE
+  submission_date = @submission_date
 GROUP BY
   ALL

Link to full diff

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants