Coverage gap
Apache Spark 3.3.0 ships a 22-test DataFrameTimeWindowingSuite under spark/sql/core/src/test/scala/org/apache/spark/sql/DataFrameTimeWindowingSuite.scala that exercises the TimeWindow expression:
- Tumbling and sliding time windows with various durations (second / millisecond / minute)
- Time window SQL syntax with 1/2/3 string/duration expressions
- Window slide alignment (no filter when
windowDuration is a multiple of slideDuration)
- Handling of negative start times
TimestampNTZ type support (SPARK-36091)
- Nullability of window
start / end fields (SPARK-38227)
- Window column projection, grouping, and aggregation
None of these behaviors are currently exercised against the RAPIDS GPU path in tests/src/test/spark330/scala/org/apache/spark/sql/rapids/suites/. The existing RapidsTimeWindowSuite in RAPIDS only covers expression-level evaluation (via ExpressionEvalHelper), not the end-to-end DataFrame / SQL flow.
Intended test scope
Add RapidsDataFrameTimeWindowingSuite extends DataFrameTimeWindowingSuite with RapidsSQLTestsTrait, register it in RapidsTestSettings.
Expected outcome
All 22 tests pass on the GPU path (confirmed locally; see PR). No exclusions required.
Coverage gap
Apache Spark 3.3.0 ships a 22-test
DataFrameTimeWindowingSuiteunderspark/sql/core/src/test/scala/org/apache/spark/sql/DataFrameTimeWindowingSuite.scalathat exercises theTimeWindowexpression:windowDurationis a multiple ofslideDuration)TimestampNTZtype support (SPARK-36091)start/endfields (SPARK-38227)None of these behaviors are currently exercised against the RAPIDS GPU path in
tests/src/test/spark330/scala/org/apache/spark/sql/rapids/suites/. The existingRapidsTimeWindowSuitein RAPIDS only covers expression-level evaluation (viaExpressionEvalHelper), not the end-to-end DataFrame / SQL flow.Intended test scope
Add
RapidsDataFrameTimeWindowingSuite extends DataFrameTimeWindowingSuite with RapidsSQLTestsTrait, register it inRapidsTestSettings.Expected outcome
All 22 tests pass on the GPU path (confirmed locally; see PR). No exclusions required.