Skip to content

[AutoSparkUT] Add GPU test coverage for DataFrameTimeWindowingSuite (TimeWindow expression) #14661

@wjxiz1992

Description

@wjxiz1992

Coverage gap

Apache Spark 3.3.0 ships a 22-test DataFrameTimeWindowingSuite under spark/sql/core/src/test/scala/org/apache/spark/sql/DataFrameTimeWindowingSuite.scala that exercises the TimeWindow expression:

  • Tumbling and sliding time windows with various durations (second / millisecond / minute)
  • Time window SQL syntax with 1/2/3 string/duration expressions
  • Window slide alignment (no filter when windowDuration is a multiple of slideDuration)
  • Handling of negative start times
  • TimestampNTZ type support (SPARK-36091)
  • Nullability of window start / end fields (SPARK-38227)
  • Window column projection, grouping, and aggregation

None of these behaviors are currently exercised against the RAPIDS GPU path in tests/src/test/spark330/scala/org/apache/spark/sql/rapids/suites/. The existing RapidsTimeWindowSuite in RAPIDS only covers expression-level evaluation (via ExpressionEvalHelper), not the end-to-end DataFrame / SQL flow.

Intended test scope

Add RapidsDataFrameTimeWindowingSuite extends DataFrameTimeWindowingSuite with RapidsSQLTestsTrait, register it in RapidsTestSettings.

Expected outcome

All 22 tests pass on the GPU path (confirmed locally; see PR). No exclusions required.

Metadata

Metadata

Assignees

No one assigned

    Labels

    ? - Needs TriageNeed team to review and classifytestOnly impacts tests

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions