Is your feature request related to a problem? Please describe.

Currently only Spark 3.5 is supported for the Spark Client, we use the Spark client to write data in the Delta format, but we need to use Spark 4 in order to write queries like SELECT * EXCEPT(...) via the thrift server, as this is not being parsed correctly in earlier versions.

Describe the solution you'd like

A version of the client jar built for Spark 4

Describe alternatives you've considered

No response

Additional context

No response