Describe the bug
spark-shell smoke test failed: expected result line missing; Master WARN for unknown executor (local-cluster)
The spark-shell smoke test (SPARK_SHELL_SMOKE_TEST=1) failed because the process output did not contain the expected res0 line.
spark-shell --master 'local-cluster[1,2,1024]' --conf spark.plugins=com.nvidia.spark.SQLPlugin
--conf spark.deploy.maxExecutorRetries=0 --conf spark.shuffle.manager=com.nvidia.spark.rapids.spark350.RapidsShuffleManager
--driver-class-path xxx
+ grep -F 'res0: Array[org.apache.spark.sql.Row] = Array([4950])'
Warning: Permanently added '[20.168.121.39]:2200' (ED25519) to the list of known hosts.
Environment (from logs)
First observed on Databricks runtime 13.3/14.3./17.3
Describe the bug
spark-shell smoke test failed: expected result line missing; Master WARN for unknown executor (local-cluster)
The spark-shell smoke test (SPARK_SHELL_SMOKE_TEST=1) failed because the process output did not contain the expected res0 line.
Environment (from logs)
First observed on Databricks runtime 13.3/14.3./17.3