Add Spark 4.0.3 shim support#15151
Conversation
Signed-off-by: Firestarman <firestarmanllc@gmail.com>
|
Too many files changed for review. ( |
|
build |
Signed-off-by: Firestarman <firestarmanllc@gmail.com>
|
build |
Signed-off-by: Firestarman <firestarmanllc@gmail.com>
|
build |
|
The Spark 4.0.3 shim metadata is missing from seven shared Scala test suites: |
|
|
Signed-off-by: Firestarman <firestarmanllc@gmail.com>
|
Addressed the latest review feedback in
Validation: |
|
build |
Fixes #15065.
Description
docs/download.mdso the published support matrix lists Apache Spark 4.0.3 and the Scala 2.13 Spark 4.0.3 support line.SPARK_HOME=/bigdata/work/tools/spark-4.0.3-bin-hadoop3 mvn -B -s /home/liangcail/.m2/settings_art.xml -f scala2.13/pom.xml -Dbuildver=403 -Dcuda.version=cuda13 verify: BUILD SUCCESS; integration tests reported 35271 passed, 2058 skipped, 513 xfailed, 895 xpassed; Scala tests reported 1759 succeeded, 0 failed.SPARK_HOME=/bigdata/work/tools/spark-4.0.3-bin-hadoop3 mvn -B -s /home/liangcail/.m2/settings_art.xml -f scala2.13/pom.xml -Dbuildver=403 -Dcuda.version=cuda13 -Dmaven.scalastyle.skip=true -Drat.skip=true -DskipTests -Dmaven.scaladoc.skip=true -pl tests -am package: BUILD SUCCESS./bigdata/tpcds_data/parquet_100frapids-4-spark_2.13-26.08.0-SNAPSHOT-cuda13-403-perf.jar/bigdata/work/tools/spark-4.0.2-bin-hadoop3/bigdata/work/tools/spark-4.0.3-bin-hadoop3Checklists
Documentation
Testing
(Please provide the names of the existing tests in the PR description.)
Performance