Skip to content

Commit 625abca

Browse files
committed
[SPARK-31858][BUILD] Upgrade commons-io to 2.5 in Hadoop 3.2 profile
### What changes were proposed in this pull request? This PR aims to upgrade `commons-io` from 2.4 to 2.5 for Apache Spark 3.1. ### Why are the changes needed? Since Hadoop 3.1, `commons-io` 2.5 is used. - https://issues.apache.org/jira/browse/HADOOP-15261 ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass the Jenkins with Hadoop-3.2 profile. Maven dependency is verified via `test-dependencies.sh` automatically. SBT dependency can be verified like the following manually. ``` build/sbt -Phadoop-3.2 "core/dependencyTree" | grep commons-io:commons-io | head -n1 [info] | | +-commons-io:commons-io:2.5 ``` Closes apache#28665 from dongjoon-hyun/SPARK-31858. Authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
1 parent fe1d1e2 commit 625abca

File tree

3 files changed

+2
-2
lines changed

3 files changed

+2
-2
lines changed

dev/deps/spark-deps-hadoop-3.2-hive-2.3

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -37,7 +37,7 @@ commons-crypto/1.0.0//commons-crypto-1.0.0.jar
3737
commons-daemon/1.0.13//commons-daemon-1.0.13.jar
3838
commons-dbcp/1.4//commons-dbcp-1.4.jar
3939
commons-httpclient/3.1//commons-httpclient-3.1.jar
40-
commons-io/2.4//commons-io-2.4.jar
40+
commons-io/2.5//commons-io-2.5.jar
4141
commons-lang/2.6//commons-lang-2.6.jar
4242
commons-lang3/3.9//commons-lang3-3.9.jar
4343
commons-logging/1.1.3//commons-logging-1.1.3.jar

pom.xml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3041,6 +3041,7 @@
30413041
<properties>
30423042
<hadoop.version>3.2.0</hadoop.version>
30433043
<curator.version>2.13.0</curator.version>
3044+
<commons-io.version>2.5</commons-io.version>
30443045
</properties>
30453046
</profile>
30463047

project/SparkBuild.scala

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -623,7 +623,6 @@ object KubernetesIntegrationTests {
623623
object DependencyOverrides {
624624
lazy val settings = Seq(
625625
dependencyOverrides += "com.google.guava" % "guava" % "14.0.1",
626-
dependencyOverrides += "commons-io" % "commons-io" % "2.4",
627626
dependencyOverrides += "xerces" % "xercesImpl" % "2.12.0",
628627
dependencyOverrides += "jline" % "jline" % "2.14.6",
629628
dependencyOverrides += "org.apache.avro" % "avro" % "1.8.2")

0 commit comments

Comments
 (0)