Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Do not merge] Update slf4j version #33574

Open
wants to merge 15 commits into
base: master
Choose a base branch
from

Conversation

shunping
Copy link
Contributor

@shunping shunping commented Jan 13, 2025

Upgrade slf4j from 1.7.30 to 2.0.16

@github-actions github-actions bot added the build label Jan 13, 2025
The class path of slf4j has been changed from org/slf4j/impl
to org/slf4j/jul.

Two failed tests:
- :runners:google-cloud-dataflow-java:worker:validateShadedJarContainsSlf4jJdk14
- :runners:google-cloud-dataflow-java:worker:validateShadedJarDoesntLeakNonProjectClasses
The failed tests  are under
org.apache.beam.runners.dataflow.worker.HotKeyLoggerTest
The previous version has a compile dependency on slf4j 1.x binding, which would no longer
work with slf4j 2.x.
@github-actions github-actions bot added the spark label Feb 4, 2025
@Abacn
Copy link
Contributor

Abacn commented Feb 4, 2025

triggered a performance test: https://github.com/apache/beam/actions/runs/13145020125

@shunping shunping marked this pull request as ready for review February 5, 2025 05:52
@shunping
Copy link
Contributor Author

shunping commented Feb 5, 2025

r: @Abacn

Copy link
Contributor

github-actions bot commented Feb 5, 2025

Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment assign set of reviewers

Copy link
Contributor

@Abacn Abacn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! Had a few comments.

when it is ready to merge good to announce it in CHANGES.md

@@ -250,6 +250,14 @@ project.task('validateShadedJarContainsSlf4jJdk14', dependsOn: 'shadowJar') {
}
}

project.tasks.withType(Test).configureEach {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why are they needed? tests currently using Java11 should be fine as https://openjdk.org/jeps/403 is enforced in Java16+ only.

Did you run tests on Java 17+ locally? If so did the test experience similar issue on master branch?

Copy link
Contributor Author

@shunping shunping Feb 5, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I just took them out and triggered the tests again on github. Will see.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like the test is fine. However, still good to confirm

Did you run tests on Java 17+ locally? If so did the test experience similar issue on master branch?

@@ -43,8 +43,8 @@ dependencies {
implementation library.java.commons_lang3
implementation library.java.joda_time
implementation library.java.slf4j_api
implementation library.java.spark_streaming
implementation library.java.spark_core
implementation library.java.spark3_streaming
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let's move sparkreceiver/2 to sparkreceiver/3 or simply sparkreceiver/. The package name is unchanged so that release is unchanged.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I sent an email to dev list regarding this change. I will wait a couple days to see if there is any objection or other suggestion.

@shunping
Copy link
Contributor Author

shunping commented Feb 5, 2025

Run Java PreCommit

@shunping
Copy link
Contributor Author

shunping commented Feb 5, 2025

Run Java_Examples_Dataflow_Java21 PreCommit

@Abacn
Copy link
Contributor

Abacn commented Feb 5, 2025

Java PreCommit testOnNewWorkerMetadata_redistributesBudget (org.apache.beam.runners.dataflow.worker.streaming.harness.FanOutStreamingEngineWorkerHarnessTest) failed

due to #28957 not related to this change

Copy link
Contributor

@Abacn Abacn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you!

@shunping shunping changed the title Update slf4j version [Do not merge] Update slf4j version Feb 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants