[Work in progress] [KAFKA-19174] Gradle version upgrade 8 -->> 9

[dejan2609]

JIRA ticket: https://issues.apache.org/jira/browse/KAFKA-19174

Related links:

• https://gradle.org/whats-new/gradle-9
• https://github.com/gradle/gradle/releases/tag/v9.0.0
• https://docs.gradle.org/9.0.0/release-notes.html
• https://docs.gradle.org/9.0.0/userguide/upgrading_major_version_9.html

Also, it would be wise to include shadow plugin version upgrade when the time comes: https://gradleup.com/shadow/changes/#900-rc3-2025-08-01

Note: new Gradle version brings up some breaking changes (as always 😃); Kafka build with Gradle 9 has same issues as other projects:

• Broken with OpenJDK 24 (gradle 9.x snapshots) redhat-developer/vscode-java#4018
• Turn resolution from outside of project context to an error from a warning gradle/gradle#32597

[github-actions]

A label of 'needs-attention' was automatically added to this PR in order to raise the
attention of the committers. Once this issue has been triaged, the triage label
should be removed to prevent this automation from happening again.

[github-actions]

This PR is being marked as stale since it has not had any activity in 90 days. If you
would like to keep this PR alive, please leave a comment asking for a review. If the PR has
merge conflicts, update it with the latest from the base branch.

If you are having difficulty finding a reviewer, please reach out on the [mailing list](https://kafka.apache.org/contact).

If this PR is no longer valid or desired, please feel free to close it. If no activity occurs in the next 30 days, it will be automatically closed.

[github-actions]

A label of 'needs-attention' was automatically added to this PR in order to raise the
attention of the committers. Once this issue has been triaged, the triage label
should be removed to prevent this automation from happening again.

[dejan2609]

Update: project compilation works as expected (when powered by Gradle 9) but binary release creation fails.
More work has to be done in order to accommodate to Gradle breaking changes.

[github-actions]

A label of 'needs-attention' was automatically added to this PR in order to raise the
attention of the committers. Once this issue has been triaged, the triage label
should be removed to prevent this automation from happening again.

[chia7712]

@dejan2609 any update?

[github-actions]

A label of 'needs-attention' was automatically added to this PR in order to raise the
attention of the committers. Once this issue has been triaged, the triage label
should be removed to prevent this automation from happening again.

[dejan2609]

@chia7712
Will provide an update during the weekend (there are two problems with Gradle 9 build, will explain in more details and provide some insights).

[chia7712]

@dejan2609 thanks!

[dejan2609]

@chia7712 feel free to check this related PR: #20327

[dejan2609]

Pending: I will also explain second problem (specific to Gradle 9, that is).

[github-actions]

A label of 'needs-attention' was automatically added to this PR in order to raise the
attention of the committers. Once this issue has been triaged, the triage label
should be removed to prevent this automation from happening again.

[dejan2609]

So, just to sum it up: Gradle 9 task :core:releaseTarGz (for a binary tgz file creation) fails ❌:

:core:releaseTarGz (Thread[Execution worker Thread 3,5,main]) started.

> Task :core:releaseTarGz FAILED

[Incubating] Problems report is available at: file:///home/dejan/kafka/build/reports/problems/problems-report.html

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':core:releaseTarGz'.
> Resolution of the configuration ':tools:tools-api:runtimeClasspath' was attempted without an exclusive lock. This is unsafe and not allowed.

What needs to be done 💡: it seems to me that Gradle producer-consumer concept needs to be applied for Kafka submodules.

Other related links (mental note for me) 📒:

• https://docs.gradle.org/9.0.0/userguide/viewing_debugging_dependencies.html#sub:resolving-unsafe-configuration-resolution-errors
• https://docs.gradle.org/9.0.0/userguide/multi_project_builds.html#sec:depending_on_output_of_another_project
• https://docs.gradle.org/9.0.0/samples/sample_cross_project_output_sharing.html
• https://docs.gradle.org/9.0.0/userguide/upgrading_major_version_9.html#packaging_and_artifact_behavior_changes