Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GH-43412: [Java][Benchmarking] Use JDK_JAVA_OPTIONS for JVM arguments #43411

Merged
merged 1 commit into from
Jul 25, 2024

Conversation

danepitkin
Copy link
Member

@danepitkin danepitkin commented Jul 24, 2024

Rationale for this change

Java options are not getting picked up properly in archery.

What changes are included in this PR?

  • Use JDK_JAVA_OPTIONS instead of _JAVA_OPTIONS env var.

Are these changes tested?

Test via benchmark bot (ursabot)

Are there any user-facing changes?

No

Copy link

Thanks for opening a pull request!

If this is not a minor PR. Could you open an issue for this pull request on GitHub? https://github.com/apache/arrow/issues/new/choose

Opening GitHub issues ahead of time contributes to the Openness of the Apache Arrow project.

Then could you also rename the pull request title in the following format?

GH-${GITHUB_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

or

MINOR: [${COMPONENT}] ${SUMMARY}

In the case of PARQUET issues on JIRA the title also supports:

PARQUET-${JIRA_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

See also:

@danepitkin
Copy link
Member Author

@ursabot please benchmark lang=Java

@ursabot
Copy link

ursabot commented Jul 24, 2024

Benchmark runs are scheduled for commit 4309d3f. Watch https://buildkite.com/apache-arrow and https://conbench.ursa.dev for updates. A comment will be posted here when the runs are complete.

@github-actions github-actions bot added the awaiting review Awaiting review label Jul 24, 2024
@danepitkin danepitkin changed the title Fix Java benchmarks GH-43412: [Java][Benchmarking] Use JDK_JAVA_OPTIONS for JVM arguments Jul 24, 2024
Copy link

⚠️ GitHub issue #43412 has been automatically assigned in GitHub to PR creator.

@danepitkin
Copy link
Member Author

The JVM arg is getting picked up now, according to logs: https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-ec2-m5-4xlarge-us-east-2/builds/5035

@@ -73,7 +73,7 @@ def environment(self):
env["JAVA_HOME"] = self.java_home

if self.java_options:
env["JAVA_OPTIONS"] = self.java_options
env["JDK_JAVA_OPTIONS"] = self.java_options
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The issue is _JAVA_OPTIONS being used as the environment variable instead here JAVA_OPTIONS?
I am just thinking how did this work previously? Didn't picked up at all?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It was an undocumented Java 8 option. In Java 9+, it switched to JDK_JAVA_OPTIONS 😅

@github-actions github-actions bot added awaiting committer review Awaiting committer review and removed awaiting review Awaiting review labels Jul 24, 2024
Copy link

Thanks for your patience. Conbench analyzed the 2 benchmarking runs that have been run so far on PR commit 4309d3f.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details.

Copy link
Collaborator

@vibhatha vibhatha left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Dane. LGTM!

@danepitkin danepitkin merged commit e2d4dbf into apache:main Jul 25, 2024
13 checks passed
@danepitkin danepitkin removed the awaiting committer review Awaiting committer review label Jul 25, 2024
Copy link

After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit e2d4dbf.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 5 possible false positives for unstable benchmarks that are known to sometimes produce them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants