Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

compare between targets #834

Open
drdozer opened this issue Dec 21, 2024 · 0 comments
Open

compare between targets #834

drdozer opened this issue Dec 21, 2024 · 0 comments

Comments

@drdozer
Copy link

drdozer commented Dec 21, 2024

Is it possible to run criterion with a range of targets, and then get it to compare the performances? I need to collect benchmarks for:

  • cargo bench
  • RUSTFLAGS="-C target-cpu=native" cargo bench
  • O3 vs O2
  • possibly other things

I think all the raw data is being collected when I run with -- --save-baseline default, for example, to put each independent run into a different folder. But while I see lots of json files, I can't see any command in either criterion or bench to generate reports comparing them. I would ideally like to avoid pulling this all into a python session.

I'm happy to use different command-line combinations. Or even some other cargo tool. I'd just rather avoid this becoming a python workbooks horror show.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant