Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Benchmark VMB tests #7

Closed
bitjson opened this issue Feb 5, 2024 · 3 comments
Closed

Benchmark VMB tests #7

bitjson opened this issue Feb 5, 2024 · 3 comments

Comments

@bitjson
Copy link
Owner

bitjson commented Feb 5, 2024

It would be good to have a set of VMB tests that implementations can use to benchmark VM performance for all the known worst-case scenarios. Implementations should use the performance benchmark tooling for their stack to judge the relative performance of each test (over a series of runs) to verify that there aren't any significant outliers.

@bitjson
Copy link
Owner Author

bitjson commented Feb 16, 2024

The start of a wallet template including all the benchmarks:
https://ide.bitauth.com/import-gist/6be7fbca3b3f77d60bc8953439e42612

@bitjson
Copy link
Owner Author

bitjson commented Aug 12, 2024

Here's some discussion of the last few months of work, and I'm continuing to build out test vectors and benchmarks.

Ultimately, this CHIP should also significantly increase our set of cross-implementation test vectors to thoroughly cover both the behavior and benchmarked performance of every operation. I'm just going to leave this issue open until we've thoroughly covered everything and migrated script_tests.json.

@bitjson
Copy link
Owner Author

bitjson commented Sep 25, 2024

I'm going to close this now that we've directly committed the trimmed down set of test vectors/benchmarks and completed the Tests & Benchmarks appendix.

I still plan to expand BCH's test coverage and deprecate script_tests.json, but that's significantly beyond the scope of this CHIP. I'll report on progress here (even after this CHIP is archived): bitauth/libauth#31

@bitjson bitjson closed this as completed Sep 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant