Skip to content
This repository has been archived by the owner on Nov 24, 2022. It is now read-only.

Add nofib performance testing #639

Open
3 tasks
TerrorJack opened this issue May 3, 2020 · 1 comment · May be fixed by #640
Open
3 tasks

Add nofib performance testing #639

TerrorJack opened this issue May 3, 2020 · 1 comment · May be fixed by #640
Assignees

Comments

@TerrorJack
Copy link
Member

Is your feature request related to a problem? Please describe.
We don't have quantitative comparison of generated code performance against native or ghcjs. A good starting point would be using nofib, since most nofib programs are self-contained and can be compiled with ghc boot libs.

Gathering performance characteristics of nofib opens new chances for generating smaller and faster code (and improving the runtime). We need to answer the following questions:

  • How do we compare to native/ghcjs in terms of code size and performance?
  • What are the bottlenecks in the wasm code or runtime?
  • For a PR that impacts generated code or the runtime, does it make things better or worse? (And by what percentage?)

Describe the solution you'd like

  • Collect nofib main programs and their arguments from the upstream nofib repo. Upstream uses Makefiles to specify different inputs of programs for fast/normal/slow paths; we should parse those data from Makefiles.
  • Finish native/asterius comparison first; set this up as a standalone CI job, similar to ghc-testsuite.
  • Generate V8 CPU/heap profiler report and serve them as CI artifacts, so we can examine the bottlenecks visually.
@TerrorJack
Copy link
Member Author

Blocked by #634.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants