Skip to content
This repository has been archived by the owner on Sep 1, 2020. It is now read-only.

Run benchmarks on CI #76

Open
iamed2 opened this issue Sep 26, 2016 · 2 comments
Open

Run benchmarks on CI #76

iamed2 opened this issue Sep 26, 2016 · 2 comments

Comments

@iamed2
Copy link
Collaborator

iamed2 commented Sep 26, 2016

We should be able to run benchmarks on CI infrastructure and report on regressions or progressions. We may need to widen tolerance to account for variance in the cloud, but Curtis Vogt (@omus) has determined that it's feasible to rely on Travis-run benchmarks most of the time.

@iamed2 iamed2 added this to the 1.0.0 milestone Sep 26, 2016
@omus
Copy link

omus commented Sep 27, 2016

Just going to note that benchmarks on Travis CI do give a "ballpark" view for performance regressions. Definitely not great at finding subtle regressions.

@iamed2
Copy link
Collaborator Author

iamed2 commented Sep 27, 2016

Mhm, they'll need to be run more seriously in a controlled (local) environment when examining.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants