Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run SyzOS runtests continuonsly to detect regressions #5589

Open
ramosian-glider opened this issue Dec 10, 2024 · 1 comment
Open

Run SyzOS runtests continuonsly to detect regressions #5589

ramosian-glider opened this issue Dec 10, 2024 · 1 comment

Comments

@ramosian-glider
Copy link
Member

Is your feature request related to a problem? Please describe.
We currently have a bunch of ARM64 SyzOS tests in sys/linux/test. I run them locally using syz-manager -mode run-tests, but want to continuously run them somewhere to detect regressions.

Describe the solution you'd like
Because the manager already has all the building blocks to execute those tests, I was thinking about adding a config option that would run the tests at manager startup and report their failures as bugs.

This can be very helpful for verifying the behavior of SyzOS guest code, but can be also used to validate pseudo-syscalls that can silently stop working now.

An alternative approach would be to add a separate Github CI test target that would effectively run syz-manager -mode run-tests.

Additional context
In general, tests in sys/linux/tests do not always validate any functionality. In certain modes, some syscalls may fail leading to test failures. So we'll need to split off the tests meant to be run continuously.

@dvyukov
Copy link
Collaborator

dvyukov commented Dec 10, 2024

Related #4022, #604, #603

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants