Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test_runner: finish build phase before running tests #54423

Merged
merged 1 commit into from
Aug 20, 2024

Conversation

cjihrig
Copy link
Contributor

@cjihrig cjihrig commented Aug 17, 2024

Please ignore the first commit. That is #54387, which is currently blocked from landing because the macOS machine in the CI has a full disk.

This commit updates the test runner to wait for suites to finish
building before starting any tests. This is necessary when test
filtering is enabled, as suites may transition from filtered to
not filtered depending on what is inside of them.

Fixes: #54084
Fixes: #54154

@nodejs-github-bot
Copy link
Collaborator

Review requested:

  • @nodejs/test_runner

@nodejs-github-bot nodejs-github-bot added needs-ci PRs that need a full CI run. test_runner Issues and PRs related to the test runner subsystem. labels Aug 17, 2024
Copy link

codecov bot commented Aug 17, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 87.32%. Comparing base (2226155) to head (4cb8fba).
Report is 347 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main   #54423   +/-   ##
=======================================
  Coverage   87.32%   87.32%           
=======================================
  Files         648      648           
  Lines      182321   182345   +24     
  Branches    34973    34974    +1     
=======================================
+ Hits       159210   159234   +24     
- Misses      16376    16379    +3     
+ Partials     6735     6732    -3     
Files with missing lines Coverage Δ
lib/internal/test_runner/harness.js 89.91% <100.00%> (+0.77%) ⬆️
lib/internal/test_runner/runner.js 85.07% <100.00%> (ø)
lib/internal/test_runner/test.js 98.35% <100.00%> (ø)

... and 25 files with indirect coverage changes

Copy link
Member

@mcollina mcollina left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@cjihrig cjihrig added the request-ci Add this label to start a Jenkins CI on a PR. label Aug 18, 2024
@github-actions github-actions bot removed the request-ci Add this label to start a Jenkins CI on a PR. label Aug 18, 2024
@nodejs-github-bot
Copy link
Collaborator

@nodejs-github-bot
Copy link
Collaborator

nodejs-github-bot commented Aug 18, 2024

This commit updates the test runner to wait for suites to finish
building before starting any tests. This is necessary when test
filtering is enabled, as suites may transition from filtered to
not filtered depending on what is inside of them.

Fixes: nodejs#54084
Fixes: nodejs#54154
@cjihrig cjihrig force-pushed the filter-suite-order branch from aff03a5 to 4cb8fba Compare August 18, 2024 17:42
@cjihrig cjihrig added the request-ci Add this label to start a Jenkins CI on a PR. label Aug 18, 2024
@cjihrig
Copy link
Contributor Author

cjihrig commented Aug 18, 2024

Rebased after #54387 landed. I'm not quite sure why the GitHub UI was saying there was a conflict, but it didn't exist locally 🤷

@github-actions github-actions bot removed the request-ci Add this label to start a Jenkins CI on a PR. label Aug 18, 2024
@nodejs-github-bot
Copy link
Collaborator

@nodejs-github-bot
Copy link
Collaborator

nodejs-github-bot commented Aug 18, 2024

@cjihrig cjihrig added author ready PRs that have at least one approval, no pending requests for changes, and a CI started. commit-queue Add this label to land a pull request using GitHub Actions. and removed needs-ci PRs that need a full CI run. labels Aug 18, 2024
@nodejs-github-bot nodejs-github-bot removed the commit-queue Add this label to land a pull request using GitHub Actions. label Aug 19, 2024
@nodejs-github-bot
Copy link
Collaborator

Commit Queue failed
- Loading data for nodejs/node/pull/54423
✔  Done loading data for nodejs/node/pull/54423
----------------------------------- PR info ------------------------------------
Title      test_runner: finish build phase before running tests (#54423)
Author     Colin Ihrig <[email protected]> (@cjihrig)
Branch     cjihrig:filter-suite-order -> nodejs:main
Labels     author ready, test_runner
Commits    1
 - test_runner: finish build phase before running tests
Committers 1
 - cjihrig <[email protected]>
PR-URL: https://github.com/nodejs/node/pull/54423
Fixes: https://github.com/nodejs/node/issues/54084
Fixes: https://github.com/nodejs/node/issues/54154
Reviewed-By: Benjamin Gruenbaum <[email protected]>
Reviewed-By: Matteo Collina <[email protected]>
------------------------------ Generated metadata ------------------------------
PR-URL: https://github.com/nodejs/node/pull/54423
Fixes: https://github.com/nodejs/node/issues/54084
Fixes: https://github.com/nodejs/node/issues/54154
Reviewed-By: Benjamin Gruenbaum <[email protected]>
Reviewed-By: Matteo Collina <[email protected]>
--------------------------------------------------------------------------------
   ⚠  Commits were pushed since the last approving review:
   ⚠  - test_runner: finish build phase before running tests
   ℹ  This PR was created on Sat, 17 Aug 2024 16:04:38 GMT
   ✔  Approvals: 2
   ✔  - Benjamin Gruenbaum (@benjamingr) (TSC): https://github.com/nodejs/node/pull/54423#pullrequestreview-2244147856
   ✔  - Matteo Collina (@mcollina) (TSC): https://github.com/nodejs/node/pull/54423#pullrequestreview-2244290735
   ✔  Last GitHub CI successful
   ℹ  Last Full PR CI on 2024-08-18T20:14:06Z: https://ci.nodejs.org/job/node-test-pull-request/61207/
- Querying data for job/node-test-pull-request/61207/
   ✔  Last Jenkins CI successful
--------------------------------------------------------------------------------
   ✔  Aborted `git node land` session in /home/runner/work/node/node/.ncu
https://github.com/nodejs/node/actions/runs/10456894484

@nodejs-github-bot nodejs-github-bot added the commit-queue-failed An error occurred while landing this pull request using GitHub Actions. label Aug 19, 2024
@cjihrig
Copy link
Contributor Author

cjihrig commented Aug 19, 2024

This needs a re-approval after the rebase to appease the commit queue.

@jakecastelli jakecastelli added commit-queue Add this label to land a pull request using GitHub Actions. and removed commit-queue-failed An error occurred while landing this pull request using GitHub Actions. labels Aug 20, 2024
@nodejs-github-bot nodejs-github-bot removed the commit-queue Add this label to land a pull request using GitHub Actions. label Aug 20, 2024
@nodejs-github-bot nodejs-github-bot merged commit ef4bdbf into nodejs:main Aug 20, 2024
64 checks passed
@nodejs-github-bot
Copy link
Collaborator

Landed in ef4bdbf

@cjihrig cjihrig deleted the filter-suite-order branch August 20, 2024 11:14
RafaelGSS pushed a commit that referenced this pull request Aug 25, 2024
This commit updates the test runner to wait for suites to finish
building before starting any tests. This is necessary when test
filtering is enabled, as suites may transition from filtered to
not filtered depending on what is inside of them.

Fixes: #54084
Fixes: #54154
PR-URL: #54423
Reviewed-By: Benjamin Gruenbaum <[email protected]>
Reviewed-By: Matteo Collina <[email protected]>
Reviewed-By: Moshe Atlow <[email protected]>
Reviewed-By: Jake Yuesong Li <[email protected]>
@RafaelGSS RafaelGSS mentioned this pull request Aug 25, 2024
@targos targos added the dont-land-on-v20.x PRs that should not land on the v20.x-staging branch and should not be released in v20.x. label Sep 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
author ready PRs that have at least one approval, no pending requests for changes, and a CI started. dont-land-on-v20.x PRs that should not land on the v20.x-staging branch and should not be released in v20.x. test_runner Issues and PRs related to the test runner subsystem.
Projects
None yet
7 participants