Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adds CI to generate test vectors #3793

Merged
merged 68 commits into from
Jun 11, 2024
Merged
Changes from 67 commits
Commits
Show all changes
68 commits
Select commit Hold shift + click to select a range
3a7f7b1
testing xs spec runners
parithosh Apr 22, 2024
a37052d
bump ci
parithosh Apr 22, 2024
4c78d73
bump ci
parithosh Apr 22, 2024
1c4546e
add deps
parithosh Apr 24, 2024
16556de
add deps
parithosh Apr 24, 2024
7e13ddf
add deps
parithosh Apr 24, 2024
150d6b5
fix nvm
parithosh Apr 24, 2024
5a6e871
fix apt
parithosh Apr 24, 2024
0eb8b34
try uses
parithosh Apr 24, 2024
575d6ee
try uses
parithosh Apr 24, 2024
1a0f1d2
fix codespell
parithosh Apr 24, 2024
020a022
try modding makefile
parithosh Apr 24, 2024
6f134c4
install venv
parithosh Apr 24, 2024
0175990
fix venv
parithosh Apr 24, 2024
102da80
try l
parithosh Apr 24, 2024
963d75a
fixing tag
parithosh Apr 24, 2024
c4c2e03
update actions node16
parithosh Apr 24, 2024
5dd86b9
try multiple sizes
parithosh Apr 24, 2024
46c3bc1
xl them all
parithosh Apr 24, 2024
e1c2b61
try new ci
parithosh Apr 25, 2024
9b1edd6
update label
parithosh Apr 25, 2024
d1790fa
test arm
parithosh Apr 25, 2024
652eafa
switch back to xl
parithosh Apr 25, 2024
4e3ce3e
try chungus
parithosh Apr 25, 2024
b033ea5
try just tough job as chungus
parithosh Apr 25, 2024
f7bb493
try tough job as megachungus
parithosh Apr 25, 2024
56dff39
switch back to xl
parithosh Apr 25, 2024
448bd1f
bump ci
parithosh Apr 26, 2024
0fab043
Merge branch 'ethereum:dev' into dev
parithosh Apr 26, 2024
fcfe793
modded makefile
parithosh Apr 26, 2024
0c09b34
Merge remote-tracking branch 'refs/remotes/origin/dev' into dev
parithosh Apr 26, 2024
1a906dd
yeet stale jobs
parithosh Apr 26, 2024
7eba36c
trigger ci
parithosh Apr 26, 2024
83df72f
try the github envs
parithosh Apr 26, 2024
6c7dc0f
update env
parithosh Apr 26, 2024
a7be2f8
update cache with nil
parithosh Apr 26, 2024
ffd42a8
try multiple sizes
parithosh Apr 26, 2024
8082e5c
drop down to l
parithosh Apr 26, 2024
f51aaf9
up type
parithosh Apr 30, 2024
8b6d343
Merge branch 'ethereum:dev' into dev
parithosh May 6, 2024
f596cc5
retrigger ci
parithosh May 6, 2024
e145f5e
Merge remote-tracking branch 'refs/remotes/origin/dev' into dev
parithosh May 6, 2024
468dd2e
retrigger ci
parithosh May 6, 2024
723401d
retrigger ci
parithosh May 6, 2024
16b038c
retrigger ci
parithosh May 6, 2024
4f8071b
cleanup naming
parithosh May 7, 2024
9f7cf7d
adding test vector generation action
parithosh May 30, 2024
40252bc
Merge remote-tracking branch 'refs/remotes/origin/dev' into dev
parithosh May 30, 2024
e8ae81a
update path
parithosh May 30, 2024
12d0247
updating path
parithosh May 30, 2024
b371058
trying higher tier
parithosh May 31, 2024
e7224bb
switch to size-gigachungus-x64
parithosh May 31, 2024
19e7a40
updating threads to use
parithosh May 31, 2024
fcf2523
trying size-chungus-x64
parithosh May 31, 2024
dc097d3
fix path
parithosh May 31, 2024
b06551b
split into multiple files
parithosh Jun 4, 2024
7ee61f7
split into multiple files
parithosh Jun 4, 2024
36a5747
Merge remote-tracking branch 'refs/remotes/origin/dev' into dev
parithosh Jun 7, 2024
5c4b84e
switching types
parithosh Jun 7, 2024
cdb4e64
switching back to a big node
parithosh Jun 7, 2024
f5ec366
fix name
parithosh Jun 8, 2024
51a774d
switching to giga
parithosh Jun 8, 2024
1c5a7c1
switching to xl
parithosh Jun 8, 2024
a31fe60
switching to chungus
parithosh Jun 8, 2024
dbba3ad
switch to gigachungus
parithosh Jun 10, 2024
ad98e99
switching back size
parithosh Jun 10, 2024
4133a8d
Merge branch 'ethereum:dev' into dev
parithosh Jun 10, 2024
18b92e9
removing unused variable
parithosh Jun 11, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
81 changes: 81 additions & 0 deletions .github/workflows/generate_vectors.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,81 @@
name: Run test vector generation

defaults:
run:
shell: zsh {0}

env:
TEST_PRESET_TYPE: "minimal"
parithosh marked this conversation as resolved.
Show resolved Hide resolved

on:
workflow_dispatch:
inputs:
ref:
description: The branch, tag or SHA to checkout and build from
default: dev
type: string
required: true

jobs:
generate-tests:
runs-on: [self-hosted-ghr-custom, size-chungus-x64, profile-consensusSpecs]
steps:
- name: Checkout repository
uses: actions/checkout@v4
with:
repository: 'ethereum/consensus-specs'
path: 'consensus-specs'
ref: ${{ inputs.source_ref }}
- name: Checkout consensus-spec-tests repository
uses: actions/checkout@v4
with:
repository: 'ethereum/consensus-spec-tests'
path: 'consensus-spec-tests'
fetch-depth: 1
- name: Setup Python
uses: actions/setup-python@v5
with:
python-version: '3.10'
cache: ''
- name: Clean up Spec Repository
run: |
cd consensus-specs
make clean
- name: Install dependencies and generate pyspec
run: |
cd consensus-specs
make install_test
make -B pyspec
- name: Generate tests
run: |
cd consensus-specs
make -j 16 generate_tests 2>&1 | tee ../consensustestgen.log
cp -r presets/ ../consensus-spec-tests/presets
cp -r configs/ ../consensus-spec-tests/configs
find . -type d -empty -delete
- name: Archive configurations
run: |
cd consensus-spec-tests
tar -czvf general.tar.gz tests/general
tar -czvf minimal.tar.gz tests/minimal
tar -czvf mainnet.tar.gz tests/mainnet
- name: Upload general.tar.gz
uses: actions/upload-artifact@v4
with:
name: General Test Configuration
path: consensus-spec-tests/general.tar.gz
- name: Upload minimal.tar.gz
uses: actions/upload-artifact@v4
with:
name: Minimal Test Configuration
path: consensus-spec-tests/minimal.tar.gz
- name: Upload mainnet.tar.gz
uses: actions/upload-artifact@v4
with:
name: Mainnet Test Configuration
path: consensus-spec-tests/mainnet.tar.gz
- name: Upload consensustestgen
uses: actions/upload-artifact@v4
with:
name: consensustestgen.log
path: consensustestgen.log