Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adjust default values for batching #934

Merged
merged 1 commit into from
Nov 20, 2024

Adjust default values for batching

b007fca
Select commit
Loading
Failed to load commit list.
Merged

Adjust default values for batching #934

Adjust default values for batching
b007fca
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / tests-lint-ruff succeeded Nov 20, 2024 in 2m 49s

FirefoxCI (pull_request)

Run tests

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2024-11-20T19:19:06.536Z
Resolved: 2024-11-20T19:19:53.691Z
Task Execution Time: 47 seconds, 155 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log


[taskcluster 2024-11-20 19:19:06.587Z] Task ID: VvmVmOJvTmiksZBPwt5DJg
[taskcluster 2024-11-20 19:19:06.587Z] Worker ID: 8926786771309792047
[taskcluster 2024-11-20 19:19:06.587Z] Worker Group: us-central1-a
[taskcluster 2024-11-20 19:19:06.587Z] Worker Node Type: projects/887720501152/machineTypes/n2-highmem-32
[taskcluster 2024-11-20 19:19:06.587Z] Worker Pool: translations-1/b-linux-large-gcp
[taskcluster 2024-11-20 19:19:06.587Z] Worker Version: 38.0.5
[taskcluster 2024-11-20 19:19:06.587Z] Public IP: 35.232.195.183
[taskcluster 2024-11-20 19:19:06.587Z] Hostname: translations-1-b-linux-large-gcp-jnzeuer0q6gkrlzevwwb1w
[taskcluster 2024-11-20 19:19:06.587Z] using cache "translations-level-1-checkouts-v3-7afeb851dd97df8f3607-SOiR_FI4S9mK4J3mpbYH1w" -> /builds/worker/checkouts

[taskcluster 2024-11-20 19:19:09.784Z] Downloading artifact "public/image.tar.zst" from task ID: SOiR_FI4S9mK4J3mpbYH1w.
[taskcluster 2024-11-20 19:19:12.994Z] Downloaded artifact successfully.
[taskcluster 2024-11-20 19:19:12.995Z] Downloaded 264.518 mb
[taskcluster 2024-11-20 19:19:12.996Z] Decompressing downloaded image
[taskcluster 2024-11-20 19:19:15.029Z] Loading docker image from downloaded archive.
[taskcluster 2024-11-20 19:19:29.561Z] Image 'public/image.tar.zst' from task 'SOiR_FI4S9mK4J3mpbYH1w' loaded.  Using image ID sha256:e39c0327831f6554b1d51eb16c2da14b810b878b1b9fb7bec56b391a70f7c4b4.
[taskcluster 2024-11-20 19:19:29.714Z] === Task Starting ===
[setup 2024-11-20T19:19:30.945Z] run-task started in /builds/worker
[setup 2024-11-20T19:19:30.945Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/vcs/ --task-cwd /builds/worker/checkouts/vcs -- bash -c task lint-ruff
[setup 2024-11-20T19:19:30.945Z] Python version: 3.10.12
[cache 2024-11-20T19:19:30.946Z] cache /builds/worker/checkouts is empty; writing requirements: gid=1000 uid=1000 version=1
[volume 2024-11-20T19:19:30.946Z] changing ownership of volume /builds/worker/.cache to 1000:1000
[volume 2024-11-20T19:19:30.946Z] volume /builds/worker/checkouts is a cache
[setup 2024-11-20T19:19:30.947Z] running as worker:worker
[vcs 2024-11-20T19:19:30.947Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/vcs']
[vcs 2024-11-20T19:19:30.949Z] executing ['git', 'clone', 'https://github.com/mozilla/translations', '/builds/worker/checkouts/vcs']
[vcs 2024-11-20T19:19:30.950Z] Cloning into '/builds/worker/checkouts/vcs'...
[vcs 2024-11-20T19:19:32.755Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/gregtatum/firefox-translations-training', 'teacher-decoder-config']
[vcs 2024-11-20T19:19:33.012Z] From https://github.com/gregtatum/firefox-translations-training
[vcs 2024-11-20T19:19:33.012Z]  * branch            teacher-decoder-config -> FETCH_HEAD
[vcs 2024-11-20T19:19:33.014Z] executing ['git', 'checkout', '-f', '-B', 'teacher-decoder-config', 'b007fcac494840ef48f84d01c72cb5ff177ecb68']
[vcs 2024-11-20T19:19:33.803Z] Switched to a new branch 'teacher-decoder-config'
[vcs 2024-11-20T19:19:33.826Z] executing ['git', 'submodule', 'init']
[vcs 2024-11-20T19:19:33.848Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2024-11-20T19:19:33.848Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2024-11-20T19:19:33.849Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2024-11-20T19:19:33.849Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2024-11-20T19:19:33.850Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2024-11-20T19:19:33.850Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2024-11-20T19:19:33.851Z] Submodule 'inference/3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path 'inference/3rd_party/browsermt-marian-dev'
[vcs 2024-11-20T19:19:33.851Z] Submodule 'inference/3rd_party/emsdk' (https://github.com/emscripten-core/emsdk.git) registered for path 'inference/3rd_party/emsdk'
[vcs 2024-11-20T19:19:33.854Z] Submodule 'inference/3rd_party/ssplit-cpp' (https://github.com/browsermt/ssplit-cpp) registered for path 'inference/3rd_party/ssplit-cpp'
[vcs 2024-11-20T19:19:33.855Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-11-20T19:19:33.879Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/browsermt-marian-dev'...
[vcs 2024-11-20T19:19:35.085Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/extract-lex'...
[vcs 2024-11-20T19:19:35.372Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/fast_align'...
[vcs 2024-11-20T19:19:35.679Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/kenlm'...
[vcs 2024-11-20T19:19:36.331Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/marian-dev'...
[vcs 2024-11-20T19:19:37.909Z] Cloning into '/builds/worker/checkouts/vcs/3rd_party/preprocess'...
[vcs 2024-11-20T19:19:38.296Z] Cloning into '/builds/worker/checkouts/vcs/inference/3rd_party/browsermt-marian-dev'...
[vcs 2024-11-20T19:19:39.583Z] Cloning into '/builds/worker/checkouts/vcs/inference/3rd_party/emsdk'...
[vcs 2024-11-20T19:19:40.082Z] Cloning into '/builds/worker/checkouts/vcs/inference/3rd_party/ssplit-cpp'...
[vcs 2024-11-20T19:19:44.375Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-11-20T19:19:44.386Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-11-20T19:19:44.398Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-11-20T19:19:44.426Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-11-20T19:19:44.544Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-11-20T19:19:44.565Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-11-20T19:19:44.642Z] Submodule path 'inference/3rd_party/browsermt-marian-dev': checked out '2781d735d4a10dca876d61be587afdab2726293c'
[vcs 2024-11-20T19:19:44.663Z] Submodule path 'inference/3rd_party/emsdk': checked out '2346baa7bb44a4a0571cc75f1986ab9aaa35aa03'
[vcs 2024-11-20T19:19:44.678Z] Submodule path 'inference/3rd_party/ssplit-cpp': checked out 'a311f9865ade34db1e8e080e6cc146f55dafb067'
[vcs 2024-11-20T19:19:44.678Z] cleaning git checkout...
[vcs 2024-11-20T19:19:44.678Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-11-20T19:19:44.682Z] removing []
[vcs 2024-11-20T19:19:44.682Z] successfully cleaned git checkout!
[vcs 2024-11-20T19:19:44.684Z] TinderboxPrint:<a href='https://github.com/gregtatum/firefox-translations-training/commit/b007fcac494840ef48f84d01c72cb5ff177ecb68' title='Built from firefox-translations-training commit b007fcac494840ef48f84d01c72cb5ff177ecb68'>b007fcac494840ef48f84d01c72cb5ff177ecb68</a>
[task 2024-11-20T19:19:44.684Z] executing ['bash', '-c', 'task lint-ruff']
[task 2024-11-20T19:19:44.692Z] task: [poetry-install-*] poetry install --only lint --no-root
[task 2024-11-20T19:19:45.167Z] Creating virtualenv firefox-translations-hlUNdH3O-py3.10 in /builds/worker/.cache/pypoetry/virtualenvs
[task 2024-11-20T19:19:45.690Z] Installing dependencies from lock file
[task 2024-11-20T19:19:46.130Z] 
[task 2024-11-20T19:19:46.130Z] Package operations: 36 installs, 1 update, 0 removals
[task 2024-11-20T19:19:46.130Z] 
[task 2024-11-20T19:19:46.130Z]   - Installing typing-extensions (4.12.2)
[task 2024-11-20T19:19:46.367Z]   - Installing frozenlist (1.5.0)
[task 2024-11-20T19:19:46.368Z]   - Installing idna (3.10)
[task 2024-11-20T19:19:46.370Z]   - Installing multidict (6.1.0)
[task 2024-11-20T19:19:46.372Z]   - Installing propcache (0.2.0)
[task 2024-11-20T19:19:46.373Z]   - Installing smmap (5.0.1)
[task 2024-11-20T19:19:46.592Z]   - Installing aiohappyeyeballs (2.4.3)
[task 2024-11-20T19:19:46.593Z]   - Installing aiosignal (1.3.1)
[task 2024-11-20T19:19:46.594Z]   - Installing async-timeout (4.0.3)
[task 2024-11-20T19:19:46.595Z]   - Installing certifi (2024.8.30)
[task 2024-11-20T19:19:46.596Z]   - Installing attrs (24.2.0)
[task 2024-11-20T19:19:46.597Z]   - Installing gitdb (4.0.11)
[task 2024-11-20T19:19:46.598Z]   - Installing charset-normalizer (3.4.0)
[task 2024-11-20T19:19:46.600Z]   - Installing six (1.16.0)
[task 2024-11-20T19:19:46.601Z]   - Installing urllib3 (2.2.3)
[task 2024-11-20T19:19:46.603Z]   - Installing yarl (1.17.1)
[task 2024-11-20T19:19:46.816Z]   - Installing aiohttp (3.10.10)
[task 2024-11-20T19:19:46.817Z]   - Installing click (8.1.7)
[task 2024-11-20T19:19:46.817Z]   - Installing docker-pycreds (0.4.0)
[task 2024-11-20T19:19:46.818Z]   - Installing gitpython (3.1.43)
[task 2024-11-20T19:19:46.819Z]   - Installing mohawk (1.1.0)
[task 2024-11-20T19:19:46.820Z]   - Installing platformdirs (4.3.6)
[task 2024-11-20T19:19:46.823Z]   - Installing protobuf (3.19.0)
[task 2024-11-20T19:19:46.823Z]   - Installing psutil (6.1.0)
[task 2024-11-20T19:19:46.825Z]   - Installing python-dateutil (2.9.0.post0)
[task 2024-11-20T19:19:46.826Z]   - Installing pyyaml (6.0.2)
[task 2024-11-20T19:19:46.827Z]   - Installing sentry-sdk (2.18.0)
[task 2024-11-20T19:19:46.829Z]   - Installing setproctitle (1.3.3)
[task 2024-11-20T19:19:46.830Z]   - Updating setuptools (75.2.0 -> 75.3.0)
[task 2024-11-20T19:19:46.831Z]   - Installing requests (2.31.0)
[task 2024-11-20T19:19:46.832Z]   - Installing slugid (2.0.0)
[task 2024-11-20T19:19:46.833Z]   - Installing taskcluster-urls (13.0.1)
[task 2024-11-20T19:19:48.289Z]   - Installing numpy (1.26.4)
[task 2024-11-20T19:19:48.290Z]   - Installing taskcluster (56.0.3)
[task 2024-11-20T19:19:48.291Z]   - Installing wandb (0.17.2)
[task 2024-11-20T19:19:49.580Z]   - Installing ruff (0.1.15)
[task 2024-11-20T19:19:49.894Z]   - Installing translations-parser (0.1.0 /builds/worker/checkouts/vcs/tracking)
[task 2024-11-20T19:19:51.558Z] task: [lint-ruff] poetry run ruff --version
[task 2024-11-20T19:19:52.100Z] ruff 0.1.15
[task 2024-11-20T19:19:52.101Z] task: [lint-ruff] poetry run ruff check . 
[taskcluster 2024-11-20 19:19:53.206Z] === Task Finished ===
[taskcluster 2024-11-20 19:19:53.206Z] Successful task run with exit code: 0 completed in 46.62 seconds