[taskcluster 2024-11-20 19:16:38.694Z] Task ID: GgjMM_wCSh2Dxs3fUeLqZA
[taskcluster 2024-11-20 19:16:38.694Z] Worker ID: 5589730296239197091
[taskcluster 2024-11-20 19:16:38.694Z] Worker Group: us-central1-f
[taskcluster 2024-11-20 19:16:38.694Z] Worker Node Type: projects/887720501152/machineTypes/n2-standard-2
[taskcluster 2024-11-20 19:16:38.694Z] Worker Pool: translations-1/decision-gcp
[taskcluster 2024-11-20 19:16:38.694Z] Worker Version: 38.0.5
[taskcluster 2024-11-20 19:16:38.694Z] Public IP: 34.134.126.171
[taskcluster 2024-11-20 19:16:38.694Z] Hostname: translations-1-decision-gcp-f2s-31kcsxad366p-6qnow
[taskcluster 2024-11-20 19:16:38.694Z] using cache "translations-level-1-checkouts-sparse-v2" -> /builds/worker/checkouts

559df9a599c4 - Started downloading
b57ab501a8f4 - Started downloading
559df9a599c4 - Downloaded in 0.102 seconds
3bb7dd3accd0 - Started downloading
fad8d951cdaf - Started downloading
fad8d951cdaf - Downloaded in 0.001 seconds
b57ab501a8f4 - Downloaded in 0.562 seconds
3bb7dd3accd0 - Downloaded in 1.125 seconds
Digest: sha256:8c57e30214c85625856479812e63212dc2873b1ffcd97467a7c93508cbb3075a
Status: Downloaded newer image for mozillareleases/taskgraph@sha256:8c57e30214c85625856479812e63212dc2873b1ffcd97467a7c93508cbb3075a
[taskcluster 2024-11-20 19:16:49.673Z] === Task Starting ===
[setup 2024-11-20T19:16:50.827Z] run-task started in /
[setup 2024-11-20T19:16:50.827Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/src -- bash -cx cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/translations' --base-ref='main' --base-rev='60e8730b9a25a1a6ebc252124af981752a22a5ff' --head-repository='https://github.com/gregtatum/firefox-translations-training' --head-ref='teacher-decoder-config' --head-rev='b007fcac494840ef48f84d01c72cb5ff177ecb68' 

[setup 2024-11-20T19:16:50.827Z] Python version: 3.11.2
[vcs 2024-11-20T19:16:50.829Z] WARNING: vcs checkout path (/builds/worker/checkouts/src) not in cache or volume; performance will likely suffer
[setup 2024-11-20T19:16:50.829Z] running as worker:worker
[vcs 2024-11-20T19:16:50.829Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/src']
[vcs 2024-11-20T19:16:50.831Z] executing ['git', 'clone', 'https://github.com/mozilla/translations', '/builds/worker/checkouts/src']
[vcs 2024-11-20T19:16:50.833Z] Cloning into '/builds/worker/checkouts/src'...
[vcs 2024-11-20T19:16:52.109Z] executing ['git', 'fetch', 'origin', 'main']
[vcs 2024-11-20T19:16:52.337Z] From https://github.com/mozilla/translations
[vcs 2024-11-20T19:16:52.337Z]  * branch            main       -> FETCH_HEAD
[vcs 2024-11-20T19:16:52.344Z] executing ['git', 'checkout', 'main']
[vcs 2024-11-20T19:16:52.399Z] Already on 'main'
[vcs 2024-11-20T19:16:52.399Z] Your branch is up to date with 'origin/main'.
[vcs 2024-11-20T19:16:52.399Z] executing ['git', 'fetch', 'origin', '60e8730b9a25a1a6ebc252124af981752a22a5ff']
[vcs 2024-11-20T19:16:52.612Z] From https://github.com/mozilla/translations
[vcs 2024-11-20T19:16:52.613Z]  * branch            60e8730b9a25a1a6ebc252124af981752a22a5ff -> FETCH_HEAD
[vcs 2024-11-20T19:16:52.620Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/gregtatum/firefox-translations-training', 'teacher-decoder-config']
[vcs 2024-11-20T19:16:52.871Z] From https://github.com/gregtatum/firefox-translations-training
[vcs 2024-11-20T19:16:52.872Z]  * branch            teacher-decoder-config -> FETCH_HEAD
[vcs 2024-11-20T19:16:52.874Z] executing ['git', 'checkout', '-f', '-B', 'teacher-decoder-config', 'b007fcac494840ef48f84d01c72cb5ff177ecb68']
[vcs 2024-11-20T19:16:52.976Z] Switched to a new branch 'teacher-decoder-config'
[vcs 2024-11-20T19:16:52.977Z] executing ['git', 'submodule', 'init']
[vcs 2024-11-20T19:16:52.995Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2024-11-20T19:16:52.996Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2024-11-20T19:16:52.997Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2024-11-20T19:16:52.997Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2024-11-20T19:16:52.998Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2024-11-20T19:16:52.999Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2024-11-20T19:16:52.999Z] Submodule 'inference/3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path 'inference/3rd_party/browsermt-marian-dev'
[vcs 2024-11-20T19:16:53.000Z] Submodule 'inference/3rd_party/emsdk' (https://github.com/emscripten-core/emsdk.git) registered for path 'inference/3rd_party/emsdk'
[vcs 2024-11-20T19:16:53.000Z] Submodule 'inference/3rd_party/ssplit-cpp' (https://github.com/browsermt/ssplit-cpp) registered for path 'inference/3rd_party/ssplit-cpp'
[vcs 2024-11-20T19:16:53.001Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-11-20T19:16:53.023Z] Cloning into '/builds/worker/checkouts/src/3rd_party/browsermt-marian-dev'...
[vcs 2024-11-20T19:16:55.158Z] Cloning into '/builds/worker/checkouts/src/3rd_party/extract-lex'...
[vcs 2024-11-20T19:16:55.445Z] Cloning into '/builds/worker/checkouts/src/3rd_party/fast_align'...
[vcs 2024-11-20T19:16:55.753Z] Cloning into '/builds/worker/checkouts/src/3rd_party/kenlm'...
[vcs 2024-11-20T19:16:56.584Z] Cloning into '/builds/worker/checkouts/src/3rd_party/marian-dev'...
[vcs 2024-11-20T19:16:59.136Z] Cloning into '/builds/worker/checkouts/src/3rd_party/preprocess'...
[vcs 2024-11-20T19:16:59.687Z] Cloning into '/builds/worker/checkouts/src/inference/3rd_party/browsermt-marian-dev'...
[vcs 2024-11-20T19:17:01.779Z] Cloning into '/builds/worker/checkouts/src/inference/3rd_party/emsdk'...
[vcs 2024-11-20T19:17:02.537Z] Cloning into '/builds/worker/checkouts/src/inference/3rd_party/ssplit-cpp'...
[vcs 2024-11-20T19:17:02.976Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-11-20T19:17:02.983Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-11-20T19:17:02.989Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-11-20T19:17:03.010Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-11-20T19:17:03.114Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-11-20T19:17:03.130Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-11-20T19:17:03.197Z] Submodule path 'inference/3rd_party/browsermt-marian-dev': checked out '2781d735d4a10dca876d61be587afdab2726293c'
[vcs 2024-11-20T19:17:03.211Z] Submodule path 'inference/3rd_party/emsdk': checked out '2346baa7bb44a4a0571cc75f1986ab9aaa35aa03'
[vcs 2024-11-20T19:17:03.221Z] Submodule path 'inference/3rd_party/ssplit-cpp': checked out 'a311f9865ade34db1e8e080e6cc146f55dafb067'
[vcs 2024-11-20T19:17:03.222Z] cleaning git checkout...
[vcs 2024-11-20T19:17:03.222Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-11-20T19:17:03.225Z] removing []
[vcs 2024-11-20T19:17:03.225Z] successfully cleaned git checkout!
[vcs 2024-11-20T19:17:03.228Z] TinderboxPrint:<a href='https://github.com/gregtatum/firefox-translations-training/commit/b007fcac494840ef48f84d01c72cb5ff177ecb68' title='Built from firefox-translations-training commit b007fcac494840ef48f84d01c72cb5ff177ecb68'>b007fcac494840ef48f84d01c72cb5ff177ecb68</a>
[task 2024-11-20T19:17:03.228Z] executing ['bash', '-cx', "cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/translations' --base-ref='main' --base-rev='60e8730b9a25a1a6ebc252124af981752a22a5ff' --head-repository='https://github.com/gregtatum/firefox-translations-training' --head-ref='teacher-decoder-config' --head-rev='b007fcac494840ef48f84d01c72cb5ff177ecb68' \n"]
[task 2024-11-20T19:17:03.230Z] + cd /builds/worker/checkouts/src
[task 2024-11-20T19:17:03.230Z] + ln -s /builds/worker/artifacts artifacts
[task 2024-11-20T19:17:03.231Z] + taskgraph decision --pushlog-id=0 --pushdate=0 --project=firefox-translations-training [email protected] --level=1 --repository-type=git --tasks-for=github-pull-request --base-repository=https://github.com/mozilla/translations --base-ref=main --base-rev=60e8730b9a25a1a6ebc252124af981752a22a5ff --head-repository=https://github.com/gregtatum/firefox-translations-training --head-ref=teacher-decoder-config --head-rev=b007fcac494840ef48f84d01c72cb5ff177ecb68
[task 2024-11-20T19:17:03.476Z] 2024-11-20 19:17:03,476 - INFO - Loading graph configuration.
[task 2024-11-20T19:17:03.499Z] 2024-11-20 19:17:03,499 - WARNING - using default project parameters; add firefox-translations-training to PER_PROJECT_PARAMETERS in /usr/local/lib/python3.11/dist-packages/taskgraph/decision.py to customize behavior for this project
[task 2024-11-20T19:17:03.506Z] 2024-11-20 19:17:03,506 - INFO - Using Parameters(id=567c26b282c9) (from defaults)
[task 2024-11-20T19:17:03.508Z] 2024-11-20 19:17:03,508 - INFO - writing artifact file `parameters.yml`
[task 2024-11-20T19:17:03.516Z] 2024-11-20 19:17:03,515 - INFO - writing artifact file `actions.json`
[task 2024-11-20T19:17:03.518Z] 2024-11-20 19:17:03,518 - INFO - Loading kinds
[task 2024-11-20T19:17:03.547Z] 2024-11-20 19:17:03,547 - INFO - Generating full task set
[task 2024-11-20T19:17:03.575Z] 2024-11-20 19:17:03,575 - INFO - Generated 12 tasks for kind dataset
[task 2024-11-20T19:17:03.576Z] 2024-11-20 19:17:03,576 - INFO - Writing docker-contexts/base.tar.gz for docker image base
[task 2024-11-20T19:17:03.593Z] 2024-11-20 19:17:03,593 - INFO - Writing docker-contexts/inference.tar.gz for docker image inference
[task 2024-11-20T19:17:03.594Z] 2024-11-20 19:17:03,594 - INFO - Writing docker-contexts/test.tar.gz for docker image test
[task 2024-11-20T19:17:03.596Z] 2024-11-20 19:17:03,595 - INFO - Writing docker-contexts/train.tar.gz for docker image train
[task 2024-11-20T19:17:03.596Z] 2024-11-20 19:17:03,595 - INFO - Writing docker-contexts/toolchain-build.tar.gz for docker image toolchain-build
[task 2024-11-20T19:17:03.613Z] 2024-11-20 19:17:03,613 - INFO - Generated 5 tasks for kind docker-image
[task 2024-11-20T19:17:03.623Z] 2024-11-20 19:17:03,623 - INFO - Generated 10 tasks for kind fetch
[task 2024-11-20T19:17:03.705Z] 2024-11-20 19:17:03,705 - INFO - Generated 11 tasks for kind toolchain
[task 2024-11-20T19:17:03.710Z] 2024-11-20 19:17:03,710 - INFO - Generated 4 tasks for kind analyze-mono
[task 2024-11-20T19:17:03.715Z] 2024-11-20 19:17:03,715 - INFO - Generated 4 tasks for kind analyze-corpus
[task 2024-11-20T19:17:03.720Z] 2024-11-20 19:17:03,720 - INFO - Generated 4 tasks for kind clean-corpus
[task 2024-11-20T19:17:03.723Z] 2024-11-20 19:17:03,722 - INFO - Generated 1 tasks for kind bicleaner-model
[task 2024-11-20T19:17:03.728Z] 2024-11-20 19:17:03,728 - INFO - Generated 4 tasks for kind bicleaner
[task 2024-11-20T19:17:03.733Z] 2024-11-20 19:17:03,733 - INFO - Generated 4 tasks for kind clean-mono
[task 2024-11-20T19:17:03.738Z] 2024-11-20 19:17:03,738 - INFO - Generated 1 tasks for kind merge-corpus
[task 2024-11-20T19:17:03.741Z] 2024-11-20 19:17:03,741 - INFO - Generated 2 tasks for kind merge-mono
[task 2024-11-20T19:17:03.744Z] 2024-11-20 19:17:03,744 - INFO - Generated 1 tasks for kind train-vocab
[task 2024-11-20T19:17:03.747Z] 2024-11-20 19:17:03,746 - INFO - Generated 1 tasks for kind split-corpus
[task 2024-11-20T19:17:03.749Z] 2024-11-20 19:17:03,749 - INFO - Generated 1 tasks for kind merge-devset
[task 2024-11-20T19:17:03.753Z] 2024-11-20 19:17:03,753 - INFO - Generated 4 tasks for kind inference
[task 2024-11-20T19:17:03.758Z] 2024-11-20 19:17:03,758 - INFO - Generated 1 tasks for kind train-backwards
[task 2024-11-20T19:17:03.760Z] 2024-11-20 19:17:03,760 - INFO - Generated 1 tasks for kind split-mono-src
[task 2024-11-20T19:17:03.763Z] 2024-11-20 19:17:03,762 - INFO - Generated 1 tasks for kind split-mono-trg
[task 2024-11-20T19:17:03.767Z] 2024-11-20 19:17:03,766 - INFO - Generated 6 tasks for kind tests
[task 2024-11-20T19:17:03.771Z] 2024-11-20 19:17:03,771 - INFO - Generated 2 tasks for kind translate-mono-trg
[task 2024-11-20T19:17:03.775Z] 2024-11-20 19:17:03,775 - INFO - Generated 1 tasks for kind collect-mono-trg
[task 2024-11-20T19:17:03.778Z] 2024-11-20 19:17:03,778 - INFO - Generated 1 tasks for kind alignments-original
[task 2024-11-20T19:17:03.781Z] 2024-11-20 19:17:03,780 - INFO - Generated 1 tasks for kind alignments-backtranslated
[task 2024-11-20T19:17:03.784Z] 2024-11-20 19:17:03,784 - INFO - Generated 1 tasks for kind train-teacher
[task 2024-11-20T19:17:03.787Z] 2024-11-20 19:17:03,787 - INFO - Generated 1 tasks for kind evaluate-teacher-ensemble
[task 2024-11-20T19:17:03.791Z] 2024-11-20 19:17:03,791 - INFO - Generated 2 tasks for kind translate-corpus
[task 2024-11-20T19:17:03.794Z] 2024-11-20 19:17:03,794 - INFO - Generated 2 tasks for kind extract-best
[task 2024-11-20T19:17:03.796Z] 2024-11-20 19:17:03,796 - INFO - Generated 1 tasks for kind collect-corpus
[task 2024-11-20T19:17:03.800Z] 2024-11-20 19:17:03,800 - INFO - Generated 2 tasks for kind translate-mono-src
[task 2024-11-20T19:17:03.803Z] 2024-11-20 19:17:03,803 - INFO - Generated 1 tasks for kind collect-mono-src
[task 2024-11-20T19:17:03.805Z] 2024-11-20 19:17:03,805 - INFO - Generated 1 tasks for kind merge-translated
[task 2024-11-20T19:17:03.808Z] 2024-11-20 19:17:03,808 - INFO - Generated 1 tasks for kind score
[task 2024-11-20T19:17:03.810Z] 2024-11-20 19:17:03,810 - INFO - Generated 1 tasks for kind cefilter
[task 2024-11-20T19:17:03.813Z] 2024-11-20 19:17:03,812 - INFO - Generated 1 tasks for kind shortlist
[task 2024-11-20T19:17:03.815Z] 2024-11-20 19:17:03,815 - INFO - Generated 1 tasks for kind alignments-student
[task 2024-11-20T19:17:03.818Z] 2024-11-20 19:17:03,818 - INFO - Generated 1 tasks for kind train-student
[task 2024-11-20T19:17:03.820Z] 2024-11-20 19:17:03,820 - INFO - Generated 1 tasks for kind finetune-student
[task 2024-11-20T19:17:03.823Z] 2024-11-20 19:17:03,823 - INFO - Generated 1 tasks for kind quantize
[task 2024-11-20T19:17:03.825Z] 2024-11-20 19:17:03,825 - INFO - Generated 1 tasks for kind evaluate-quantized
[task 2024-11-20T19:17:03.828Z] 2024-11-20 19:17:03,828 - INFO - Generated 1 tasks for kind export
[task 2024-11-20T19:17:03.834Z] 2024-11-20 19:17:03,834 - INFO - Generated 4 tasks for kind evaluate
[task 2024-11-20T19:17:03.836Z] 2024-11-20 19:17:03,836 - INFO - Generated 1 tasks for kind all-pipeline
[task 2024-11-20T19:17:03.837Z] 2024-11-20 19:17:03,837 - INFO - Generated 1 tasks for kind all-pr-pipeline
[task 2024-11-20T19:17:03.837Z] 2024-11-20 19:17:03,837 - INFO - Generating full task graph
[task 2024-11-20T19:17:03.837Z] 2024-11-20 19:17:03,837 - INFO - Full task graph contains 109 tasks and 308 dependencies
[task 2024-11-20T19:17:03.842Z] 2024-11-20 19:17:03,842 - INFO - writing artifact file `full-task-graph.json`
[task 2024-11-20T19:17:03.864Z] 2024-11-20 19:17:03,864 - INFO - writing artifact file `runnable-jobs.json`
[task 2024-11-20T19:17:03.865Z] 2024-11-20 19:17:03,865 - INFO - Generating target task set
[task 2024-11-20T19:17:03.865Z] 2024-11-20 19:17:03,865 - INFO - Filter filter_target_tasks pruned 87 tasks (22 remain)
[task 2024-11-20T19:17:03.866Z] 2024-11-20 19:17:03,865 - INFO - writing artifact file `target-tasks.json`
[task 2024-11-20T19:17:03.866Z] 2024-11-20 19:17:03,866 - INFO - Generating target task graph
[task 2024-11-20T19:17:03.866Z] 2024-11-20 19:17:03,866 - INFO - Adding 5 tasks with `always_target` attribute
[task 2024-11-20T19:17:03.867Z] 2024-11-20 19:17:03,867 - INFO - Generating optimized task graph
[task 2024-11-20T19:17:03.871Z] 2024-11-20 19:17:03,871 - INFO - Removed 4 tasks by skip-unless-changed (skip-unless-changed) during optimization.
[task 2024-11-20T19:17:04.581Z] 2024-11-20 19:17:04,580 - INFO - Replaced 96 tasks by index-search (index-search) during optimization.
[task 2024-11-20T19:17:04.582Z] 2024-11-20 19:17:04,582 - INFO - writing artifact file `task-graph.json`
[task 2024-11-20T19:17:04.583Z] 2024-11-20 19:17:04,583 - INFO - writing artifact file `label-to-taskid.json`
[task 2024-11-20T19:17:04.585Z] 2024-11-20 19:17:04,585 - INFO - Creating task with taskId HDk3ogCoRjyNe2xB-vHvPQ for tests-taskgraph-definition
[task 2024-11-20T19:17:04.587Z] 2024-11-20 19:17:04,587 - INFO - Creating task with taskId CpJlEkZ8QS2G5fHoT4-2eg for tests-lint-eslint
[task 2024-11-20T19:17:04.589Z] 2024-11-20 19:17:04,589 - INFO - Creating task with taskId Mn0D0rC_QYaiu0eBI5rnFA for tests-lint-black
[task 2024-11-20T19:17:04.591Z] 2024-11-20 19:17:04,591 - INFO - Creating task with taskId WlID2sS1RnaYRe53ebBVYg for tests-taskgraph-diff
[task 2024-11-20T19:17:04.592Z] 2024-11-20 19:17:04,592 - INFO - Creating task with taskId EgGSRHkbR0awg4Bc9Mt0tw for tests-test
[task 2024-11-20T19:17:04.595Z] 2024-11-20 19:17:04,594 - INFO - Creating task with taskId VvmVmOJvTmiksZBPwt5DJg for tests-lint-ruff
[task 2024-11-20T19:17:04.598Z] 2024-11-20 19:17:04,598 - INFO - Creating task with taskId HSZ8ZQztQIicUXpCSqeMMw for all-pr-pipeline-ru-en-1
[taskcluster 2024-11-20 19:17:05.152Z] === Task Finished ===
[taskcluster 2024-11-20 19:17:07.201Z] Successful task run with exit code: 0 completed in 28.507 seconds