-
Notifications
You must be signed in to change notification settings - Fork 93
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Problem with the cloud release mechanism after recent Lake
updates
#115
Comments
Lake
updatesLake
updates
Seems like Issue #117 is related to this problem too. |
Hi @Peiyang-Song, can you check if the issue is resolved for the current version ( |
Sounds great! We'll use Lean versions directly as name tags here. |
Sure, I just tried the latest version on my M2 Mac which should be a supported architecture (and thus I think should be using cloud releases). The good news is that all builds succeed, yet I think it is still doing some building in the log? % lake build
ℹ [2/554] Replayed LeanCopilot/libctranslate2
info: Cloning CTranslate2 from https://github.com/OpenNMT/CTranslate2
info: Configuring CTranslate2 with `cmake -DOPENMP_RUNTIME=NONE -DWITH_MKL=OFF -DWITH_ACCELERATE=ON -DWITH_OPENBLAS=OFF ..`
info: Building CTranslate2 with `make -j4`
info: stdout:
[ 1%] Building CXX object CMakeFiles/ctranslate2.dir/src/allocator.cc.o
[ 1%] Building CXX object CMakeFiles/ctranslate2.dir/src/batch_reader.cc.o
[ 2%] Building CXX object CMakeFiles/ctranslate2.dir/src/cpu/allocator.cc.o
[ 3%] Building CXX object CMakeFiles/ctranslate2.dir/src/buffered_translation_wrapper.cc.o
[ 4%] Building CXX object CMakeFiles/ctranslate2.dir/src/cpu/cpu_info.cc.o
[ 4%] Building CXX object CMakeFiles/ctranslate2.dir/src/cpu/backend.cc.o
[ 5%] Building CXX object CMakeFiles/ctranslate2.dir/src/cpu/cpu_isa.cc.o
[ 6%] Building CXX object CMakeFiles/ctranslate2.dir/src/cpu/kernels.cc.o
[ 7%] Building CXX object CMakeFiles/ctranslate2.dir/src/cpu/parallel.cc.o
[ 8%] Building CXX object CMakeFiles/ctranslate2.dir/src/cpu/primitives.cc.o
[ 8%] Building CXX object CMakeFiles/ctranslate2.dir/src/decoding.cc.o
[ 9%] Building CXX object CMakeFiles/ctranslate2.dir/src/decoding_utils.cc.o
[ 10%] Building CXX object CMakeFiles/ctranslate2.dir/src/devices.cc.o
[ 11%] Building CXX object CMakeFiles/ctranslate2.dir/src/dtw.cc.o
[ 12%] Building CXX object CMakeFiles/ctranslate2.dir/src/encoder.cc.o
[ 12%] Building CXX object CMakeFiles/ctranslate2.dir/src/env.cc.o
[ 13%] Building CXX object CMakeFiles/ctranslate2.dir/src/filesystem.cc.o
[ 14%] Building CXX object CMakeFiles/ctranslate2.dir/src/generator.cc.o
[ 15%] Building CXX object CMakeFiles/ctranslate2.dir/src/layers/attention_layer.cc.o
[ 17%] Building CXX object CMakeFiles/ctranslate2.dir/src/layers/attention.cc.o
[ 17%] Building CXX object CMakeFiles/ctranslate2.dir/src/layers/flash_attention.cc.o
[ 18%] Building CXX object CMakeFiles/ctranslate2.dir/src/layers/common.cc.o
[ 19%] Building CXX object CMakeFiles/ctranslate2.dir/src/layers/decoder.cc.o
[ 20%] Building CXX object CMakeFiles/ctranslate2.dir/src/layers/transformer.cc.o
[ 21%] Building CXX object CMakeFiles/ctranslate2.dir/src/layers/wav2vec2.cc.o
[ 21%] Building CXX object CMakeFiles/ctranslate2.dir/src/layers/wav2vec2bert.cc.o
[ 22%] Building CXX object CMakeFiles/ctranslate2.dir/src/layers/whisper.cc.o
[ 23%] Building CXX object CMakeFiles/ctranslate2.dir/src/logging.cc.o
[ 24%] Building CXX object CMakeFiles/ctranslate2.dir/src/models/language_model.cc.o
[ 25%] Building CXX object CMakeFiles/ctranslate2.dir/src/models/model.cc.o
[ 25%] Building CXX object CMakeFiles/ctranslate2.dir/src/models/model_factory.cc.o
[ 26%] Building CXX object CMakeFiles/ctranslate2.dir/src/models/model_reader.cc.o
[ 27%] Building CXX object CMakeFiles/ctranslate2.dir/src/models/sequence_to_sequence.cc.o
[ 28%] Building CXX object CMakeFiles/ctranslate2.dir/src/models/transformer.cc.o
[ 29%] Building CXX object CMakeFiles/ctranslate2.dir/src/models/wav2vec2.cc.o
[ 29%] Building CXX object CMakeFiles/ctranslate2.dir/src/models/wav2vec2bert.cc.o
[ 30%] Building CXX object CMakeFiles/ctranslate2.dir/src/models/whisper.cc.o
[ 31%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/activation.cc.o
[ 32%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/add.cc.o
[ 34%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/alibi_add.cc.o
[ 34%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/alibi_add_cpu.cc.o
[ 35%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/bias_add.cc.o
[ 36%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/bias_add_cpu.cc.o
[ 37%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/concat.cc.o
[ 38%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/concat_split_slide_cpu.cc.o
[ 38%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/conv1d.cc.o
[ 39%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/conv1d_cpu.cc.o
[ 40%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/cos.cc.o
[ 41%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/dequantize.cc.o
[ 42%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/dequantize_cpu.cc.o
[ 42%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/flash_attention.cc.o
[ 43%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/flash_attention_cpu.cc.o
[ 44%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/gather.cc.o
[ 45%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/gather_cpu.cc.o
[ 46%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/gelu.cc.o
[ 46%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/gemm.cc.o
[ 47%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/gumbel_max.cc.o
[ 48%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/gumbel_max_cpu.cc.o
[ 50%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/layer_norm.cc.o
[ 51%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/layer_norm_cpu.cc.o
[ 51%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/log.cc.o
[ 52%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/matmul.cc.o
[ 53%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/mean.cc.o
[ 54%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/mean_cpu.cc.o
[ 55%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/median_filter.cc.o
[ 55%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/min_max.cc.o
[ 56%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/mul.cc.o
[ 57%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/multinomial.cc.o
[ 58%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/multinomial_cpu.cc.o
[ 59%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/quantize.cc.o
[ 59%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/quantize_cpu.cc.o
[ 60%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/relu.cc.o
[ 61%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/rms_norm.cc.o
[ 62%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/rms_norm_cpu.cc.o
[ 63%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/rotary.cc.o
[ 63%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/rotary_cpu.cc.o
[ 64%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/sin.cc.o
[ 65%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/softmax.cc.o
[ 67%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/softmax_cpu.cc.o
[ 68%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/split.cc.o
[ 68%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/slide.cc.o
[ 69%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/sub.cc.o
[ 70%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/sigmoid.cc.o
[ 71%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/swish.cc.o
[ 72%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/tanh.cc.o
[ 72%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/tile.cc.o
[ 73%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/tile_cpu.cc.o
[ 74%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/topk.cc.o
[ 75%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/topk_cpu.cc.o
[ 76%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/topp_mask.cc.o
[ 76%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/topp_mask_cpu.cc.o
[ 77%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/transpose.cc.o
[ 78%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/nccl_ops.cc.o
[ 79%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/nccl_ops_cpu.cc.o
[ 80%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/awq/dequantize.cc.o
[ 80%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/awq/dequantize_cpu.cc.o
[ 81%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/awq/gemm.cc.o
[ 82%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/awq/gemm_cpu.cc.o
[ 84%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/awq/gemv.cc.o
[ 85%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/awq/gemv_cpu.cc.o
[ 85%] Building CXX object CMakeFiles/ctranslate2.dir/src/ops/sum.cc.o
[ 86%] Building CXX object CMakeFiles/ctranslate2.dir/src/padder.cc.o
[ 87%] Building CXX object CMakeFiles/ctranslate2.dir/src/profiler.cc.o
[ 88%] Building CXX object CMakeFiles/ctranslate2.dir/src/random.cc.o
[ 89%] Building CXX object CMakeFiles/ctranslate2.dir/src/sampling.cc.o
[ 89%] Building CXX object CMakeFiles/ctranslate2.dir/src/scoring.cc.o
[ 90%] Building CXX object CMakeFiles/ctranslate2.dir/src/storage_view.cc.o
[ 91%] Building CXX object CMakeFiles/ctranslate2.dir/src/thread_pool.cc.o
[ 92%] Building CXX object CMakeFiles/ctranslate2.dir/src/translator.cc.o
[ 93%] Building CXX object CMakeFiles/ctranslate2.dir/src/types.cc.o
[ 93%] Building CXX object CMakeFiles/ctranslate2.dir/src/utils.cc.o
[ 94%] Building CXX object CMakeFiles/ctranslate2.dir/src/vocabulary.cc.o
[ 95%] Building CXX object CMakeFiles/ctranslate2.dir/src/vocabulary_map.cc.o
[ 96%] Building CXX object CMakeFiles/ctranslate2.dir/kernels_neon.cc.o
[ 97%] Linking CXX shared library libctranslate2.dylib
[ 97%] Built target ctranslate2
[ 98%] Building CXX object cli/CMakeFiles/translator.dir/translator.cc.o
[100%] Linking CXX executable ct2-translator
[100%] Built target translator
info: stderr:
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/cpu/backend.cc:51:18: warning: unused variable 'is_int8' [-Wunused-variable]
const bool is_int8 = (compute_type == ComputeType::INT8
^
1 warning generated.
In file included from /Users/psong/LeanCopilot/.lake/build/CTranslate2/src/cpu/kernels.cc:19:
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/cpu/vec.h:148:65: warning: unused parameter 'count' [-Wunused-parameter]
static inline void convert_and_store(float v, U* a, dim_t count) {
^
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/cpu/primitives.cc:890:43: warning: unused parameter 'transpose_a' [-Wunused-parameter]
bool transpose_a, bool transpose_b,
^
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/cpu/primitives.cc:890:61: warning: unused parameter 'transpose_b' [-Wunused-parameter]
bool transpose_a, bool transpose_b,
^
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/cpu/primitives.cc:891:44: warning: unused parameter 'm' [-Wunused-parameter]
dim_t m, dim_t n, dim_t k,
^
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/cpu/primitives.cc:891:53: warning: unused parameter 'n' [-Wunused-parameter]
dim_t m, dim_t n, dim_t k,
^
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/cpu/primitives.cc:891:62: warning: unused parameter 'k' [-Wunused-parameter]
dim_t m, dim_t n, dim_t k,
^
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/cpu/primitives.cc:892:44: warning: unused parameter 'alpha' [-Wunused-parameter]
float alpha,
^
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/cpu/primitives.cc:893:52: warning: unused parameter 'a' [-Wunused-parameter]
const int8_t* a, dim_t lda,
^
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/cpu/primitives.cc:893:61: warning: unused parameter 'lda' [-Wunused-parameter]
const int8_t* a, dim_t lda,
^
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/cpu/primitives.cc:894:52: warning: unused parameter 'b' [-Wunused-parameter]
const int8_t* b, dim_t ldb,
^
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/cpu/primitives.cc:894:61: warning: unused parameter 'ldb' [-Wunused-parameter]
const int8_t* b, dim_t ldb,
^
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/cpu/primitives.cc:895:44: warning: unused parameter 'beta' [-Wunused-parameter]
float beta,
^
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/cpu/primitives.cc:896:47: warning: unused parameter 'c' [-Wunused-parameter]
int32_t* c, dim_t ldc,
^
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/cpu/primitives.cc:896:56: warning: unused parameter 'ldc' [-Wunused-parameter]
int32_t* c, dim_t ldc,
^
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/cpu/primitives.cc:897:53: warning: unused parameter 'a_shift_compensation' [-Wunused-parameter]
const int32_t* a_shift_compensation) {
^
1 warning generated.
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/layers/attention.cc:41:19: warning: unused variable 'offset' [-Wunused-variable]
const dim_t offset = keys_length - queries_length;
^
1 warning generated.
14 warnings generated.
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/layers/wav2vec2.cc:14:9: warning: field '_transpose' will be initialized after field '_output_norm' [-Wreorder-ctor]
, _transpose({0, 2, 1})
^~~~~~~~~~~~~~~~~~~~~
_output_norm(model, scope + "/layer_norm")
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/layers/wav2vec2.cc:57:9: warning: field '_num_heads' will be initialized after field '_transpose' [-Wreorder-ctor]
, _num_heads(model.get_attribute_with_default<int32_t>(scope + "/num_heads", 8))
^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
_transpose({0, 2, 1})
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/layers/wav2vec2.cc:84:27: warning: comparison of integers of different signs: 'ctranslate2::dim_t' (aka 'long long') and 'std::vector<std::unique_ptr<const ctranslate2::layers::Wav2Vec2LayerNormConvLayer>>::size_type' (aka 'unsigned long') [-Wsign-compare]
for (dim_t l = 0; l < _feat_layers.size(); l++) {
~ ^ ~~~~~~~~~~~~~~~~~~~
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/layers/wav2vec2.cc:86:15: warning: comparison of integers of different signs: 'ctranslate2::dim_t' (aka 'long long') and 'unsigned long' [-Wsign-compare]
if (l < _feat_layers.size() - 1 ) {
~ ^ ~~~~~~~~~~~~~~~~~~~~~~~
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/layers/wav2vec2bert.cc:13:9: warning: field '_self_attn_layer_norm' will be initialized after field '_num_heads' [-Wreorder-ctor]
, _self_attn_layer_norm(model, scope + "/enc_attn_layer_norm")
^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
_ff1(model, scope + "/enc_ffn1", pre_norm, activation_type)
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/layers/wav2vec2bert.cc:107:9: warning: field '_attn_conv' will be initialized after field '_num_heads' [-Wreorder-ctor]
, _attn_conv(model, scope + "/adpt_attn_conv", /*stride=*/2, /*padding=*/1)
^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
_attn_layer_norm(model, scope + "/adpt_attn_layer_norm")
4 warnings generated.
2 warnings generated.
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/models/model.cc:449:25: warning: comparison of integers of different signs: 'int' and 'size_t' (aka 'unsigned long') [-Wsign-compare]
for (int i = 0; i < num; ++i) {
~ ^ ~~~
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/models/model.cc:641:25: warning: unused variable 'quantization_type' [-Wunused-variable]
QUANTIZATION_TYPE quantization_type = QUANTIZATION_TYPE::CT2;
^
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/models/model.cc:744:32: warning: comparison of integers of different signs: 'std::vector<ctranslate2::StorageView>::size_type' (aka 'unsigned long') and 'int' [-Wsign-compare]
if (outputs.size() > current_index && !outputs[current_index].empty())
~~~~~~~~~~~~~~ ^ ~~~~~~~~~~~~~
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/models/model.cc:455:17: warning: unused function 'replace' [-Wunused-function]
static bool replace(std::string& str, const std::string& from, const std::string& to) {
^
4 warnings generated.
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/ops/gemm.cc:34:9: warning: field '_b_is_packed' will be initialized after field '_activation_type' [-Wreorder-ctor]
, _b_is_packed(b_is_packed)
^~~~~~~~~~~~~~~~~~~~~~~~~
_a_is_packed(a_is_packed)
1 warning generated.
In file included from /Users/psong/LeanCopilot/.lake/build/CTranslate2/build/kernels_neon.cc:16:
In file included from /Users/psong/LeanCopilot/.lake/build/CTranslate2/src/cpu/vec_neon.h:6:
/Users/psong/LeanCopilot/.lake/build/CTranslate2/src/cpu/vec.h:148:65: warning: unused parameter 'count' [-Wunused-parameter]
static inline void convert_and_store(float v, U* a, dim_t count) {
^
1 warning generated.
ℹ [129/554] Built ModelCheckpointManager.Url
info: ././././ModelCheckpointManager/Url.lean:68:0: { protocol := "https", hostname := "huggingface.co", path := FilePath.mk "kaiyuy/ct2-leandojo-lean4-tacgen-byt5-small" }
info: ././././ModelCheckpointManager/Url.lean:69:0: { protocol := "https", hostname := "huggingface.co", path := FilePath.mk "bert-base-uncased" }
info: ././././ModelCheckpointManager/Url.lean:71:0: "ct2-leandojo-lean4-tacgen-byt5-small"
info: ././././ModelCheckpointManager/Url.lean:72:0: "bert-base-uncased"
Build completed successfully. |
After recent
Lake
updates, we found that the cloud release mechanism is not working as expected. Specifically, on some supported architectures, where Lean Copilot is expected to directly download cloud release instead of re-building, the log indicates that a building still occurs. This does not create any actual bugs because Lean Copilot should be able to build just well on these supported architectures, yet it would be great if we fix the cloud release mechanism in thelakefile
and make the process more convenient again.The text was updated successfully, but these errors were encountered: