[AL-1574] Fast chunk compression

[farizrahman4u]

🚀 🚀 Pull Request

Checklist:

• My code follows the style guidelines of this project and the Contributing document
• I have commented my code, particularly in hard-to-understand areas
• I have kept the coverage-rate up
• I have performed a self-review of my own code and resolved any problems
• I have checked to ensure there aren't any other open Pull Requests for the same change
• I have described and made corresponding changes to the relevant documentation
• New and existing unit tests pass locally with my changes

Changes

Speed up chunk compression by predicting length of compressed bytes using an adaptive compression ratio.
https://activeloop.atlassian.net/browse/AL-1574

[CLAassistant]

All committers have signed the CLA.

[codecov]

Codecov Report

Merging #1366 (3f9abcb) into main (9aa892e) will increase coverage by 0.03%.
The diff coverage is 97.58%.

❗ Current head 3f9abcb differs from pull request most recent head 831b7a4. Consider uploading reports for the commit 831b7a4 to get more accurate results

@@            Coverage Diff             @@
##             main    #1366      +/-   ##
==========================================
+ Coverage   92.23%   92.27%   +0.03%     
==========================================
  Files         174      174              
  Lines       12706    12758      +52     
==========================================
+ Hits        11720    11772      +52     
  Misses        986      986              

Flag	Coverage Δ
unittests	92.27% <97.58%> (+0.03%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
hub/core/chunk/chunk_compressed_chunk.py	98.15% <96.80%> (+0.50%)	⬆️
hub/api/tests/test_api_tiling.py	100.00% <100.00%> (ø)
hub/core/chunk/base_chunk.py	98.02% <100.00%> (+0.08%)	⬆️
hub/core/chunk/sample_compressed_chunk.py	98.18% <100.00%> (+0.06%)	⬆️
hub/core/chunk/test_chunk_compressed.py	98.95% <100.00%> (+0.05%)	⬆️
hub/core/compression.py	87.33% <100.00%> (+0.04%)	⬆️
hub/core/meta/encode/base_encoder.py	98.32% <100.00%> (+0.01%)	⬆️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9aa892e...831b7a4. Read the comment docs.

[AbhinavTuli]

Some changes + codecov

[aliubimov]

Fix coverage