Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

epic: improve model encoding compression 💾 #12293

Draft
wants to merge 69 commits into
base: master
Choose a base branch
from

Conversation

mcdurdin
Copy link
Member

@mcdurdin mcdurdin commented Aug 27, 2024

jahorton added 30 commits July 2, 2024 11:24
…ssion

Aims for a UCS-2 encoded string and does not shy away from unpaired surrogates in the encoding.
… code

When a leaf node exists at the same Trie location as an internal node, it should be a child of that internal node using SENTINEL_CODE_UNIT
(\ufdd0).  The fixture was using null/undefined instead!
…on/models/templates

We'll likely want to dynamically build a Trie to represent user-specific entries made available by the active OS.  We'll then blend _that_ with the 'static' distributed model.
…ruction' into refactor/common/models/trie-construction-cntd
…ruction-cntd' into change/common/models/trie-construction-cleanup
…ie-construction-cleanup' into feat/common/models/templates/trie-compression-start
jahorton and others added 5 commits August 27, 2024 14:44
…/trie-compression-start

feat(common/models): add Trie string-encoding + decoding methods 💾
…/integrate-trie-compression

feat(common/models): integrate new trie decoding methods into predictive-text engine 💾
…iled-tries

feat(developer): output new TrieModel format when compiling 💾
@jahorton
Copy link
Contributor

TODO:

  • consider some form of versioning on the Trie format

@github-actions github-actions bot added common/ and removed common/ labels Sep 15, 2024
@github-actions github-actions bot added common/ and removed common/ labels Oct 11, 2024
@github-actions github-actions bot added common/ and removed common/ labels Oct 25, 2024
@github-actions github-actions bot added common/ and removed common/ labels Nov 10, 2024
@github-actions github-actions bot added common/ and removed common/ labels Dec 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: No status
Development

Successfully merging this pull request may close these issues.

2 participants