Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Compile featurizers as part of serving computation #151

Closed
jonatanklosko opened this issue Jan 23, 2023 · 1 comment · Fixed by #244
Closed

Compile featurizers as part of serving computation #151

jonatanklosko opened this issue Jan 23, 2023 · 1 comment · Fixed by #244
Labels
kind:chore Internal improvements

Comments

@jonatanklosko
Copy link
Member

We can define featurizers in two chunks, an initial chunk that takes arbitrarily sized input of any allowed type and converts it to a normalized-size tensor, then an optional Nx chunk that does further processing. This plus some shape information should allow us to compile the Nx chunk together with the model in serving implementations.

@jonatanklosko jonatanklosko added the kind:chore Internal improvements label Jan 23, 2023
@josevalim
Copy link
Contributor

We should also include post processing in the computation too.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind:chore Internal improvements
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants