What's Changed
- Allow special tokens when encoding text for token accounting by @RyanMarten in #181
- [Package Dependency] Downgrade tiotoken and aiofiles, bump poetry package in pyproject toml by @CharlieJCJ in #183
- Re-merge main into dev by @vutrung96 in #185
- Cleanups and fix minor issues. by @madiator in #184
- Scale batch processor to managing thousands of batches by @RyanMarten in #186
- Easy way to cancel batches by @RyanMarten in #187
- litellm refactoring base online request processor by @CharlieJCJ in #188
- More retries for batch by @RyanMarten in #194
- Delete input and output files for successful batches by @RyanMarten in #195
- Add LiteLLM+instructor (for structured output) backend for curator by @CharlieJCJ in #141
- small bugfix by @RyanMarten in #199
- Increase max retry to 50 by @vutrung96 in #200
- LiteLLM missing cost handling for models by @CharlieJCJ in #210
- OnlineRequestProcessor - Fix retry only once issue by @CharlieJCJ in #202
- Implement persona-hub using Curator by @madiator in #211
- Allow user to switch keys during batch and resume by @RyanMarten in #198
- Small fix for datetime in openai request processor by @CharlieJCJ in #219
- Bump 0.1.11 pypi version by @CharlieJCJ in #221
0.1.11
by @CharlieJCJ in #220
Full Changelog: v0.1.10...v0.1.11