v2.3.1 🌈

🧭 What's Changed

• [Bug] Fix memory leak (#1523) @AbhinavTuli
• [Bug fix] Removes repeated key misses for CommitChunkSet in some old datasets (#1518) @AbhinavTuli
• Update README.md (#1498) @istranic
• Check if a dataset exists or not (Issue #1182) (#1517) @dhiganthrao
• BytePositionsEncoder fix (#1516) @farizrahman4u
• [Bug Fix] Fixes an issue with info not being updated properly outside with context (#1515) @AbhinavTuli
• Store user name in lock file (#1489) @farizrahman4u
• [AL-1678] Adds ability to rechunk tensors (#1510) @AbhinavTuli
• [Small bug fix] Pytorch + transform dict bug (#1513) @AbhinavTuli
• [AL-1679] Partial upload (#1484) @farizrahman4u
• Dataset view saving: small fix for #plat (#1508) @farizrahman4u
• Fix python shutting down error message (#1509) @farizrahman4u
• [AL-1677] Allow out of order data insertion (recommended for internal use only, will greatly impact performace if used incorrectly) (#1507) @AbhinavTuli

⚙️ Who Contributes

@AbhinavTuli, @davidbuniat, @dhiganthrao, @farizrahman4u, @istranic and @tatevikh

v2.3.0 🌈

🧭 What's Changed

• Updating installation instructions (#1506) @istranic
• [AL-1699][AL-1700] Fix indexing issues (#1502) @FayazRahman
• Fix hub compute + filter (#1504) @AbhinavTuli
• setup.py fix (#1503) @farizrahman4u

⚙️ Who Contributes

@AbhinavTuli, @FayazRahman, @davidbuniat, @farizrahman4u and @istranic

v2.2.4 🌈

🧭 What's Changed

• Remote URL read test fix: Do not test with s3 & gcs if options not enabled (#1499) @farizrahman4u
• [AL-1590] PyAV video implementation + stream large videos (#1483) @FayazRahman
• Thread leak fix (#1491) @farizrahman4u
• [AL-1649] Added coords to bbox htype (#1493) @AbhinavTuli
• [Bug fix] Pytorch + old read only datasets (#1492) @AbhinavTuli
• Update fast forwarding warning (#1496) @farizrahman4u
• Delete hub cloud datasets properly in tests (#1494) @AbhinavTuli
• Fixing jpeg2000 dosctring in compressions (#1490) @istranic
• [AL-1606] Reduce autocommits before checkout (#1485) @AbhinavTuli
• [AL-1619][AL-1586] Removes cachable, makes Info more dict like (#1469) @AbhinavTuli
• [AL-1604] hub.read() from remote URLs (#1480) @farizrahman4u
• Query fixes (#1487) @farizrahman4u
• Fix local provider keys on windows (#1486) @FayazRahman
• Adding click to requirements (#1481) @AbhinavTuli
• [AL-1668] Adds modified method to tensor (#1478) @AbhinavTuli
• Fix bad key set returned by _all_keys() (#1350) @FayazRahman
• [AL-1629] Optional dependencies + refac (#1277) @farizrahman4u
• Finalize events (#1474) @khustup
• [AL-1686] Single CSV / Pandas dataframe ingestion (#1468) @FayazRahman
• [AL-1671] Dataset locks: always warn (#1477) @farizrahman4u
• [AL-1609] API Reference Updates (#1476) @farizrahman4u
• [AL-1637] Update hub.read docstring (#1479) @farizrahman4u
• [AL-1589] Autocomplete and code highlighting (#1453) @farizrahman4u
• FFmpeg acknowledgement (#1475) @FayazRahman
• [AL-1639] Clarify diff message (#1473) @AbhinavTuli
• fixes issue #1169 (#1452) @gaurav879
• [AL-1685] Add retry for incomplete read error (#1472) @AbhinavTuli
• [AL-1590] Partial video decompression (#1466) @FayazRahman
• [AL-1655] Add .tif as alias for .tiff (#1455) @FayazRahman
• [Small] Added dtype to sample.py array method (#1470) @AbhinavTuli
• Video bug fixes (#1463) @FayazRahman

⚙️ Who Contributes

@AbhinavTuli, @FayazRahman, @davidbuniat, @farizrahman4u, @gaurav879, @istranic, @khustup and @tatevikh

v2.2.3 🌈

🧭 What's Changed

• Import huggingface only when user calls function (#1467) @FayazRahman
• [AL-1630] Better handling of S3 Timeouts (#1460) @AbhinavTuli
• Fixes overflow due to CompressedChunks leading to errors in transformed datasets (#1459) @AbhinavTuli
• [AL-1672] Add profile_name to creds argument (#1450) @AbhinavTuli
• Rename from_huggingface to ingest_huggingface (#1454) @FayazRahman
• [Al-1669] Reduce test duration (#1443) @AbhinavTuli
• Fix repeated key misses slowing down Version Controlled datasets (#1458) @AbhinavTuli
• FFmpeg with CFFI for faster video decompression (#1361) @FayazRahman
• Changed auth token request method to POST (#1440) @Diveafall
• [AL - 1596] Dataset view saving (#1380) @farizrahman4u

⚙️ Who Contributes

@AbhinavTuli, @Diveafall, @FayazRahman, @davidbuniat and @farizrahman4u

v2.2.2 🌈

🧭 What's Changed

• Fix indexing in query for blocks (#1448) @aliubimov
• Fix for memory leak in cache (#1451) @AbhinavTuli
• [AL-1626] Speedup hub load (#1442) @AbhinavTuli
• Fix wrong video shape (#1447) @FayazRahman
• Unpin numcodecs and pillow version (#1444) @farizrahman4u
• Fix CI: added new test params and gdrive opt (#1445) @gautamkrishnar
• Hugging Face to Hub converter (#1390) @FayazRahman

⚙️ Who Contributes

@AbhinavTuli, @FayazRahman, @aliubimov, @davidbuniat, @farizrahman4u, @gautamkrishnar and @tatevikh

v2.2.1 🌈

🧭 What's Changed

• Fix indexing and groups (#1426) @aliubimov
• Tweak tile encoder format (#1435) @AbhinavTuli
• Remove explicit shared memory conversion (#1437) @aliubimov
• Fix tiling + pytorch (#1427) @AbhinavTuli
• Distributed data parallel loader (#1412) @aliubimov
• Rewrite query (#1415) @aliubimov
• Fix RCE in video decompression (#1425) @farizrahman4u
• Enable intellisense for hub compute functions (#1419) @AbhinavTuli
• [Bug Fix] Stop accessing underlying storage for checking encoder existence (#1417) @AbhinavTuli
• Video bug fix (#1349) @farizrahman4u
• Fix windows pickling issue (#1421) @farizrahman4u
• Delete old pytorch impl (#1420) @farizrahman4u
• [AL-1610] Json VC Info (#1413) @farizrahman4u
• removing hub_shm since it is no longer required (#1418) @gautamkrishnar
• [AL-1613][AL-1549] Send events from Hub to Platform (#1406) @AbhinavTuli
• [AL-1621] Add skip_ok to hub compute (#1409) @AbhinavTuli
• [AL-1615][AL-1612] Speedup inplace transform (#1396) @AbhinavTuli
• [Bug fix] Fix pytorch + version control (#1410) @AbhinavTuli
• [AL-1631] Commit with custom hash (#1408) @farizrahman4u
• Fix typo in README.md (#1411) @fabioperez
• [AL-1579] Auto htype (#1370) @farizrahman4u

⚙️ Who Contributes

@AbhinavTuli, @aliubimov, @davidbuniat, @fabioperez, @farizrahman4u, @gautamkrishnar and @mikayelh

v2.2.0 🎅

🧭 What's Changed

• Make decorated functions work with filter (#1407) @AbhinavTuli
• Tensor/group deletion perf fix + corruption proofing (#1404) @farizrahman4u
• [AL1571] Clearning unused chunks (#1358) @aliubimov
• Faster query (#1403) @aliubimov
• ds.append (#1351) @farizrahman4u
• [AL-1597] Use alternate implementation of progress bar for Hub compute (#1393) @AbhinavTuli
• Delete tensor / tensor group from dataset (#1256) @FayazRahman
• [AL-1443] Tiling + Slicing + Updating (#1374) @farizrahman4u
• [AL-1519] Fix read only issue after pickling dataset/storage provider (#1394) @AbhinavTuli
• [AL-1592] Changes version control outputs (#1391) @AbhinavTuli
• [AL-1574] Fast chunk compression (#1366) @farizrahman4u
• Compresses Diff format and fix diff bug in Transforms (#1379) @AbhinavTuli
• Update README.md (#1395) @istranic
• Version control locking (#1343) @farizrahman4u
• Tensor pass through (#1353) @farizrahman4u
• [AL-1331] Api reference updates (#1384) @AbhinavTuli
• Updated pytorch portion of readme (#1389) @istranic
• Reduces flushes during commit/checkout (#1381) @AbhinavTuli
• Add pytorch training example to readme (#1382) @farizrahman4u
• Groups + Transforms (#1333) @farizrahman4u
• Fix info not getting updated across versions (#1356) @AbhinavTuli
• moved bugout token to a file for better CD support (#1373) @gautamkrishnar
• [AL-1598] Added more APIs for VC (#1371) @AbhinavTuli
• [AL-1578] Simplify stack traces for authentication errors (#1344) @aliubimov
• [AL-1587] Fix iteration slowdowns and import issue (#1368) @AbhinavTuli
• removed hacktoberfest banner (#1362) @gautamkrishnar
• [AL-1591] Add visualizer link when loading hub datasets (#1367) @farizrahman4u
• Tiling Support for large samples (#1331) @AbhinavTuli
• Image compression: don't decompress while compressing (#1363) @farizrahman4u
• [AL-1418] Fix error when extending with empty list (#1365) @farizrahman4u
• [AL-1565] Filtering with simple query language (#1352) @aliubimov
• fixed typo (#1360) @istranic
• Added version control diff (#1345) @AbhinavTuli

⚙️ Who Contributes

@AbhinavTuli, @FayazRahman, @aliubimov, @davidbuniat, @farizrahman4u, @gautamkrishnar, @istranic, @mikayelh and @tatevikh

v2.1.1 🌈

🧭 What's Changed

• [AL-1132] Added the ability to do inplace transforms (#1354) @AbhinavTuli
• Pytorch transform api (#1337) @AbhinavTuli
• Chunk engine and chunk refactor (#1307) @AbhinavTuli
• Fix hub list deletion (#1340) @AbhinavTuli
• Autocast empty samples (#1334) @farizrahman4u
• Fix to ensure agreement isn't reloaded for each slice of dataset (#1347) @AbhinavTuli
• added bench repo branch input, set units as default (#1348) @gautamkrishnar
• [tiny] let users load datasets from newer versions of hub (#1306) @nollied
• Fixes pytorch with text (#1342) @AbhinavTuli
• minor bug fix for the benchmark code (#1332) @gautamkrishnar
• Added statement in Version Control log when uncommitted data is present (#1328) @AbhinavTuli
• Fix "NumPy array is not writeable" (#1338) @aliubimov
• Fix leaked semaphore issue on mac (#1291) @AbhinavTuli

⚙️ Who Contributes

@AbhinavTuli, @aliubimov, @davidbuniat, @farizrahman4u, @gautamkrishnar, @mikayelh, @nollied and @tatevikh

v2.1.0 🌈

🧭 What's Changed

• Default shuffle buffer size 2GB (#1330) @aliubimov
• bug_report.md typo and README Badge fix (#1302) @qzylalala
• Bye Bye CircleCI (#1329) @farizrahman4u
• Refactor pytorch integration (#1257) @aliubimov
• Fixes slowdowns with Hub (#1304) @AbhinavTuli
• Added text signwall within Hub (#1323) @AbhinavTuli
• Readme typo (#1299) @farizrahman4u
• Update README.md (#1322) @istranic
• Fixes bug with groups on hub cloud datasets (#1321) @AbhinavTuli
• simplify Github actions (#1318) @gautamkrishnar
• Progressbar + bad transform hanging fix (#1295) @farizrahman4u
• Video (#1216) @FayazRahman
• Changing default dataset setting from public to private (#1317) @istranic
• Add GitHub actions (#1241) @araratpoghosyan
• enable str objects to be converted to tensorflow (#1309) @hoshimura
• Persistence fix (#1298) @farizrahman4u
• Fix/cloud dataset bugs (#1294) @nollied
• [tiny] fix formatting + update keypointscoco to int32 instead of float (#1272) @nollied
• Removed overwrite and public arguments from hub.load (#1275) @AbhinavTuli
• Jpeg fix issue with verify (#1297) @farizrahman4u
• hub.delete + logging fixes (#1278) @farizrahman4u
• Feature/add docker compose (#1250) @davidbuniat
• Tensor.bytes() (#1280) @farizrahman4u
• Add class_names as an option to segment_mask htype (#1281) @farizrahman4u
• Fix grayscale warnings + hub.read docstring (#1289) @farizrahman4u
• Better retries for s3 (#1283) @AbhinavTuli
• Byte compression + empty sample fix (#1293) @farizrahman4u
• Readme updates (#1265) @farizrahman4u
• refactor core/Dataset (#1284) @nollied
• Add token to hub list (#1276) @AbhinavTuli
• Add pytest fixture decorator to test_gcs_tokens (#1285) @dhiganthrao
• Progress bar for hub.eval (#1200) @farizrahman4u
• hub/compression.py dosctring update (#1279) @farizrahman4u
• Better error message for invalid dataset (#1282) @farizrahman4u

⚙️ Who Contributes

@AbhinavTuli, @FayazRahman, @aliubimov, @araratpoghosyan, @davidbuniat, @dhiganthrao, @farizrahman4u, @gautamkrishnar, @hoshimura, @istranic, @mikayelh, @nollied, @qzylalala and @tatevikh

v2.0.13 🌈

🧭 What's Changed

• added improvements and regressions as artifacts (#1255) @gautamkrishnar
• Fixes empty samples in hub compute (#1269) @AbhinavTuli
• [2 liner] TorchDataset.len (#1268) @mccrearyd
• Fix creating nested tensor from non-head node (#1261) @FayazRahman
• fix text not working for transforms (#1258) @mccrearyd
• [Tiny] Updated htype docstring for segment mask (#1264) @istranic
• Added coco_keypoint htype and changed default dtype for segment masks (#1262) @istranic
• Groups perf fix (#1212) @farizrahman4u
• Jpeg: External test images repo + small fixes (#1249) @farizrahman4u
• Json, List, Text (#1214) @farizrahman4u
• fix pytest dependency error (#1254) @mccrearyd
• PNG compression for arbitrary number of channels (#1252) @farizrahman4u
• [tiny] tqdm progress bar for pytorch (#1243) @mccrearyd

🔗 Dependency Updates

• Bump pillow from 8.2.0 to 8.3.2 in /hub/requirements (#1151) @dependabot

⚙️ Who Contributes

@AbhinavTuli, @FayazRahman, @davidbuniat, @dependabot, @farizrahman4u, @gautamkrishnar, @istranic and @mccrearyd