Package versioning downgrade for colab

[CharlieJCJ]

Closes #30

The log for colab

!pip install bespokelabs-curator==0.1.7rc1

Collecting bespokelabs-curator==0.1.7rc1
  Downloading bespokelabs_curator-0.1.7rc1-py3-none-any.whl.metadata (3.2 kB)
Collecting aiofiles<25.0.0,>=24.1.0 (from bespokelabs-curator==0.1.7rc1)
  Downloading aiofiles-24.1.0-py3-none-any.whl.metadata (10 kB)
Collecting datasets<4.0.0,>=3.0.2 (from bespokelabs-curator==0.1.7rc1)
  Downloading datasets-3.1.0-py3-none-any.whl.metadata (20 kB)
Collecting instructor<2.0.0,>=1.6.3 (from bespokelabs-curator==0.1.7rc1)
  Downloading instructor-1.6.3-py3-none-any.whl.metadata (17 kB)
Collecting matplotlib<4.0.0,>=3.9.2 (from bespokelabs-curator==0.1.7rc1)
  Downloading matplotlib-3.9.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB)
Requirement already satisfied: pandas==2.2.2 in /usr/local/lib/python3.10/dist-packages (from bespokelabs-curator==0.1.7rc1) (2.2.2)
Requirement already satisfied: pydantic>=2.9.2 in /usr/local/lib/python3.10/dist-packages (from bespokelabs-curator==0.1.7rc1) (2.9.2)
Requirement already satisfied: pytest<9.0.0,>=8.3.3 in /usr/local/lib/python3.10/dist-packages (from bespokelabs-curator==0.1.7rc1) (8.3.3)
Collecting pytest-asyncio<0.25.0,>=0.24.0 (from bespokelabs-curator==0.1.7rc1)
  Downloading pytest_asyncio-0.24.0-py3-none-any.whl.metadata (3.9 kB)
Collecting tiktoken<0.9.0,>=0.8.0 (from bespokelabs-curator==0.1.7rc1)
  Downloading tiktoken-0.8.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.6 kB)
Collecting tqdm<5.0.0,>=4.67.0 (from bespokelabs-curator==0.1.7rc1)
  Downloading tqdm-4.67.0-py3-none-any.whl.metadata (57 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.6/57.6 kB 1.7 MB/s eta 0:00:00
Collecting xxhash<4.0.0,>=3.5.0 (from bespokelabs-curator==0.1.7rc1)
  Downloading xxhash-3.5.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (12 kB)
Requirement already satisfied: numpy>=1.22.4 in /usr/local/lib/python3.10/dist-packages (from pandas==2.2.2->bespokelabs-curator==0.1.7rc1) (1.26.4)
Requirement already satisfied: python-dateutil>=2.8.2 in /usr/local/lib/python3.10/dist-packages (from pandas==2.2.2->bespokelabs-curator==0.1.7rc1) (2.8.2)
Requirement already satisfied: pytz>=2020.1 in /usr/local/lib/python3.10/dist-packages (from pandas==2.2.2->bespokelabs-curator==0.1.7rc1) (2024.2)
Requirement already satisfied: tzdata>=2022.7 in /usr/local/lib/python3.10/dist-packages (from pandas==2.2.2->bespokelabs-curator==0.1.7rc1) (2024.2)
Requirement already satisfied: filelock in /usr/local/lib/python3.10/dist-packages (from datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1) (3.16.1)
Requirement already satisfied: pyarrow>=15.0.0 in /usr/local/lib/python3.10/dist-packages (from datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1) (17.0.0)
Collecting dill<0.3.9,>=0.3.0 (from datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1)
  Downloading dill-0.3.8-py3-none-any.whl.metadata (10 kB)
Requirement already satisfied: requests>=2.32.2 in /usr/local/lib/python3.10/dist-packages (from datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1) (2.32.3)
Collecting multiprocess<0.70.17 (from datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1)
  Downloading multiprocess-0.70.16-py310-none-any.whl.metadata (7.2 kB)
Collecting fsspec<=2024.9.0,>=2023.1.0 (from fsspec[http]<=2024.9.0,>=2023.1.0->datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1)
  Downloading fsspec-2024.9.0-py3-none-any.whl.metadata (11 kB)
Requirement already satisfied: aiohttp in /usr/local/lib/python3.10/dist-packages (from datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1) (3.10.10)
Requirement already satisfied: huggingface-hub>=0.23.0 in /usr/local/lib/python3.10/dist-packages (from datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1) (0.26.2)
Requirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1) (24.2)
Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.10/dist-packages (from datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1) (6.0.2)
Requirement already satisfied: docstring-parser<0.17,>=0.16 in /usr/local/lib/python3.10/dist-packages (from instructor<2.0.0,>=1.6.3->bespokelabs-curator==0.1.7rc1) (0.16)
Requirement already satisfied: jinja2<4.0.0,>=3.1.4 in /usr/local/lib/python3.10/dist-packages (from instructor<2.0.0,>=1.6.3->bespokelabs-curator==0.1.7rc1) (3.1.4)
Collecting jiter<0.6.0,>=0.5.0 (from instructor<2.0.0,>=1.6.3->bespokelabs-curator==0.1.7rc1)
  Downloading jiter-0.5.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.6 kB)
Requirement already satisfied: openai<2.0.0,>=1.52.0 in /usr/local/lib/python3.10/dist-packages (from instructor<2.0.0,>=1.6.3->bespokelabs-curator==0.1.7rc1) (1.54.3)
Requirement already satisfied: pydantic-core<3.0.0,>=2.18.0 in /usr/local/lib/python3.10/dist-packages (from instructor<2.0.0,>=1.6.3->bespokelabs-curator==0.1.7rc1) (2.23.4)
Requirement already satisfied: rich<14.0.0,>=13.7.0 in /usr/local/lib/python3.10/dist-packages (from instructor<2.0.0,>=1.6.3->bespokelabs-curator==0.1.7rc1) (13.9.4)
Requirement already satisfied: tenacity<10.0.0,>=9.0.0 in /usr/local/lib/python3.10/dist-packages (from instructor<2.0.0,>=1.6.3->bespokelabs-curator==0.1.7rc1) (9.0.0)
Requirement already satisfied: typer<1.0.0,>=0.9.0 in /usr/local/lib/python3.10/dist-packages (from instructor<2.0.0,>=1.6.3->bespokelabs-curator==0.1.7rc1) (0.13.0)
Requirement already satisfied: contourpy>=1.0.1 in /usr/local/lib/python3.10/dist-packages (from matplotlib<4.0.0,>=3.9.2->bespokelabs-curator==0.1.7rc1) (1.3.0)
Requirement already satisfied: cycler>=0.10 in /usr/local/lib/python3.10/dist-packages (from matplotlib<4.0.0,>=3.9.2->bespokelabs-curator==0.1.7rc1) (0.12.1)
Requirement already satisfied: fonttools>=4.22.0 in /usr/local/lib/python3.10/dist-packages (from matplotlib<4.0.0,>=3.9.2->bespokelabs-curator==0.1.7rc1) (4.54.1)
Requirement already satisfied: kiwisolver>=1.3.1 in /usr/local/lib/python3.10/dist-packages (from matplotlib<4.0.0,>=3.9.2->bespokelabs-curator==0.1.7rc1) (1.4.7)
Requirement already satisfied: pillow>=8 in /usr/local/lib/python3.10/dist-packages (from matplotlib<4.0.0,>=3.9.2->bespokelabs-curator==0.1.7rc1) (11.0.0)
Requirement already satisfied: pyparsing>=2.3.1 in /usr/local/lib/python3.10/dist-packages (from matplotlib<4.0.0,>=3.9.2->bespokelabs-curator==0.1.7rc1) (3.2.0)
Requirement already satisfied: annotated-types>=0.6.0 in /usr/local/lib/python3.10/dist-packages (from pydantic>=2.9.2->bespokelabs-curator==0.1.7rc1) (0.7.0)
Requirement already satisfied: typing-extensions>=4.6.1 in /usr/local/lib/python3.10/dist-packages (from pydantic>=2.9.2->bespokelabs-curator==0.1.7rc1) (4.12.2)
Requirement already satisfied: iniconfig in /usr/local/lib/python3.10/dist-packages (from pytest<9.0.0,>=8.3.3->bespokelabs-curator==0.1.7rc1) (2.0.0)
Requirement already satisfied: pluggy<2,>=1.5 in /usr/local/lib/python3.10/dist-packages (from pytest<9.0.0,>=8.3.3->bespokelabs-curator==0.1.7rc1) (1.5.0)
Requirement already satisfied: exceptiongroup>=1.0.0rc8 in /usr/local/lib/python3.10/dist-packages (from pytest<9.0.0,>=8.3.3->bespokelabs-curator==0.1.7rc1) (1.2.2)
Requirement already satisfied: tomli>=1 in /usr/local/lib/python3.10/dist-packages (from pytest<9.0.0,>=8.3.3->bespokelabs-curator==0.1.7rc1) (2.0.2)
Requirement already satisfied: regex>=2022.1.18 in /usr/local/lib/python3.10/dist-packages (from tiktoken<0.9.0,>=0.8.0->bespokelabs-curator==0.1.7rc1) (2024.9.11)
Requirement already satisfied: aiohappyeyeballs>=2.3.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1) (2.4.3)
Requirement already satisfied: aiosignal>=1.1.2 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1) (1.3.1)
Requirement already satisfied: attrs>=17.3.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1) (24.2.0)
Requirement already satisfied: frozenlist>=1.1.1 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1) (1.5.0)
Requirement already satisfied: multidict<7.0,>=4.5 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1) (6.1.0)
Requirement already satisfied: yarl<2.0,>=1.12.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1) (1.17.1)
Requirement already satisfied: async-timeout<5.0,>=4.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1) (4.0.3)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.10/dist-packages (from jinja2<4.0.0,>=3.1.4->instructor<2.0.0,>=1.6.3->bespokelabs-curator==0.1.7rc1) (3.0.2)
Requirement already satisfied: anyio<5,>=3.5.0 in /usr/local/lib/python3.10/dist-packages (from openai<2.0.0,>=1.52.0->instructor<2.0.0,>=1.6.3->bespokelabs-curator==0.1.7rc1) (3.7.1)
Requirement already satisfied: distro<2,>=1.7.0 in /usr/local/lib/python3.10/dist-packages (from openai<2.0.0,>=1.52.0->instructor<2.0.0,>=1.6.3->bespokelabs-curator==0.1.7rc1) (1.9.0)
Requirement already satisfied: httpx<1,>=0.23.0 in /usr/local/lib/python3.10/dist-packages (from openai<2.0.0,>=1.52.0->instructor<2.0.0,>=1.6.3->bespokelabs-curator==0.1.7rc1) (0.27.2)
Requirement already satisfied: sniffio in /usr/local/lib/python3.10/dist-packages (from openai<2.0.0,>=1.52.0->instructor<2.0.0,>=1.6.3->bespokelabs-curator==0.1.7rc1) (1.3.1)
Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.10/dist-packages (from python-dateutil>=2.8.2->pandas==2.2.2->bespokelabs-curator==0.1.7rc1) (1.16.0)
Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests>=2.32.2->datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1) (3.4.0)
Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/dist-packages (from requests>=2.32.2->datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1) (3.10)
Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests>=2.32.2->datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1) (2.2.3)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests>=2.32.2->datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1) (2024.8.30)
Requirement already satisfied: markdown-it-py>=2.2.0 in /usr/local/lib/python3.10/dist-packages (from rich<14.0.0,>=13.7.0->instructor<2.0.0,>=1.6.3->bespokelabs-curator==0.1.7rc1) (3.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /usr/local/lib/python3.10/dist-packages (from rich<14.0.0,>=13.7.0->instructor<2.0.0,>=1.6.3->bespokelabs-curator==0.1.7rc1) (2.18.0)
Requirement already satisfied: click>=8.0.0 in /usr/local/lib/python3.10/dist-packages (from typer<1.0.0,>=0.9.0->instructor<2.0.0,>=1.6.3->bespokelabs-curator==0.1.7rc1) (8.1.7)
Requirement already satisfied: shellingham>=1.3.0 in /usr/local/lib/python3.10/dist-packages (from typer<1.0.0,>=0.9.0->instructor<2.0.0,>=1.6.3->bespokelabs-curator==0.1.7rc1) (1.5.4)
Requirement already satisfied: httpcore==1.* in /usr/local/lib/python3.10/dist-packages (from httpx<1,>=0.23.0->openai<2.0.0,>=1.52.0->instructor<2.0.0,>=1.6.3->bespokelabs-curator==0.1.7rc1) (1.0.6)
Requirement already satisfied: h11<0.15,>=0.13 in /usr/local/lib/python3.10/dist-packages (from httpcore==1.*->httpx<1,>=0.23.0->openai<2.0.0,>=1.52.0->instructor<2.0.0,>=1.6.3->bespokelabs-curator==0.1.7rc1) (0.14.0)
Requirement already satisfied: mdurl~=0.1 in /usr/local/lib/python3.10/dist-packages (from markdown-it-py>=2.2.0->rich<14.0.0,>=13.7.0->instructor<2.0.0,>=1.6.3->bespokelabs-curator==0.1.7rc1) (0.1.2)
Requirement already satisfied: propcache>=0.2.0 in /usr/local/lib/python3.10/dist-packages (from yarl<2.0,>=1.12.0->aiohttp->datasets<4.0.0,>=3.0.2->bespokelabs-curator==0.1.7rc1) (0.2.0)
Downloading bespokelabs_curator-0.1.7rc1-py3-none-any.whl (1.1 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 14.4 MB/s eta 0:00:00
Downloading aiofiles-24.1.0-py3-none-any.whl (15 kB)
Downloading datasets-3.1.0-py3-none-any.whl (480 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 480.6/480.6 kB 14.6 MB/s eta 0:00:00
Downloading instructor-1.6.3-py3-none-any.whl (69 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 69.4/69.4 kB 2.8 MB/s eta 0:00:00
Downloading matplotlib-3.9.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (8.3 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8.3/8.3 MB 50.0 MB/s eta 0:00:00
Downloading pytest_asyncio-0.24.0-py3-none-any.whl (18 kB)
Downloading tiktoken-0.8.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 29.5 MB/s eta 0:00:00
Downloading tqdm-4.67.0-py3-none-any.whl (78 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.6/78.6 kB 2.8 MB/s eta 0:00:00
Downloading xxhash-3.5.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (194 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 194.1/194.1 kB 7.1 MB/s eta 0:00:00
Downloading dill-0.3.8-py3-none-any.whl (116 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 116.3/116.3 kB 4.6 MB/s eta 0:00:00
Downloading fsspec-2024.9.0-py3-none-any.whl (179 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 179.3/179.3 kB 6.1 MB/s eta 0:00:00
Downloading jiter-0.5.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (318 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 318.9/318.9 kB 11.8 MB/s eta 0:00:00
Downloading multiprocess-0.70.16-py310-none-any.whl (134 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 134.8/134.8 kB 4.9 MB/s eta 0:00:00
Installing collected packages: xxhash, tqdm, jiter, fsspec, dill, aiofiles, tiktoken, pytest-asyncio, multiprocess, matplotlib, instructor, datasets, bespokelabs-curator
  Attempting uninstall: tqdm
    Found existing installation: tqdm 4.66.6
    Uninstalling tqdm-4.66.6:
      Successfully uninstalled tqdm-4.66.6
  Attempting uninstall: jiter
    Found existing installation: jiter 0.7.0
    Uninstalling jiter-0.7.0:
      Successfully uninstalled jiter-0.7.0
  Attempting uninstall: fsspec
    Found existing installation: fsspec 2024.10.0
    Uninstalling fsspec-2024.10.0:
      Successfully uninstalled fsspec-2024.10.0
  Attempting uninstall: matplotlib
    Found existing installation: matplotlib 3.8.0
    Uninstalling matplotlib-3.8.0:
      Successfully uninstalled matplotlib-3.8.0
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
gcsfs 2024.10.0 requires fsspec==2024.10.0, but you have fsspec 2024.9.0 which is incompatible.
Successfully installed aiofiles-24.1.0 bespokelabs-curator-0.1.7rc1 datasets-3.1.0 dill-0.3.8 fsspec-2024.9.0 instructor-1.6.3 jiter-0.5.0 matplotlib-3.9.2 multiprocess-0.70.16 pytest-asyncio-0.24.0 tiktoken-0.8.0 tqdm-4.67.0 xxhash-3.5.0

[CharlieJCJ]

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
gcsfs 2024.10.0 requires fsspec==2024.10.0, but you have fsspec 2024.9.0 which is incompatible.

this is a colab specific warning, I don't think we need to add additional package to revert this colab complaint. the other dependencies are installed correctly