Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

notebook "llm rag llama-index" fail to initial #2587

Open
JamieVC opened this issue Dec 10, 2024 · 2 comments
Open

notebook "llm rag llama-index" fail to initial #2587

JamieVC opened this issue Dec 10, 2024 · 2 comments

Comments

@JamieVC
Copy link

JamieVC commented Dec 10, 2024

To compare multiple LLM models to OEM/ODM, we are running this sample.

  1. install new env based on openvino guide: https://github.com/openvinotoolkit/openvino_notebooks/wiki/Windows
  2. run >jupyter lab notebooks\llm-rag-llamaindex\llm-rag-llamaindex.ipynb
  3. run the first section in https://github.com/openvinotoolkit/openvino_notebooks/blob/latest/notebooks/llm-rag-llamaindex/llm-rag-llamaindex.ipynb

-error log-

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
gradio 5.8.0 requires huggingface-hub>=0.25.1, but you have huggingface-hub 0.23.5 which is incompatible.
llama-index-embeddings-openvino 0.5.0 requires llama-index-core<0.13.0,>=0.12.0, but you have llama-index-core 0.11.23 which is incompatible.
llama-index-embeddings-openvino 0.5.0 requires llama-index-embeddings-huggingface<0.5.0,>=0.4.0, but you have llama-index-embeddings-huggingface 0.3.1 which is incompatible.
llama-index-llms-openvino 0.4.0 requires llama-index-core<0.13.0,>=0.12.0, but you have llama-index-core 0.11.23 which is incompatible.
llama-index-llms-openvino 0.4.0 requires llama-index-llms-huggingface<0.5.0,>=0.4.0, but you have llama-index-llms-huggingface 0.3.3 which is incompatible.
llama-index-postprocessor-openvino-rerank 0.4.0 requires llama-index-core<0.13.0,>=0.12.0, but you have llama-index-core 0.11.23 which is incompatible.
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
llama-index-embeddings-openvino 0.5.0 requires huggingface-hub<0.24.0,>=0.23.0, but you have huggingface-hub 0.26.5 which is incompatible.
llama-index-embeddings-openvino 0.5.0 requires llama-index-core<0.13.0,>=0.12.0, but you have llama-index-core 0.11.23 which is incompatible.
llama-index-embeddings-openvino 0.5.0 requires llama-index-embeddings-huggingface<0.5.0,>=0.4.0, but you have llama-index-embeddings-huggingface 0.3.1 which is incompatible.
llama-index-llms-huggingface 0.3.3 requires huggingface-hub<0.24.0,>=0.23.0, but you have huggingface-hub 0.26.5 which is incompatible.
llama-index-llms-openvino 0.4.0 requires llama-index-core<0.13.0,>=0.12.0, but you have llama-index-core 0.11.23 which is incompatible.
llama-index-llms-openvino 0.4.0 requires llama-index-llms-huggingface<0.5.0,>=0.4.0, but you have llama-index-llms-huggingface 0.3.3 which is incompatible.
llama-index-postprocessor-openvino-rerank 0.4.0 requires huggingface-hub<0.24.0,>=0.23.0, but you have huggingface-hub 0.26.5 which is incompatible.
llama-index-postprocessor-openvino-rerank 0.4.0 requires llama-index-core<0.13.0,>=0.12.0, but you have llama-index-core 0.11.23 which is incompatible.
Looking in indexes: https://pypi.org/simple, https://storage.openvinotoolkit.org/simple/wheels/nightly
Requirement already satisfied: openvino>=2024.2 in c:\windows\system32\openvino_env\lib\site-packages (2025.0.0.dev20241209)
Requirement already satisfied: numpy<2.2.0,>=1.16.6 in c:\windows\system32\openvino_env\lib\site-packages (from openvino>=2024.2) (1.26.4)
Requirement already satisfied: openvino-telemetry>=2023.2.1 in c:\windows\system32\openvino_env\lib\site-packages (from openvino>=2024.2) (2024.5.0)
Requirement already satisfied: packaging in c:\windows\system32\openvino_env\lib\site-packages (from openvino>=2024.2) (24.2)
Looking in indexes: https://pypi.org/simple, https://storage.openvinotoolkit.org/simple/wheels/nightly
Requirement already satisfied: openvino-tokenizers>=2024.2 in c:\windows\system32\openvino_env\lib\site-packages (from openvino-tokenizers[transformers]>=2024.2) (2025.0.0.0.dev20241209)
Requirement already satisfied: openvino~=2025.0.0.dev in c:\windows\system32\openvino_env\lib\site-packages (from openvino-tokenizers>=2024.2->openvino-tokenizers[transformers]>=2024.2) (2025.0.0.dev20241209)
Requirement already satisfied: transformers>=4.36.0 in c:\windows\system32\openvino_env\lib\site-packages (from transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (4.46.3)
Requirement already satisfied: tiktoken in c:\windows\system32\openvino_env\lib\site-packages (from openvino-tokenizers[transformers]>=2024.2) (0.8.0)
Requirement already satisfied: numpy<2.2.0,>=1.16.6 in c:\windows\system32\openvino_env\lib\site-packages (from openvino~=2025.0.0.dev->openvino-tokenizers>=2024.2->openvino-tokenizers[transformers]>=2024.2) (1.26.4)
Requirement already satisfied: openvino-telemetry>=2023.2.1 in c:\windows\system32\openvino_env\lib\site-packages (from openvino~=2025.0.0.dev->openvino-tokenizers>=2024.2->openvino-tokenizers[transformers]>=2024.2) (2024.5.0)
Requirement already satisfied: packaging in c:\windows\system32\openvino_env\lib\site-packages (from openvino~=2025.0.0.dev->openvino-tokenizers>=2024.2->openvino-tokenizers[transformers]>=2024.2) (24.2)
Requirement already satisfied: filelock in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (3.16.1)
Requirement already satisfied: huggingface-hub<1.0,>=0.23.2 in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (0.26.5)
Requirement already satisfied: pyyaml>=5.1 in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (6.0.2)
Requirement already satisfied: regex!=2019.12.17 in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (2024.11.6)
Requirement already satisfied: requests in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (2.32.3)
Requirement already satisfied: tokenizers<0.21,>=0.20 in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (0.20.3)
Requirement already satisfied: safetensors>=0.4.1 in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (0.4.5)
Requirement already satisfied: tqdm>=4.27 in c:\windows\system32\openvino_env\lib\site-packages (from transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (4.67.1)
Requirement already satisfied: sentencepiece!=0.1.92,>=0.1.91 in c:\windows\system32\openvino_env\lib\site-packages (from transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (0.2.0)
Requirement already satisfied: protobuf in c:\windows\system32\openvino_env\lib\site-packages (from transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (5.29.1)
Requirement already satisfied: fsspec>=2023.5.0 in c:\windows\system32\openvino_env\lib\site-packages (from huggingface-hub<1.0,>=0.23.2->transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (2024.9.0)
Requirement already satisfied: typing-extensions>=3.7.4.3 in c:\windows\system32\openvino_env\lib\site-packages (from huggingface-hub<1.0,>=0.23.2->transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (4.12.2)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\windows\system32\openvino_env\lib\site-packages (from requests->transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (3.4.0)
Requirement already satisfied: idna<4,>=2.5 in c:\windows\system32\openvino_env\lib\site-packages (from requests->transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (3.10)
Requirement already satisfied: urllib3<3,>=1.21.1 in c:\windows\system32\openvino_env\lib\site-packages (from requests->transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (2.2.3)
Requirement already satisfied: certifi>=2017.4.17 in c:\windows\system32\openvino_env\lib\site-packages (from requests->transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (2024.8.30)
Requirement already satisfied: colorama in c:\windows\system32\openvino_env\lib\site-packages (from tqdm>=4.27->transformers>=4.36.0->transformers[sentencepiece]>=4.36.0; extra == "transformers"->openvino-tokenizers[transformers]>=2024.2) (0.4.6)
@brmarkus
Copy link

brmarkus commented Dec 10, 2024

Can you try to create a new (not used before) Python virtual environment, activate it and run the notebook again from within the activated Python virtual environment?
Which OS, which version of Python do you use?

@Wilson120603
Copy link

Wilson120603 commented Dec 11, 2024

Can you try to create a new (not used before) Python virtual environment, activate it and run the notebook again from within the activated Python virtual environment? Which OS, which version of Python do you use?

Hi
OS version is 24H2 26100.2314 and python version is 3.10.11
We've tried to delete openvino_env and openvino_notebooks folder under C:\Windows\System32 and re-download with step then still pop out same failure.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants