Skip to content

Commit

Permalink
Add tgis-vllm adapter with adapter/#137
Browse files Browse the repository at this point in the history
Signed-off-by: Jefferson Fialho <[email protected]>
  • Loading branch information
fialhocoelho committed Sep 27, 2024
1 parent 0bdb5c4 commit e60cdc5
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion Dockerfile.ubi
Original file line number Diff line number Diff line change
Expand Up @@ -210,8 +210,10 @@ FROM vllm-openai as vllm-grpc-adapter

USER root

# RUN --mount=type=cache,target=/root/.cache/pip \
# pip install vllm-tgis-adapter==0.4.1
RUN --mount=type=cache,target=/root/.cache/pip \
pip install vllm-tgis-adapter==0.4.0
pip install git+https://github.com/opendatahub-io/vllm-tgis-adapter@ibm-adapter-20240927

ENV GRPC_PORT=8033 \
PORT=8000 \
Expand Down

0 comments on commit e60cdc5

Please sign in to comment.