Code

[pull] master from kserve:master#357

Code

Merged

openshift-merge-bot[bot] merged 50 commits intoopendatahub-io:masteropendatahub-io/kserve:masterfrom kserve:masterkserve/kserve:masterCopy head branch name to clipboardMay 17, 2024

+113,565-4,463

Commits

Commits on Apr 7, 2024

• docs: Move Alibi explainer to docs (#3579)

  Show description for 96ca17a
  terrytangyuan

  authored
  96ca17a

Commits on Apr 9, 2024

• build: Add flake8 and black to pre-commit hooks (#3578)

  Show description for 19314ab
  terrytangyuan

  authored
  19314ab

• fix: Set writable cache folder to avoid permission issue. Fixes #3562 (#3576)

  Show description for d0cb667
  terrytangyuan

  authored
  d0cb667

Commits on Apr 14, 2024

• golang.org/x/net Allocation of Resources Without Limits or Throttling (#3596)

  Show description for 9fd262f
  spolti

  authored
  9fd262f

Commits on Apr 16, 2024

• Support OpenAIModel in ModelRepository (#3590)

  Show description for 888afd5
  

  grandbora

  and

  yuzisun

  authored
  888afd5

• updated xgboost to support json and ubj models (#3551)

  Show description for d01d6c3
  andyi2it

  authored
  d01d6c3

• Security fix - CVE 2024 24786 (#3585)

  Show description for 385b8c2
  andyi2it

  authored
  385b8c2

Commits on Apr 19, 2024

• VLLM support for OpenAI Completions in HF server (#3589)

  Show description for 9cc4eed
  gavrissh

  authored
  9cc4eed

Commits on Apr 20, 2024

• Add a user friendly error message for http exceptions (#3581)

  Show description for 09a9168
  

  grandbora

  and

  Bora Tunca

  authored
  09a9168

Commits on Apr 21, 2024

• Fix model unload in server stop method (#3587)

  Show description for 362cd18
  sivanantha321

  authored
  362cd18

• feat: Provide minimal distribution of CRDs (#3492)

  Show description for f1b4d4b
  terrytangyuan

  authored
  f1b4d4b

• build: Allow pre-commit to keep changes in reformatted code (#3604)

  Show description for af37834
  terrytangyuan

  authored
  af37834

• Fix golint errors (#3552)

  Show description for 39a4866
  andyi2it

  authored
  39a4866

Commits on Apr 23, 2024

• Fix make deploy-dev-storage-initializer not working (#3617)

  Show description for 9a897ed
  sivanantha321

  authored
  9a897ed

• Fix Pydantic 2 warnings (#3622)

  Show description for ec59f43
  cmaddalozzo

  authored
  ec59f43

• build: Fix CRD copying in generate-install.sh (#3620)

  Show description for 34ea6f0
  terrytangyuan

  authored
  34ea6f0

• chore: v0.12.1 install files (#3619)

  Show description for 6c23281
  

  terrytangyuan

  and

  sivanantha321

  authored
  6c23281

• Fix CVE-2023-45288 for qpext (#3618)

  Show description for cefdc2e
  sivanantha321

  authored
  cefdc2e

Commits on Apr 25, 2024

• Allow rerunning failed workflows by comment (#3550)

  Show description for 47265b2
  andyi2it

  authored
  47265b2

• Add OpenAI API support to Huggingfaceserver (#3582)

  Show description for a9d747e
  

  cmaddalozzo

  and

  tessapham

  authored
  a9d747e

Commits on Apr 27, 2024

• add re-run info in the PR templates (#3633)

  Show description for 0549c98
  spolti

  authored
  0549c98

Commits on Apr 28, 2024

• chore: Bump ModelMesh version to v0.12.0-rc0 in Helm chart (#3642)

  Show description for e27aeec
  terrytangyuan

  authored
  e27aeec

• build: Remove misleading logs from minimal-crdgen.sh (#3641)

  Show description for 5b51837
  terrytangyuan

  authored
  5b51837

Commits on Apr 29, 2024

• Add e2e tests for huggingface (#3600)

  Show description for 622f32f
  

  sivanantha321

  and

  yuzisun

  authored
  622f32f

• set default SAFETENSORS_FAST_GPU and HF_HUB_DISABLE_TELEMETRY in HF Server (#3594)

  Show description for 1c5b0f9
  lizzzcai

  authored
  1c5b0f9

Commits on Apr 30, 2024

• Remove generate endpoints (#3654)

  Show description for 3f9b442
  cmaddalozzo

  authored
  3f9b442

• Assign device to input tensors in huggingface server with huggingface backend (#3657)

  Show description for 0fe5d3f
  saileshd1402

  authored
  0fe5d3f

• Test image builds for ARM64 arch in CI (#3629)

  Show description for 8cfb3e0
  sivanantha321

  authored
  8cfb3e0

• Fix Huggingface server stopping criteria (#3659)

  Show description for f717e12
  cmaddalozzo

  authored
  f717e12

• Enabled the multiple domains support on an inference service (#3615)

  Show description for 36a3e6d
  houshengbo

  authored
  36a3e6d

Commits on May 2, 2024

• Explicitly specify pad token id when generating tokens (#3565)

  Show description for 9c6a6b8
  sivanantha321

  authored
  9c6a6b8

Commits on May 3, 2024

• Fix quick install does not cleans up Istio installer (#3660)

  Show description for 5011c7d
  sivanantha321

  authored
  5011c7d

• Add base model for proxying request to an OpenAI API enabled model server (#3621)

  Show description for 2cddaa4
  cmaddalozzo

  authored
  2cddaa4

• Add headers to predictor exception logging (#3658)

  Show description for 0fb5696
  grandbora

  authored
  0fb5696

Commits on May 4, 2024

• workflow file for cherry-pick on comment (#3653)

  Show description for a3fda9c
  andyi2it

  authored
  a3fda9c

• Enhance controller setup based on available CRDs (#3472)

  Show description for 59d705b
  israel-hdez

  authored
  59d705b

Commits on May 6, 2024

• Bump version to 0.13.0-rc0 (#3665)

  Show description for bfc2e21
  cmaddalozzo

  authored
  bfc2e21

Commits on May 8, 2024

• upgrade vllm/transformers version (#3671)

  Show description for f3c3220
  johnugeorge

  authored
  f3c3220

Commits on May 9, 2024

• Add openai models endpoint (#3666)

  Show description for d608056
  cmaddalozzo

  authored
  d608056

• feat: Support customizable deployment strategy for RawDeployment mode. Fixes #3452 (#3603)

  Show description for 629e4ae
  terrytangyuan

  authored
  629e4ae

• Enable dtype support for huggingface server (#3613)

  Show description for a30d402
  Datta0

  authored
  a30d402

Commits on May 10, 2024

• Add method for checking model health/readiness (#3673)

  Show description for ca50e18
  cmaddalozzo

  authored
  ca50e18

• fix for extract zip from gcs (#3510)

  Show description for ce9b0e8
  andyi2it

  authored
  ce9b0e8

Commits on May 11, 2024

• Update Dockerfile and Readme (#3676)

  Show description for a4cce1a
  gavrissh

  authored
  a4cce1a

• Update huggingface readme (#3678)

  Show description for 9dbce8e
  

  3 peopleauthored
  9dbce8e

• fix: HPA equality check should include annotations (#3650)

  Show description for 56a2940
  terrytangyuan

  authored
  56a2940

Commits on May 13, 2024

• Fix: huggingface runtime in helm chart (#3679)

  Show description for 024f69b
  yuzisun

  authored
  024f69b

Commits on May 14, 2024

• Fix: model id and model dir check order (#3680)

  Show description for 4c6ce45
  yuzisun

  authored
  4c6ce45

Commits on May 15, 2024

• Fix:vLLM Model Supported check throwing circular dependency (#3688)

  Show description for 892e5dc
  gavrissh

  authored
  892e5dc

• Fix: Allow null in Finish reason streaming response in vLLM (#3684)

  Show description for 8771c3d
  gavrissh

  authored
  8771c3d