Skip to content

Pull requests: triton-inference-server/server

New pull request New
65 Open 3,793 Closed
65 Open 3,793 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

build: Adding b64 dependency to relevant targets (fix L0_build_variants) (#7855)
#7882 opened Dec 14, 2024 by yinggeh Loading…
@yinggeh
4
fix: Lock httpx version to fix L0_openai--trtllm test failures (#7870)
#7881 opened Dec 14, 2024 by yinggeh Loading…
@yinggeh
1
fix: gRPC segfault due to Low Request Cancellation Timeout (#7840)
#7880 opened Dec 13, 2024 by yinggeh • Draft
@yinggeh
refactor: Update the response queue in the server to reuse response slots
#7879 opened Dec 13, 2024 by pskiran1 • Draft
4 of 20 tasks
1
feat: Adding version switcher to Triton sphinx documentation PR: feat A new feature
#7872 opened Dec 11, 2024 by nv-kmcgill53 Loading…
12 of 20 tasks
9
perf: Upgrade vLLM version to 0.6.3.post1 PR: perf A code change that improves performance
#7858 opened Dec 6, 2024 by kthui Loading…
9 of 20 tasks
3
fix: openai chat message dump logic
#7849 opened Dec 3, 2024 by dongs0104 Loading…
6 of 22 tasks
@rmccorm4
4
build: enabled build behind proxy
#7842 opened Nov 28, 2024 by dtrawins Loading…
6 of 22 tasks
2
feat: ORCA Format KV Cache Utilization in Inference Response Header
#7839 opened Nov 27, 2024 by BenjaminBraunDev Loading…
12 of 22 tasks
23
refactor: Refactor of L0_backend_python and the env subtest PR: ci Changes to our CI configuration files and scripts PR: refactor A code change that neither fixes a bug nor adds a feature
#7838 opened Nov 27, 2024 by nv-kmcgill53 • Draft
5 of 20 tasks
ci: Fix Windows CI Errors PR: ci Changes to our CI configuration files and scripts
#7837 opened Nov 27, 2024 by fpetrini15 Loading…
9 of 18 tasks
9
draft: Added gRPC timer for graceful shutdown of inflight requests
#7835 opened Nov 25, 2024 by mattwittwer Loading…
20 tasks
@mattwittwer
ci: Enables testing for pull requests
#7828 opened Nov 23, 2024 by pranavm-nvidia Loading…
3 of 20 tasks
1
test: Updates L0 Python API tests to run all test files
#7827 opened Nov 23, 2024 by pranavm-nvidia Loading…
4 of 20 tasks
fix: Default max tokens to None for OpenAI frontend.
#7819 opened Nov 20, 2024 by thealmightygrant Loading…
4 of 22 tasks
docs: Re-structure User Guides for Discoverability
#7807 opened Nov 16, 2024 by statiraju Loading…
10
feat: Adding RestrictedFeatures Support to the Python Frontend Bindings
#7775 opened Nov 8, 2024 by KrishnanPrash Loading…
@KrishnanPrash
32
docs: Add clarification for label_filename in classification docs
#7766 opened Nov 5, 2024 by trevoryao Loading…
7 of 22 tasks
Build: Fixing model generation
#7763 opened Nov 4, 2024 by pvijayakrish Loading…
3 of 20 tasks
docs: Simplify PR templates PR: docs Documentation only changes
#7753 opened Oct 29, 2024 by yinggeh Loading…
6 of 11 tasks
@yinggeh
10
[Do not merge!] Build: Remove TRT model generation for V100
#7712 opened Oct 16, 2024 by pvijayakrish • Draft
3 of 20 tasks
2
fix:Split L0_nomodel_perf into 2 test to ensure better debug-ability and resource util for PA
#7705 opened Oct 15, 2024 by indrajit96 • Draft
6 of 19 tasks
test: TC for Metric P0 nv_load_time per model
#7697 opened Oct 14, 2024 by indrajit96 Loading…
8 of 20 tasks
21
Build: Update TRT release branch referenced in model gen file
#7693 opened Oct 11, 2024 by pvijayakrish Loading…
3 of 20 tasks
2
Build: Update README and versions for 24.10
#7686 opened Oct 8, 2024 by pvijayakrish Loading…
3 of 20 tasks
1
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.