Skip to content

[V1] Use FlashInfer Sampling Kernel for Top-P & Top-K Sampling#11394

Draft
WoosukKwon wants to merge 1 commit intomainfrom v1-topk-top
+177-90

Commits

Commits on Dec 21, 2024