-
Notifications
You must be signed in to change notification settings - Fork 128
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
- Status: Open.#220 In vllm-project/router;
- Status: Open.#219 In vllm-project/router;
- Status: Open.#201 In vllm-project/router;
[Bug]: Periodic health checks reset active worker load counters and cause cache-aware hot spots
bugSomething isn't workingSomething isn't workingStatus: Open.#197 In vllm-project/router;[Bug]: cached_tokens = prompt_tokens in prefill-decode disagg with stream=true
bugSomething isn't workingSomething isn't workingStatus: Open.#193 In vllm-project/router;[Bug]: reorders properties inside response_format.json_schema
bugSomething isn't workingSomething isn't workingStatus: Open.#186 In vllm-project/router;- Status: Open.#183 In vllm-project/router;
- Status: Open.#182 In vllm-project/router;
[Bug]: Power of Two Load Balancing Policy Ignores Router's Local In-Flight Request Counter, Causing Thundering Herd
bugSomething isn't workingSomething isn't workingStatus: Open.#177 In vllm-project/router;[Bug]: vllm-router power_of_two policy queries /get_load but vLLM doesn't expose it
bugSomething isn't workingSomething isn't workingStatus: Open.#174 In vllm-project/router;[Bug]:
--api-keyis not applied to worker health checksbugSomething isn't workingSomething isn't workingStatus: Open.#159 In vllm-project/router;[Bug]: vLLM Router marks KServe workers healthy but fails chat completions, while SGLang Model Gateway works with the same worker URLs
bugSomething isn't workingSomething isn't workingStatus: Open.#158 In vllm-project/router;