Skip to content
#

vllm-windows

Star

Here is 1 public repository matching this topic...

aivrar / vllm-windows-build

Sponsor
Star 28

Native Windows vLLM 0.24.0: Python 3.13, CUDA 12.8, PyTorch 2.11 cu128, RTX 30/40/50 wheel, hardened portable installer with legacy PowerShell support, Qwen3-VL/FlashAttention fixes, Rust frontend/tool parser, OpenAI server fixes, and 10 KV-cache compression dtypes.

windows gpu cuda pytorch nvidia triton msvc quantization kv-cache awq llm llm-serving vllm llm-inference flash-attention qwen kv-cache-compression turboquant vllm-windows multi-turboquant
  • Updated Jul 12, 2026
  • Python

Improve this page

Add a description, image, and links to the vllm-windows topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the vllm-windows topic, visit your repo's landing page and select "manage topics."

Learn more