Repository navigation
vLLM Cuda 13 #9143
Unanswered
okcodemaybe
asked this question in
Q&A
vLLM Cuda 13
#9143
Replies: 1 comment
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Hi all,
Love LocalAI!
Was wondering if there were plans in adding CUDA 13 vLLM support?
I see its not listed as a supported backend on the wiki and when I manually try to load it from host-path backend directory it does not work.
Thanks again!
All reactions