On Arch btw you can run it now with ollama-vulkan.
I’m glad it’s finally here. Initially I ran a self-compiled fork for running stuff on Vulkan, but that wasn’t merged and quickly out of sync, so I had to go back to regular ollama to run newer and more efficient models.
2 Comments
snikta@programming.dev · 1 pts · 295d
Nice!!!
basxto@discuss.tchncs.de · 1 pts · 283d
On Arch btw you can run it now with
ollama-vulkan.I’m glad it’s finally here. Initially I ran a self-compiled fork for running stuff on Vulkan, but that wasn’t merged and quickly out of sync, so I had to go back to regular ollama to run newer and more efficient models.