on Discord bot connection? · c/localllama · 1 pts · 3yI'll give it a whirl, thanks. I saw it a day or two ago, but it doesn't really explain how to get it working. May as well try
on Discovering Locally Run Language Models: Share Your Favorites/Not So Favorites! · c/localllama · 5 pts · 3yI've been doing RP with Wizard-Vicuna 13b Uncensored. it's good, very fast (ggml v3 q5-k-s variant) But sometimes forgets it's roleplaying and spits out a story
on llama.cpp for GPU only · c/localllama · 1 pts · 3yPersonally, I have nothing but issues with Oogas ui, so I connect Silly Tavern to it or KoboldCPP. Works great
I'll give it a whirl, thanks. I saw it a day or two ago, but it doesn't really explain how to get it working. May as well try
I've been doing RP with Wizard-Vicuna 13b Uncensored. it's good, very fast (ggml v3 q5-k-s variant) But sometimes forgets it's roleplaying and spits out a story
Personally, I have nothing but issues with Oogas ui, so I connect Silly Tavern to it or KoboldCPP. Works great