I'm trying to use Text Generation Web UI, but I'm stuck with small models due to being limited to using a cpu that's "Model name: Intel(R) Core(TM)2 Duo CPU E7500 @ 2.93GHz" How do I set this up?
In Text Generation Web UI, how do I set it up for a small model?
https://github.com/oobabooga/text-generation-webui
2 Comments
hackerwacker@lemmy.ml · 3 pts · 1y
You're probably aware of this but just in case you're not, LLMs are computationally intensive and a CPU from 2007 isn't going to provide a good experience.
That said if you get it working it would be interesting hear how well it works.
icecreamtaco@lemmy.world · 1 pts · 1y
Just follow the install instructions?