Just why. This was like the third time it reminded me that I shouldn't have the phone I have.
I really don't understand the public desire to make these AIs like this.
Stupid llama
Just why. This was like the third time it reminded me that I shouldn't have the phone I have.
I really don't understand the public desire to make these AIs like this.
2 Comments
elbarto777@lemmy.world · 4 pts · 3y
gbuttersnaps@programming.dev · 3 pts · 3y
Check out Llama cpp sometime, it's foss and you can run it without too crazy system requirements. There are different sets of parameters you can use for it, I think the 13 billion parameters set only uses 8 gigs of ram and the 25b parameter set uses 16gb. Definitely nowhere near as good as gpt, but still fun and hopefully will improve in the future.
elbarto777@lemmy.world · 2 pts · 3y
slazer2au@lemmy.world · 3 pts · 3y
Yes, there are self hosted llm
Check out !selfhosted@lemmy.world.
I hope that link worked.
elbarto777@lemmy.world · 3 pts · 3y