FitMyLLM — Independent benchmarks for self-hosted AI

https://www.fitmyllm.com/

cross-posted from: https://programming.dev/post/51407459

Check what can you use and at what rate of token per seconds would it be... It has examples of many models and quantization levels. Huge resource!

-11 points · 2 comments · view on lemmy.world

2 Comments

SamuelEllis@lemmy.world · 1 pts · 48d
[ removed ]
lukecooperatus@lemmy.ml · 1 pts · 67d (1 reply)

What has this to do with degoogling?

anzo@programming.dev · 4 pts · 67d

Gemini is one of the most used LLMs. This shows alternatives.