Min P sampler (an alternative to Top K/Top P) has been merged into llama.cpp

https://github.com/ggerganov/llama.cpp/pull/3841

Very interesting new sampler, does a better drop at filtering out extremely unlikely tokens when the most likely tokens are less confident, from the results it seems to pretty reliably improve quality with no noticeable downside

10 points · 0 comments · view on lemmy.world

0 Comments

No comments yet.