Very interesting new sampler, does a better drop at filtering out extremely unlikely tokens when the most likely tokens are less confident, from the results it seems to pretty reliably improve quality with no noticeable downside
Min P sampler (an alternative to Top K/Top P) has been merged into llama.cpp
https://github.com/ggerganov/llama.cpp/pull/3841
0 Comments
No comments yet.