Baichuan 7B reaches top of LLM leaderboard for it's size?

https://github.com/baichuan-inc/baichuan-7B

baichuan-7B is an open-source large-scale pre-trained model developed by Baichuan Intelligent Technology. Based on the Transformer architecture, it is a model with 7 billion parameters trained on approximately 1.2 trillion tokens. It supports both Chinese and English, with a context window length of 4096. It achieves the best performance of its size on standard Chinese and English authoritative benchmarks (C-EVAL/MMLU).

GitHub: https://github.com/baichuan-inc/baichuan-7B

Hugging Face: https://huggingface.co/baichuan-inc/baichuan-7B

3 points · 1 comments · view on lemmy.world

1 Comments

dill@kbin.social · 1 pts · 3y

Seems like a solid model!