Early speculation is that it's an MoE (mixture of experts) of 8 7b models, so maybe not earth shattering like their last release but highly intriguing, will update with more info as it comes out
Mistral drops a new magnet download
https://twitter.com/MistralAI/status/1733150512395038967?t=1qjjZauoJSPikKFkNto2kg&s=19
2 Comments
Mixel@feddit.de · 9 pts · 2y
Honestly its such a good idea to share models via p2p it saves so much bandwidth Ofc there should still be a ddl for preservation but still
noneabove1182@sh.itjust.works · 3 pts · 2y
The only concern I had was my god is it a lot of faith to put in this random twitter, hope they never get hacked lol, but otherwise yes it's a wonderful idea, would be a good feature for huggingface to speed up downloads/uploads