Deepseek v4 is already exceptional value, with alibaba hosted version smarter than original release. Mimo 2.5 pro, and minimax m3, are only models... I can access for free testing that pass my benchmark.
Ai analysis has "cost to run tests" data, which also put mimo 2.5, not pro, on frontier curve. But deepseek 4.1, 4.0 silently improved served from main servers today, is going to blow everything away especially with this speculative decoding tech added. 85% faster means 85% cheaper, even if these techs often degrade performance.
It is much faster than MTP (around 2x). Also if you have read their paper which contains lots of really cool ideas, they clearly documented their limitations and did a good comparison with existing methods. You can run it easily on a strix halo (albeit quantized) and the peformance is fast given how quantized it is.
At least they published their research and went into great length for their novel discoveries, much bettter than any other "frontier" lab did. Them, GLM and Kimi are doing great, but deepseek hands down have the most cool and fun innovative papers in this field.
7 Comments
venusaur@lemmy.world · 4 pts · 47d
OpenAI made a similar announcement recently too. Curious about the distillation stuff Alibaba is accused of.
humanspiral@lemmy.ca · 3 pts · 46d
Deepseek v4 is already exceptional value, with alibaba hosted version smarter than original release. Mimo 2.5 pro, and minimax m3, are only models... I can access for free testing that pass my benchmark.
Ai analysis has "cost to run tests" data, which also put mimo 2.5, not pro, on frontier curve. But deepseek 4.1, 4.0 silently improved served from main servers today, is going to blow everything away especially with this speculative decoding tech added. 85% faster means 85% cheaper, even if these techs often degrade performance.
ag10n@lemmy.world · 1 pts · 47d
Breakthrough hardly. Amazing how the article specifies cloud inference while the OP mentions local
Similar or slightly better than MTP using the same tech
mal3oon@lemmy.world · 1 pts · 46d
It is much faster than MTP (around 2x). Also if you have read their paper which contains lots of really cool ideas, they clearly documented their limitations and did a good comparison with existing methods. You can run it easily on a strix halo (albeit quantized) and the peformance is fast given how quantized it is.
At least they published their research and went into great length for their novel discoveries, much bettter than any other "frontier" lab did. Them, GLM and Kimi are doing great, but deepseek hands down have the most cool and fun innovative papers in this field.
ag10n@lemmy.world · 0 pts · 46d
“Novel” and “groundbreaking” comment. You’ve made your 5 cents
Eyekaytee@aussie.zone · 0 pts · 47d
people are saying 60-80% speed up?
ag10n@lemmy.world · 2 pts · 46d
Deepseek reports this number