Top tier post. Can't wait for the experts at awful.systems to come explain. The question by OP is a very good question so I am sure we will get expert explanations from users of the awful.systems instance.
My oversimplified and possibly wrong understanding: this is like speculative decoding, but instead of a separate draft model (which does its own prompt processing), they use some diffusion thing strapped on top of the main model. The diffusion reuses the high-quality prompt processing result of the main model.
The 7.8x faster claim sounds almost too good to be true. But even if we get like 3x then this is still a huge revolution in localLLMing.
1.5 hours runtime for like half a liter of gasoline?? That's unbelievably inefficient. A half-liter of gasoline is like 15MJ, should power a laptop drawing 30W for a week.
I see. Mistral was the favorite in self-hosted LLM circles back in 2023-2024 but general opinion is that they have since been far surpassed by Chinese and American models, hence my question.
Good to know they've found a market with their online offering.
My not very confident guess is that it's just to label what kind of galaxies are observed by the instrument at that range. Really not sure about the less dense ring in the outer part though.
the latter. the map looks different further away from the center of the circle because further away = earlier time. if they attempted to compensate for how things far away have changed since the light was emitted, the map would look uniform.
My original comment was poorly worded. Ghana gained independence 69 years ago, not 200.
The kidnapping and exploitation was in full swing 200 years ago, but it started earlier than that and ended way later, if ever.
200 years later: They are expanding the anti-gay laws! Why are they so backward?!
Pay reparations or shut up.
Top tier post. Can't wait for the experts at awful.systems to come explain. The question by OP is a very good question so I am sure we will get expert explanations from users of the awful.systems instance.
They said they're working on Orthus for Qwen 3.5. It'll be amazing!
My oversimplified and possibly wrong understanding: this is like speculative decoding, but instead of a separate draft model (which does its own prompt processing), they use some diffusion thing strapped on top of the main model. The diffusion reuses the high-quality prompt processing result of the main model.
The 7.8x faster claim sounds almost too good to be true. But even if we get like 3x then this is still a huge revolution in localLLMing.
1.5 hours runtime for like half a liter of gasoline?? That's unbelievably inefficient. A half-liter of gasoline is like 15MJ, should power a laptop drawing 30W for a week.
Maybe it would be better with a fuel cell.
If you would rather not trust any AI company with your data, consider heading to !localllama@sh.itjust.works where self-hosted LLM are discussed!
I see. Mistral was the favorite in self-hosted LLM circles back in 2023-2024 but general opinion is that they have since been far surpassed by Chinese and American models, hence my question.
Good to know they've found a market with their online offering.
Is there a use case where Mistral still beat Qwen or Gemma? If you're using Mistral, which model and what do you use it for?
Yes :)
How does the crosspost listing on Lemmy work?
The original post (just 10 minutes earlier) is here but is not shown in the list of crossposts for this post. Why?
On a separate note, I hope the author of this post and his colleagues are safe. His university got bombed by America and Israel earlier this month.
This is great! The value of having your computational pipeline nicely debuggable and visualizable cannot be overstated.
The float32 limitation sounds a bit arbitrary. Would be cool if blender allows float64 in geo nodes in the future.
Check this comment https://mander.xyz/comment/26729021
@expatriado@lemmy.world do you happen to know what the less dense ring in the outer part is?
My not very confident guess is that it's just to label what kind of galaxies are observed by the instrument at that range. Really not sure about the less dense ring in the outer part though.
what. there definitely are differences between the universe today and the universe billions years ago.
the latter. the map looks different further away from the center of the circle because further away = earlier time. if they attempted to compensate for how things far away have changed since the light was emitted, the map would look uniform.
hmm brb imma go invent a refrigeration cycle that runs 15C <-> 250C
startup idea: fridge with warm little nook for dog