vane

u/vane@lemmy.world
6 posts · 1.5k comments

Recent posts

Recent comments

The tools are already there, the change is just cost optimization. Your age, post code and your buying and traveling habits identify you anyways. I remember from "Little Brother" how they identified people with the way they were walking. Protagonist was putting some pieces of paper into his shoes.

Get PC if you want more than gaming, need to do job or homework, connect with people, use internet, if you like indie games, if you like game mods, if you like play with electronics, if you like free online play, if you like friend slop games, if want to know how PC works, if you want to explore different operating systems other than windows, if you can't afford 10-30% more expensive games.

Buy PS5 if you / your parents are at least middle class, can afford yearly subscription for online play, if you can afford games that are 10-30% more expensive then on PC, you are not into electronics and just want to play games, you have no money problems, you don't need anything more than play games in next couple of years.

It's your decision.

Running model that is good at everything require huge amount of energy and huge data center. Those models are mixture of experts. Latest Kimi K3 have 896 experts. Imagine you have company with 896 employees. Each question involves 16 employees to figure out what to do in what area of your business. Like a brainstorm to solve problem. Now if you know exactly what you want and in which area you actually need only 1-5 people. Like an agile team instead of all those people that you have. So you can hire just couple Kimi K3 experts. 16 experts are 100B parameters so roughly 1 expert in frontier open source model is 6B parameters. 5 experts is 30B parameters. You can run 27B Qwen 3.6 quantized into int4 on your computer like other people are doing right now.

I posted link below to example where they fine tuned model ( take it like a employee training ) for specific task.

I have an idea. How about world put all wealthy people in one small country for wealthy people. If you cross certain wealth you are put into this country that you can't escape. There are not other people there and you need to manage all your life only with wealthy people around. There will be no import and no export from this country, no currency exchange but cameras all over the place so we can all see how wealthy people are capable to manage.

You can't right now because there is no dataset available for fine tuning. I'm just saying that it's possible to fine tune 8B-35B parameter model in int4 that will outperform those models ex. for single programming language and developer specific problems. You can read example of fine tuned 8B model here https://fermisense.com/when-machines-take-the-wheel/