Yes, when anyone proposes building our tools on top of these services I ask "what will happen to this when they start charging what it really costs to run these models?"
In general I agree with you, but llms are the one exception where it's not practical and not cost effective to run them locally. If you want to use them, the better option is by far to pay someone for the service.
Then second best option is an inference provider for open weight models, so at least if they raise the price or stop offering it you can get it from someone else or eventually upgrade to self hosting.
I agree, but I learn best when I can ask questions a certain way to understand concepts, and as much as people may hate it, it's good at answering questions like that and people are often nasty when others ask questions they assume to be stupid.
Remember: if you don't know enough about the topic in question to grade its answers then you're not judging its ability to answer accurately, you're judging it's ability to convince you.
It's shit like this that make me want to pursue a career in digging ditches with just a shovel, a bag of sandwiches, a thermos of coffee and the warm sunshine. Fuck the modern world. It jumped the rail a while ago now.
anyone with a yard should be tilling the soil and planting stuff, it's a nice hobby that gives you some fun things to eat, and if (well, kinda feels like when..) international trade goes to shit we'll have people who can keep us fed.
26 Comments
waterSticksToMyBalls@lemmy.world · 84 pts · 185d
Oh fuck this is terrible! The students are going to have to learn code now
sem@piefed.blahaj.zone · 3 pts · 184d
We all know only the smart ones will do that.
shrek_is_love@lemmy.ml · 60 pts · 185d
Good example of why I don't rely on technology I don't control. I want my workflow to be future-proof and have a predictable cost.
Munkisquisher@lemmy.nz · 17 pts · 185d
Yes, when anyone proposes building our tools on top of these services I ask "what will happen to this when they start charging what it really costs to run these models?"
joelthelion@lemmy.world · -13 pts · 185d
In general I agree with you, but llms are the one exception where it's not practical and not cost effective to run them locally. If you want to use them, the better option is by far to pay someone for the service.
gezero@sopuli.xyz · 36 pts · 185d
That's because now is the phase where they let you try the good stuff cheaper to hook you up.
joelthelion@lemmy.world · 1 pts · 184d
That's true, but there are also massive economies of scale when you can afford the big Nvidia gpus and share them among many people.
exu@feditown.com · 4 pts · 185d
https://openrouter.ai/
chicken@lemmy.dbzer0.com · 4 pts · 184d
Then second best option is an inference provider for open weight models, so at least if they raise the price or stop offering it you can get it from someone else or eventually upgrade to self hosting.
joelthelion@lemmy.world · 2 pts · 184d
I agree. I use openrouter myself.
expr@piefed.social · 39 pts · 185d
Good, maybe people will use it less.
squaresinger@lemmy.world · 35 pts · 185d
So it begins. We are past the unlimited money stage and now the cuts begin to make AI somewhat profitable.
Expect more of that in the coming months.
spartanatreyu@programming.dev · 27 pts · 184d
It's for the best.
Learning how code works is better than getting an LLM to produce convincing looking code without anyone having an understanding of how it works.
LLMs just teach students to paint themselves into a corner without them even realising why bad things keep happening to them.
PokerChips@programming.dev · 8 pts · 184d
Right. It's actually shocking that copilot is allowed at all. The next generation is going to be so fucking stupid.
KyuubiNoKitsune@lemmy.blahaj.zone · 1 pts · 184d
I agree, but I learn best when I can ask questions a certain way to understand concepts, and as much as people may hate it, it's good at answering questions like that and people are often nasty when others ask questions they assume to be stupid.
Not that I'm a student.
spartanatreyu@programming.dev · 1 pts · 180d
Are you sure about that: https://www.youtube.com/watch?v=JtBI2BvPKBQ
Remember: if you don't know enough about the topic in question to grade its answers then you're not judging its ability to answer accurately, you're judging it's ability to convince you.
KyuubiNoKitsune@lemmy.blahaj.zone · 1 pts · 180d
Same could be said about everything online really.
Trust but verify, that's been the motto since forever.
akaetis@techhub.social · 21 pts · 185d
Same process as used by drug dealers: first you can try for free, you get addict, then you have to pay.
MyNameIsRichard@lemmy.ml · 3 pts · 184d
And both drug dealers and software companies refer to their clients as users.
thingsiplay@lemmy.ml · 20 pts · 184d
I feel sorry for anyone relying on Copilot.
meathorse@lemmy.world · 9 pts · 183d
They aren't even waiting for market saturation, they're just speed-running straight into enshittification now
Croquette@sh.itjust.works · 3 pts · 183d
They can't sustain the loss-lead trying to capture the market.
sunglocto@lemmy.dbzer0.com · 8 pts · 184d
good
melsaskca@lemmy.ca · 6 pts · 184d
It's shit like this that make me want to pursue a career in digging ditches with just a shovel, a bag of sandwiches, a thermos of coffee and the warm sunshine. Fuck the modern world. It jumped the rail a while ago now.
shrek_is_love@lemmy.ml · 4 pts · 184d
Fuckin' "A."
Swedneck@discuss.tchncs.de · 1 pts · 183d
anyone with a yard should be tilling the soil and planting stuff, it's a nice hobby that gives you some fun things to eat, and if (well, kinda feels like when..) international trade goes to shit we'll have people who can keep us fed.