omarchy is a bastardisation of what arch can offer.
if dhh really cared about open-source, linux and arch, he should be using his platform to educate a wider audience on how to customise their own installs.
We already know AGI isn’t possible with LLM technology but looking past this, what I despise in the current state of AI tech journalism is the loop of:
AI stakeholder/spokesperson says something unrealistic
Journalist nods their head approvingly
Article is virtually an ad that recounts an event
Rinse and repeat
Too many tech enthusiasts masquerading as ‘journalists’ who seemingly suffer from short-term memory loss.
It’s like i’m seeing the same information on repeat because ‘journalists’ fall for the same marketing tactics endlessly and do little to actually question what they hear.
i think it was more a manufactured movement by corporate America than grassroots, that stoked discontent by feeding exceptionalism and institutionalised racism (among other things).
I don’t live in the US but it must be hard seeing that there are groups that are anti-vaccines who will make those decisions for their children who inevitably will get sick, and those who are sensible have the full knowledge that this was easily avoidable because prior to vaccinations there was widespread death.
Also not uniquely a US problem but clearly at the forefront of online media.
LLMs ingest tokens as input. It is a core component of natural language processing. When entering a query into an LLM the text will be parsed as tokens.
I don’t know if the investing is inherently problematic. I do believe that the current situation is the culmination of many intersecting societal issues.
I’m no expert so take what I say with a grain of salt.
LLMs are prohibitively expensive to run.
If I wanted to make a basic rollerball pen, the cost would be high because I would have to gather the resources just to make a single unit. Mass manufacturing drops the price considerably to make it affordable for me to buy a pen.
But tokens aren’t the same as a factory line. If it’s $1 for me to use an LLM then it’s $100 for 100 people. It scales poorly.
LLM availability over cloud infrastructure requires resources that are expensive to build and depreciate quickly to the point that ROI is untenable (ie. Nvidia’s GPUs).
Now imagine a stock market that hinges around a handful of companies that are involved in that infrastructure component (eg. SK hynix). If many retail investors have dumped their savings into those stocks which can’t provide an expected return then the value of people’s savings will inevitably fluctuate on the whims of the AI industry.
You can imagine what will happen the next time a Chinese company releases a free and efficient LLM that can run on an 8GB RAM personal laptop. The panic selling will reverberate through the markets and a lot of people’s savings will evaporate overnight.
they have the same problems we see in other advanced economies:
aging population
lack of housing
not enough births
household financial pressure
using trading/gambling as an additional income stream
They do have well known global industries but workers generally-speaking aren’t paid enough / have limited free time outside of their work. To add more pressure I believe the government increased the pension which is typically paid by the working population who are already financially stretched as it is.
They’re on track for destabilisation in the next 20-30 years.
we’re standing on a cliff watching people get swept away by a big wave and you keep clarifying to all the onlookers that it’s actually called a tsunami.
Anthropic is likely to tell investors that it sees its total addressable market (TAM) exceeding $30 trillion, ahead of the $28.5 trillion estimate from SpaceX (SPCX.O), the Wall Street Journal reported on Tuesday.
they’re predicting to sell GREATER THAN $30 trillion because they’re overvaluing a business that has no pathway to profitability.
It also isn’t ’way overblown’ because in no way is this standard behaviour in a market. To me it looks like a pump and dump with more steps.
My take is that the Saudis were incredibly fortunate to be sitting on a resource that has had inelastic demand for decades. So fortunate in fact that they didn’t get good at anything else that wasn’t related to oil.
They’ve known for some time that the oil reserves can’t sustain them forever so they’ve dabbled in investments in various industries with lacklustre results.
Their recent foray into gaming is symbolic of this. An industry that bleeds cash without the creative talent that underpins it. I mean Microsoft is a good example of when ‘business’ intersects with the production of art.
creatives who are successful want more money to fund bigger projects and increase the scope of their art.
capitalists want studios to make money to line their pockets at the expense of creativity and eventually kill them when the games become just another vector to funnel cash to the wrong places.
there used to be a time when a business had to have a proven product/service that brought consistent value to the customer.
openai has been throwing darts blindly at the dartboard for the last three years that it bewilders me that anyone could think they have the ability to be stable or profitable in the near future.
my thing is, if everyone is using LLMs to write emails (for example) then there needs to be a re-think about online communication as a whole and that would definitely not involve LLMs.
omarchy is a bastardisation of what arch can offer.
if dhh really cared about open-source, linux and arch, he should be using his platform to educate a wider audience on how to customise their own installs.
reality is that he’s slop personified.
it’s more likely that the government is going to fumble the legislation
We already know AGI isn’t possible with LLM technology but looking past this, what I despise in the current state of AI tech journalism is the loop of:
Too many tech enthusiasts masquerading as ‘journalists’ who seemingly suffer from short-term memory loss.
It’s like i’m seeing the same information on repeat because ‘journalists’ fall for the same marketing tactics endlessly and do little to actually question what they hear.
i think it was more a manufactured movement by corporate America than grassroots, that stoked discontent by feeding exceptionalism and institutionalised racism (among other things).
is it that impressive? I’m guessing it’s just a layer of speech-to-text then token parsing like usual.
I don’t live in the US but it must be hard seeing that there are groups that are anti-vaccines who will make those decisions for their children who inevitably will get sick, and those who are sensible have the full knowledge that this was easily avoidable because prior to vaccinations there was widespread death.
Also not uniquely a US problem but clearly at the forefront of online media.
on the point of depreciation. would a hyperscaler be able to make a profitable return on a per GPU basis before they’ve maxed out its use?
genuine question not a rhetorical.
LLMs ingest tokens as input. It is a core component of natural language processing. When entering a query into an LLM the text will be parsed as tokens.
I don’t know if the investing is inherently problematic. I do believe that the current situation is the culmination of many intersecting societal issues.
I’m no expert so take what I say with a grain of salt.
LLMs are prohibitively expensive to run.
If I wanted to make a basic rollerball pen, the cost would be high because I would have to gather the resources just to make a single unit. Mass manufacturing drops the price considerably to make it affordable for me to buy a pen.
But tokens aren’t the same as a factory line. If it’s $1 for me to use an LLM then it’s $100 for 100 people. It scales poorly.
LLM availability over cloud infrastructure requires resources that are expensive to build and depreciate quickly to the point that ROI is untenable (ie. Nvidia’s GPUs).
Now imagine a stock market that hinges around a handful of companies that are involved in that infrastructure component (eg. SK hynix). If many retail investors have dumped their savings into those stocks which can’t provide an expected return then the value of people’s savings will inevitably fluctuate on the whims of the AI industry.
You can imagine what will happen the next time a Chinese company releases a free and efficient LLM that can run on an 8GB RAM personal laptop. The panic selling will reverberate through the markets and a lot of people’s savings will evaporate overnight.
they have the same problems we see in other advanced economies:
They do have well known global industries but workers generally-speaking aren’t paid enough / have limited free time outside of their work. To add more pressure I believe the government increased the pension which is typically paid by the working population who are already financially stretched as it is.
They’re on track for destabilisation in the next 20-30 years.
i presume it means their economy will crash sooner than USA’s.
we’re standing on a cliff watching people get swept away by a big wave and you keep clarifying to all the onlookers that it’s actually called a tsunami.
forest from the trees dude.
they’re predicting to sell GREATER THAN $30 trillion because they’re overvaluing a business that has no pathway to profitability.
It also isn’t ’way overblown’ because in no way is this standard behaviour in a market. To me it looks like a pump and dump with more steps.
keep in mind that would be enough to solve homelessness in virtually any nation
My take is that the Saudis were incredibly fortunate to be sitting on a resource that has had inelastic demand for decades. So fortunate in fact that they didn’t get good at anything else that wasn’t related to oil.
They’ve known for some time that the oil reserves can’t sustain them forever so they’ve dabbled in investments in various industries with lacklustre results.
Their recent foray into gaming is symbolic of this. An industry that bleeds cash without the creative talent that underpins it. I mean Microsoft is a good example of when ‘business’ intersects with the production of art.
i presume this is for tax dodging?
mark zuckerberg must have the hardest time making any sort of genuine human connection.
creatives who are successful want more money to fund bigger projects and increase the scope of their art.
capitalists want studios to make money to line their pockets at the expense of creativity and eventually kill them when the games become just another vector to funnel cash to the wrong places.
there used to be a time when a business had to have a proven product/service that brought consistent value to the customer.
openai has been throwing darts blindly at the dartboard for the last three years that it bewilders me that anyone could think they have the ability to be stable or profitable in the near future.
my thing is, if everyone is using LLMs to write emails (for example) then there needs to be a re-think about online communication as a whole and that would definitely not involve LLMs.
“comedy”
should he have made an edgy joke? probably not.
the interview has been out for a while though so i can only assume it’s a slow news day/week for the the guardian.