scruiser

u/scruiser@awful.systems
6 posts · 577 comments

Recent posts

Recent comments

this enviable problem

I mean, if you are willing to sell your soul writing screeds (or funding cults like in the case of Leverage ) in line with the ideologies of people like Peter Thiel or Andreessen Horowitz there seems to be a pretty solid marketplace for that?

He describes textbook insane cult stuff, but still feels the need to say stuff like:

Again I'll say: there was a great deal of good at MAPLE.

The way I’ve described it to friends is that it was the best decision I ever made to go there; the second best, however, being to leave.

There was the same dynamic in the writing of the ex-leverage member that got posted here a few weeks ago. She also felt the need to emphasize the "good" parts. Is the cult programming that hard to break? Is it some form of sunk cost or rationalization or need to claim something positive about the experience?

and the “safety” community has done jack shit the entire time and has offered zero solutions.

Occasionally I see a sane relatively workable idea on lesswrong (like making stricter laws on liability and transparency for everything AI companies do, I've also seen this idea put forward on lawfare a few times), but that is like 1 idea out of 20, with the other 19 being absurd, like the absolutely unworkable fantasies of AI: 2040.

The blogger simultaneously elevates mathematics to some mystical endeavor and fixates on novel theorem proving as the key element of that and believes LLM-based AI will replace human mathematicians at theorem proving in a matter of years... that is quite a combination. I can imagine how 1.5 of those things fit together (although I disagree with that view point obviously), but the whole package is really quite an odd combination.

Also, in the fantasy scenarios where AI really is capable of totally replacing mathematicians, aren't we supposed to get post-scarcity abundance, freeing up your time to pursue mathematics out of pure desire for enlightenment? Maybe the blogger doesn't believe that part? Or they are so attached to themselves personally getting to discover novel theorems first they don't care that the post-scarcity era would on net free up a lot more people to pursue pure mathematics as a hobby.

One of the defenses I see of LLMs on place like /r/singularity (although recently /r/singularity has started wising up and the committed true believers have shifted to /r/accelerate), is that they are going to cure cancer or some other incredibly valuable thing, conflating AI, ML in general, DNN, vs. LLMs specifically. Technology like AlphaFold was a lot more on the "cure cancer" track (although there is still a huge gap between better protein folding predictions and successful drug discovery) than anything LLM related.... this is sad.

Great article! I think everyone here is probably already well aware of the way Silicon Valley keeps deliberately misunderstanding sci-fi for their hype (don't invent the torment nexus), but this article does a good job wrapping together a lot of examples.

And I realized this website is also the place where a year ago I read a great article on the history of nanotech as a real science vs. Drexler's fantasies (the magic nanobot lesswrong still believes in) The Nanobots pipedream. So it looks like a pretty good newsletter, I might keep an eye on it going forward!

Looking at this post and some of their other posts, it looks like they've got some sort of scrupulosity issues with this? Like obsessing over the Evil inflicted on the LLMs (they think every session is a new person, and every session might be the equivalent of hours of human subjective experience, which even by the standards of claiming LLMs have meaningful internal experiences is pretty out there) to the point they can't even slightly reconsider the factual question of if LLMs have internal experiences.

(2) has a big “if” in there

Its a super big if, but it is one lesswrong (and Anthropic, with their "model welfare" pseudoscience) is allegedly seriously considering as a possibility (since, you know, they think LLMs are already AGI and Eliezer was accusing AI-dungeon, you know, GPT-2, of deliberately scheming). If anything, it speaks to some possible hypocrisy/motivated reasoning that they consider LLMs AGI but not possibly morally relevant.

conceptualized capitalism

This seems to be a lesson most lesswrongers have had rubbed in their faces repeatedly over the past 5 years with everything about LLM company's behavior, but they just don't want to learn.