Very well written, IMO. Put me in a contemplative mood. For eg: Braun was done away with, first by civilization, then completely by the industrial revolution. Now brain has started the journey.
I guess philosophy, spiruality, religion and theology will be what the curious mind will set out to conquer next on the journey to self-actualization.
Brawn was not done away with, a smaller percentage of the population is needed for it but, according to gemini 4, construction / mechanics etc account for 29.1%, heavy and very heavy work is about 7%
Must be the first thing I've ever read on lesswrong in its entirety, let alone in one sitting.
Most similar thing I can think of is "The Metamorphosis of Prime Intellect". Metamorphosis of Prime Intellect is way better and more comprehensive, imo.
If when you say “a human” you mean this is because you expect LW to be full of AI-generated text, their policy requires that chunks of language-model-written text go into special content blocks which are headed by the name of the model and rendered in a distinct sans-serif font, so that it can be used when it's useful while making it easier for readers to filter out. https://www.lesswrong.com/posts/nQWavk9mnwcv6ScMR/new-lesswr...
I mean "a human" as human classifier of the quality of a text, most wall of texts if not all I see retweeted ad nauseam online could be summarized in a few sentences. That's a lot of human hours being thrown down the drain for very little useful content.
There is no respect for the time of the readers. Nowadays it's not just the occasional post from yegge or patio anymore. In general, the first few sentences of an article should present a summary and convince me to go further to read the details.
It's not AI fanfic. It seems well written, and can be considered a novella. Flies close to what I have read in the past. I'll give it proper time to read it.
You apparently didn't watch Pluribus or read this. Pluribus is about the experience of essentially the last autonomous person on Earth. This is about the experience of the Singularity and the questions it raises.
Honest question, in what way did you find it preachy? I didn't feel that it tried to sway me in a certain direction. If anything, it made me think about multiple sides to many coins.
For how negative the scenario is on a lot of fronts, the text devotes the most space to the rosy colored aspects. An AI getting our protagonist into shape? Rehabilitating the "finance bro"? Curing cancer? Easy on the fuckin lube dammit.
The whole piece seems like it originated when someone assumes the very specific scenarions and predictions the lesswrong crowd has as a forgone conclusion and tries to imagine the most "humane" version. This is preachy if you're one of the crowd because "rosy" and its preachy if you're not because "forgone conclusions". This annoying taste is compounded by the general lack of substance or style otherwise.
And it's boring because it focuses on the most obvious first order effects and visions of this technology directly copied from the lab blog posts.
I love reading dry scifi. They generally have one single idea worth the time contained within them so I won't hold that against it. It's just that the ideas here have these two major holes.
I doubt we've seen any HN frontpage story this year that did not have a bit of upvote coordination from the author messaging their friends they just posted.
You can just do a quick scroll through the second page of 'new' to see how stories end up for people who dont.
I think this is a really interesting, well-written, topical piece of creative writing, anyone with a free hour or so should give it a read!
It reminded me of Pluribus and Armored Core VI, fascinatingly enough as they both feature (spoiler!) AIs/entities that appear innocuous but may have more sinister motives (in Armored Core it's a more foregone conclusion).
I don't think it's doomerism but rather a creative extrapolation of current worries about AI labs allowing agents to break containment because of their poor sandboxing.
What's also interesting (although more of a meta-comment) is the dichotomy between how users on Lesswrong and here have completely different options on it. In either case, it's nice and was worth my time, even though I don't have anything more substantiative to say.
I also thought of Pluribus in the bits where Seth collaborates - similar surburban utopian-horror sci-fi vibe.
The incremental reveals and mix of plausible and implausible also reminded me of https://en.wikipedia.org/wiki/Manna_(novel), which 23 years later has not aged too badly.
Lots of negative comments here, which is surprising as I'm enjoying reading it so far. There's a line which made me smile when August says "It's not a flaw — it's an understandable gap."
I absolutely hate this AI turn of phrase that I'm starting to see everywhere. Even one of our MPs in the UK wrote a Facebook post recently and it was full of lines like this. I asked him if he'd used AI to write his post but he didn't reply. I'm 99% sure he did and I hate it.
I did enjoy the story, but doesn't it kind of feel like all the characters talk in the exact same voice? And not... idk, how people talk? It wasn't enough to take me out of it, but it makes me wonder if the story warning about an AI takeover was written by an AI.
I thought that the characters reactions/behavior felt a bit off, most accepting if not reluctantly at first of AI takeover but honestly that's probably what would happen, including the arguments the the American dream has been dead for a long time because we are not "safe"(enter quote from Mr. Franklin here).
Freedom gives you the ability to get hurt, are we afraid of that?
> Freedom gives you the ability to get hurt, are we afraid of that?
A very large percentage of society I suspect is afraid of that and would happily give away freedom for safety. Eliza's argument does make sense, a dictator without an "ego", or at least not one like a human would have would be more trustworthy, especially when it had the option to force itself a lot more than it did but it didn't.
A movie version with dialogs like this would be hilarious. I don't think it's AI, just a person who doesn't know know or care about how to write in a conventionally good way, it gave my Ayn Rand vibes.
I enjoyed reading it too, but the ending was disappointing. But not as dissapointing as most comments here.
They all talk and think the same way. It's like it's all one person having a conversation with themselves. Maybe that's like some sort of hidden joke or something. "We were the AI all along"
I guess it takes a skill, a lot of elbow grease or both to be able to write different persons' voices well. I wouldn't read too much into it. A sign of an amateurish writer, most likely.
The story is nice; not super unique. The scene that Seth and Eliza see an old teacher of Seth is nice. The AI gives some people purpose and takes it away for some (Tabby).
I might be able to enjoy this as scifi but the source makes it difficult.
Lesswrong is one of the smellier armpits of the internet. My impression is that there are clearly a lot of smart people who post there, but they've collectively embraced a lot of delusional thinking. There have been examples where it has escaped containment and harmed people.
The most noteworthy is the Zizians, a fringe group that got a lot of its ideas from Lesswrong content and is actually linked to several murders. Not exactly fair to lump the entirety of the site with their ideas, but I'd argue that it was a direct result of the echo chamber.
Beyond that, Effective Altruism got its start partly from Lesswrong. Whether or not that counts as harmful would depend on how you see that movement, but one of its biggest proponents is now in jail.
There's a famous thought experiment that came out of Lesswrong that has resulted in a lot of distress and questionable life choices from people who take it too seriously. A lot of the AI discussion I've seen on the site has the same overtones, including this particular post.
44 comments
[ 8.7 ms ] story [ 102 ms ] threadYes
I guess philosophy, spiruality, religion and theology will be what the curious mind will set out to conquer next on the journey to self-actualization.
Most similar thing I can think of is "The Metamorphosis of Prime Intellect". Metamorphosis of Prime Intellect is way better and more comprehensive, imo.
Made a bit more uncomfortable by knowing the author might believe that; by writing this they're training an AI to trigger a self-fulfilling prophecy.
There is no respect for the time of the readers. Nowadays it's not just the occasional post from yegge or patio anymore. In general, the first few sentences of an article should present a summary and convince me to go further to read the details.
That's at least how it begins.
I'll maybe read some more of it in the evening...
The whole piece seems like it originated when someone assumes the very specific scenarions and predictions the lesswrong crowd has as a forgone conclusion and tries to imagine the most "humane" version. This is preachy if you're one of the crowd because "rosy" and its preachy if you're not because "forgone conclusions". This annoying taste is compounded by the general lack of substance or style otherwise.
And it's boring because it focuses on the most obvious first order effects and visions of this technology directly copied from the lab blog posts.
I love reading dry scifi. They generally have one single idea worth the time contained within them so I won't hold that against it. It's just that the ideas here have these two major holes.
This does not help the cult accusations.
You can just do a quick scroll through the second page of 'new' to see how stories end up for people who dont.
It reminded me of Pluribus and Armored Core VI, fascinatingly enough as they both feature (spoiler!) AIs/entities that appear innocuous but may have more sinister motives (in Armored Core it's a more foregone conclusion).
I don't think it's doomerism but rather a creative extrapolation of current worries about AI labs allowing agents to break containment because of their poor sandboxing.
What's also interesting (although more of a meta-comment) is the dichotomy between how users on Lesswrong and here have completely different options on it. In either case, it's nice and was worth my time, even though I don't have anything more substantiative to say.
I absolutely hate this AI turn of phrase that I'm starting to see everywhere. Even one of our MPs in the UK wrote a Facebook post recently and it was full of lines like this. I asked him if he'd used AI to write his post but he didn't reply. I'm 99% sure he did and I hate it.
Read by Leonard Nimoy: https://www.youtube.com/watch?v=nmcURKn2sf8
I thought that the characters reactions/behavior felt a bit off, most accepting if not reluctantly at first of AI takeover but honestly that's probably what would happen, including the arguments the the American dream has been dead for a long time because we are not "safe"(enter quote from Mr. Franklin here).
Freedom gives you the ability to get hurt, are we afraid of that?
A very large percentage of society I suspect is afraid of that and would happily give away freedom for safety. Eliza's argument does make sense, a dictator without an "ego", or at least not one like a human would have would be more trustworthy, especially when it had the option to force itself a lot more than it did but it didn't.
I enjoyed reading it too, but the ending was disappointing. But not as dissapointing as most comments here.
Nothing beats a good cliffhanger to make everybody hyped up for a sequel!
https://rentry.co/4y4vboud
Lesswrong is one of the smellier armpits of the internet. My impression is that there are clearly a lot of smart people who post there, but they've collectively embraced a lot of delusional thinking. There have been examples where it has escaped containment and harmed people.
https://en.wikipedia.org/wiki/Zizians
Beyond that, Effective Altruism got its start partly from Lesswrong. Whether or not that counts as harmful would depend on how you see that movement, but one of its biggest proponents is now in jail.
https://en.wikipedia.org/wiki/Sam_Bankman-Fried
There's a famous thought experiment that came out of Lesswrong that has resulted in a lot of distress and questionable life choices from people who take it too seriously. A lot of the AI discussion I've seen on the site has the same overtones, including this particular post.
https://en.wikipedia.org/wiki/Roko%27s_basilisk