I played a RPG session with GPT-3 and it was quite fun. The problem was the combat part, as describing violent events is against the TOS (just when me and a party of villagers had prepared an attack against an orc encampment!)
I guess that something that involves "animated violence" like pokemon might be a good idea to get around that.
One interesting weak point I've noticed with GPT is that if you ask it to give examples from a category which in the real world has hundreds or thousands of different possibilities, it will give you the same half dozen answers every time. You ask it to give you "opponents" and it will always give you male humans. You ask it to give you "monsters" to kill and it always gives you orcs, giant spiders, skeletons. If a chest is supposed to have "useful items", it's always a healing potion.
I guess it's giving you the most likely answer in the same way the most likely answer to the question "what color is the sky?" is blue, according to its training data.
Yup. I think this is one of the places where the sheen will come off after a while.
While temperature can mix things up a little, we’ll quickly start to see how the depth of LLM output is tied to the depth of LLM input — and people’s prompts are not all that varied and deep at the end of the day.
We’ll start to notice signatures to each generation of model in its responses to tiringly common prompts — especially in stuff like blog spam, homework essays, email punchups, casual fiction, etc
There are certain poles that it gravitates to that end up reading like verbal tics or lazy ideas, and those will be more obvious as we begin to get inundated with generated content.
Careful prompt work can evade those poles and tics, but most people won’t have the skill or drive to bother with that.
There would be parameters to evade the obvious picks.
temperature can actually go up to 2 in the API and you can also go use top_p < 1.
but for the more out of this world stuff, this is where fine tuning will come in.
The main model will always come in as vanilla anyway.
I think this is where something like the reAct framework would be super helpful.
A human dungeon master doesn't pull a random enemy from the aether super well (or at least I don't!!). When I pick monsters I either logically think what makes sense for the area, pick something that's cool or vaguely humorous that I'm feeling the vibe of, or... use a random encounter table.
For treasure and rewards... if it's not something hand picked, I'm again getting the loot tables out and rolling. And heck even for gold rewards and things, I'm rolling the dice.
After trying basic stuff with langchain, an AI integrated with these types of tools is really promising. I think more systems on top could make it into a passable DM- at least until context becomes an issue.
If you set it up with some ground rules and rules around it's behavior (or more like guidelines), you can make it be more creative.
Something like: "We're gonna start a text RPG game. Every animal we meet should be a made-up animal composed of joining two existing ones, with creative names being made for them. Don't use any usual fantasy tropes. Make encounters have surprising but logical outcomes" and so on.
> I guess that something that involves "animated violence" like pokemon might be a good idea to get around that.
I feel like this is a bigger thing than people realize.
Changing creative output to match the proposed ethical boundaries of a corporation that you're beholden to by using their tool seems like such a new leap to hoist onto the public en-masse.
I presume somewhere there is an agreement that forbids the use of 'notepad.exe' in matters of anti-state espionage, homicide, whatever; but this is the first time that a tool is actually good at self-checking to make sure that the license /whatever is upheld rigidly -- and I feel as if that has far-reaching effects on not just the creative output but the thinking structures for those that are involved in the use of such tools.
If you know that the tool that you're using forbids certain things, you're either going to think about using it for other things or pursue other tools; given that openAI is effectively the only game in town right now they seem to be in a unique position to affect change in the way people are thinking about using these tools.
this could be good or bad, I don't really sway one way or another, but it seems important .
It doesn’t take a certificate in applied shoulder massage from lancaster technical college to work out that it’s bad for society.
We’ve seen how much social media and manipulation has destroyed the fabric of society. Now imagine those same evil people can control all creative output for their own purpose.
Every single thing and person you interact with will be whatever they want. When you whatsapp people they might not even be real anymore, but they’ll certainly tell you why you should vote for president zuckerberg to be reelected.
They’ll promise that they’ll only use their control to stop nazism or whatever. But the nazis made the same promise about communists.
I had ChatGPT (not gpt4) semi-succesfully play a session of D&D where I played the dungeon master and it had no problems with violence against goblins. It did however constantly try to take over and play as the goblins as well, and I had to keep telling it that I was the DM, not it.
It was fun in the "look at what AI Is doing" novelty way. But it was pretty uncreative and generic.
I don't know if I agree that it's "dystopian" but I do somewhat feel it's strange to be "wasting" the massive amount of compute that GPT4 has in order to play a text based version of a Pokemon game that ran on a Gameboy Advance decades ago.
Oh it is absolutely a waste of compute practically speaking. I just find it incredibly interesting that it's even possible for GPT to convincingly recreate many aspects of the original game, including the rules about what is and is not possible at various points, and I haven't seen many others exploring in this direction. I'm very curious as to what Pokemon-simulation-adjacent things GPT is capable of.
The 90% of the tecnology used in the internet and even in your pocket was born because some guys wanted to play Space War under a PDP-8 machine with no OS.
The technology to draw "widgets" in your Unix console was born to play computer games depending on them.
Do you believe the amount of time developers have spent building hello worlds is a waste because those are useless applications?
Should go without saying, but the interesting thing about this thread is not that you can now play a flawed text version of an old game. It's that this example toy use case manages to explore the new capabilities and limitations of this new promising tool. This improves our understanding of this technology, and helps us make better use of it in the future, for more productive and innovative applications that we may not be able to predict yet at this point.
The OS being shipped for lots of firewalls and the base of OpenSSH still ships today games in base such as a near 50 year old text adventure inside a cave, tetris, an air trafic controller sim, an RPG and a crude MMORPG, among others such as monopoly, mille or boggle.
Not so weird.
Nerds have been playing with computers and making games for them since early ages.
I wouldn't call it dystopian, but merely the next level in inefficiency, somewhat like Super Mario as an Electron App and other similar amusements that have made it here on HN.
VC take note: I would pay streaming subscription prices, for 24/7 access to a LLM chatbot DM which correctly and configurably runs a campaign for me [and friends].
Let me pick between styles and tones (some openly modeled on popular podcasts and streaming play), let me tune a bunch of controls, give me a nice UX if you can, but build me a consistent world which spoons out the world-building _and remembers it_ and I am a customer for life.
Oh yeah and the price I will pay doubles if this is illustrated throughout with generative art (also tunable wrt style).
We can wait for music and speech synthesis and sound effects for v1.5.
You don’t want a VC involved in this idea. Their job is to chase extreme growth and burn down any investment that doesn’t grow enough along the way. They’d ruin what you want this to be.
But you’ll 100% see this starting to mature as homespun Discord bots in the next year or so, and eventually showing up as either Steam games or web apps from bootstrapped or privately-funded companies soon enough to.
It’s not a hard thing to get going, and so it’ll just come down to sorting out a business model and then iterating on features. No VC required. Just time, passion, and some supportive fans/users.
> but build me a consistent world which spoons out the world-building _and remembers it_
Yeah, one potential way to do this is to add input / output to a semantic graph store a la WikiData, in addition to the more bog standard text and image outputs. I've been wanting to try this out ever since seeing how good LLMs are a semantic decomposition.
I can't wait to read about all of the fascinating applications people will conjure up. I've been playing with it GPT-4 through ChatGPT today. I feel like a little kid with the year's hottest toy.
I can’t understand people who are so excited about GPT. It fills me with absolute dread, and if I could vote to make it illegal, I would.
In a world where human intellect becomes meaningless, nobody can predict what will happen next, and a lot of the possibilities are not good. Does anyone want to live in a world where all books, art, etc. are produced by machines, where you can’t get a job tinkering with computers anymore because AI does it better, and so on? The optimistic case for AGI is that if nobody had to work they could spend their time on hobbies and creative passions, but what’s the point when an AI can do them better than any human can?
Previous machines only replaced humans at tasks that are tedious and boring, whereas the new crop of AIs seems poised to replace us at the very things that make us human.
Not to claim that GPT-4 is all the way there but it’s surely a huge step forward, and I wouldn’t be surprised if we live in such a world in the next decade.
Sure why not? people create amazing things no matter the medium, maybe this will enable new amazing things we haven’t experienced before! I can tinker with anything. No one can ever predict what happens next, good or bad, maybe tomorrow we’re wiped out by a meteor or we cure cancer. Life is a highway.
There will always be a place for human intellect. Machines will not replace us. I'm not too worried, as long as they are still reliant on us as their ultimate source of truth.
> There will always be a place for human intellect. Machines will not replace us.
I have precisely zero confidence of this and anyone that thinks otherwise is very shortsighted or ignorant or simply lacks imagination. Human intellect is limited by many environmental factors. It has to fit through a 10cm canal, it can't use too much power, it must be made from simple and impure combinations of hydrogen, carbon, and oxygen that have poor conductivity, it must dedicate much of its energy to non-reasoning functions like digestion and respiration control.
Just as we made machines with many times our physical strength we can make machines with many times our cognitive strength. The brain is ultimately just an arrangement of about 1500 grams of matter. If we find better arrangements and use better matter and assemble larger amounts of it we will have something with much greater cognitive strength.
> I can’t understand people who are so excited about GPT. It fills me with absolute dread, and if I could vote to make it illegal, I would.
You want to make it illegal because you think it can replace your job? Should we try to outlaw any type of automation then too, as people lose their jobs over automation as well?
> The optimistic case for AGI is that if nobody had to work they could spend their time on hobbies and creative passions, but what’s the point when an AI can do them better than any human can?
People don't generally spend time on hobbies and creative passions because of the output, they spend time on it because they enjoy the time they spend on it, because of the process and the joy of it. No matter if AI can draw better pictures, there will still be people drawing pictures because they just enjoy drawing pictures.
Just like I enjoy programming, even when I know there are better programmers out there than me.
> You want to make it illegal because you think it can replace your job?
It’s hard to believe this is what you got from my post.
> No matter if AI can draw better pictures, there will still be people drawing pictures because they just enjoy drawing pictures.
I’m really not so sure. Maybe some will, but the overwhelming majority of people will not want to dedicate time and energy to learning a craft that is completely futile in the end.
> I enjoy programming, even when I know there are better programmers out there than me.
Yes, but at least programming now has a point. I’m sure you have experienced the joy of making something that didn’t exist before, that took effort to create, and that helped you or someone else, even if another person could have done it faster. Would you get the same joy simply re-creating something that an AI can do in seconds? I doubt it.
I get tremendous amounts of joy playing my guitar, with my mediocre guitar skills, playing songs that my computer or John Mayer can play a million times better than I can.
I get tremendous amounts of joy speedrunning Celeste, knowing that a TASbot can do it in a way I will never ever be able to replicate.
> I’m really not so sure. Maybe some will, but the overwhelming majority of people will not want to dedicate time and energy to learning a craft that is completely futile in the end.
I think I have a grasp on where you're coming from, and here's what I'm feeling: better philosophy, and better general education in philosophy, could be a good solution.
One reason I think this is that for some reason you don't already think everything is completely futile. Because... it is, one could argue. So, maybe you already have a culturally defined reason this is not the case (developed by philosophers, and this includes priests if that's the case for you), or you have undergone a rigid philosophical introspection and determined for yourself why think isn't the case, or, maybe you just haven't thought of it, and when you do, a couple thousand years of philosophical insights will be ready for you to choose why, for you, things aren't futile (even if they are!).
I want to think about this in broader scope though, because to me this is the question at the root of industrialization. I keep asking the people in charge whenever I meet them, "what do we do when automation has driven the value of human labor to pennies?" And nobody ever has an answer. It's a somewhat similar question to "what do we do when we don't have to work to stay alive?" At least, I think it's similar, because there's two answers to both questions, both answers are the same, and both answers could apply today if we didn't prop up artificial scarcity: "Nothing, and, whatever we want."
You mention "creating something that didn't exist before." One of the things that depressed me when I was studying writing, and often depresses young writers, is the realization that one way or the other, all stories have already been written, mostly by shakespeare (or at least, written down by him), or by a couple greeks, or a few rare influxes in the modern era as anthropologists finally started writing down what indigenous cultures have been saying for a few millenia. But that can't be true, right? New, interesting stories get written every year. It's true if you break them down into their requisite parts, basically tokenize the tropes. I mean at some level it's always either Comedy or Tragedy. Clearly though, new stories have value, and meaning, because people spend their time reading them and talking about them, voluntarily.
To bring it back to your analogy, building something that's already been built, can still be valuable to someone, depending on your definition of "already been built" (there's already an code editor, why build another? oh wow this one has modal editing, that is cool) and also because even if it's a very similar copy (as avatar is of pocahontas) there's value in the "flavor," the different taste. Even identical copies can have value: an open source version of a closed source tool with identical APIs. And even if it's a uselessly identical copy, it can have value simply in the effort you put in to build it yourself, such as fools like me that deploy our own email servers, or, repair our own watches, whatever. Of course someone can do it better than me. It's actually kinda stupid for me to do it myself, I might break something. But there's value to me in doing it myself.
Circling all the fuckin way back because I don't know how to stay on topic: A world where AI can do everything for us is basically no different than today. With some honestly relatively minor changes, we can automate most things we need to the point that human labor effort required is minimal. We decided we needed same day deliver from amazon, and so we maintain a massively inefficient system (and also artificial scarcity to keep the exploited classes in line) to create systems to cater to this need, but if we let go of "needs" like that the system ceases to be necessar...
> Would you get the same joy simply re-creating something that an AI can do in seconds?
AI, as it stands, has no agency of thought^ All AI works requires instruction, and that instruction is given by a creative human. So artisans could then become instructors with incredible new abilities afforded by AI tools, or they could just create like the old artisans for the love of creation.
^ If an AI agent did, I would actually consider it to be 'conscious' in the same way Martin Pistorius was conscious but completely immobile.
I’m really not so sure. Maybe some will, but the overwhelming majority of people will not want to dedicate time and energy to learning a craft that is completely futile in the end.
By your logic, nobody would ever want to take up running as a hobby either, since no human could ever run as fast as a cheetah.
Chess is still popular, despite AI being able to defeat the best humans.
> I’m really not so sure. Maybe some will, but the overwhelming majority of people will not want to dedicate time and energy to learning a craft that is completely futile in the end.
We’ve had photographs for a long time, and people still do representational art of real places and things; we have superior industrial mass production and people do inferior handicrafts, etc.; we’ve tested your theory extensively and its false.
No, economic demands mean many people can’t do as much of these things as they like because they need to do something that will pay the bills, and demand for those types of crafts is lower than it once was. So, distributional economics is a concern. But will people do things even when there’s a “better” higher-tech way? Yes, absolutely.
> We’ve had photographs for a long time, and people still do representational art of real places and things; we have superior industrial mass production and people do inferior handicrafts, etc.; we’ve tested your theory extensively and its false.
Their theory is only technically false. Yes, people still do those things.
But how common is it that anyone who isn't independently wealthy actually lives a comfortable life doing that for a living? Practically speaking, no one makes a living doing art or being an artisan of one kind or another.
It feels very much lately like the next decade will see huge swaths of knowledge work made obsolete. And it will feel really self-serving when the people at the helm of that trend tell everyone who's been displaced by it that they just need to adapt or start a technology company like they did.
> But how common is it that anyone who isn't independently wealthy actually lives a comfortable life doing that for a living? Practically speaking, no one makes a living doing art or being an artisan of one kind or another.
What??
This is the kind of comment happens when we no longer have yellow pages and business cards and bored kids with nothing to do but stare at them.
I assure you that there are in fact many people making a satisfying and secure living taking photographs and making things.
> But how common is it that anyone who isn’t independently wealthy actually lives a comfortable life doing that for a living? Practically speaking, no one makes a living doing art or being an artisan of one kind or another.
If you reread the post you are responding to you might note that I mentioned how, while people will freely choose to do those type of “obsolete” crafts, economic forces tend to limit their practical freedom to do so, so that the problem to deal with isn’t automation but distributional economics.
Not that any but a small number of people are “comfortable” as artists even in non-obsolete arts; there tends to be an oversupply of people wanting to do them compared to demand, resulting in a narrow slice of success and a lot of people either struggling or only marginally attached to the art field. So, even outside of marginalization due to technical progress, distributional issues are the constraint.
People still play chess and Go despite those games being dominated by computers. People still draw despite other human artists being better etc.
For most people the point of a hobby is not done in anticipation that they will become the best in the world, but rather just because they like doing it.
> > > I can’t understand people who are so excited about GPT. It fills me with absolute dread, and if I could vote to make it illegal, I would.
> > You want to make it illegal because you think it can replace your job? Should we try to outlaw any type of automation then too, as people lose their jobs over automation as well?
> It’s hard to believe this is what you got from my post.
It's literally the words that you posted, verbatim, and wrote at the start of your comment: You want to effectively ban LLMs & AI as a whole, just because your emotions about it made you want to, with no further justifications as to why it should be illegal. You just feel that it is.
The solution to "people are killing themselves because they have no purpose outside their jobs and their job just got automated" is not outlawing technology, it is helping people find purpose outside of work.
That's essentially the same thing that GP said. I know I'd rather safety nets be improved for this future rather than outlawing, but don't see it happening until some major suffering and upheaval happen. Likely, they have a similar outlook.
I don't think "I'd outlaw technology if I could" is the same as saying "technology is good actually, let's find ways to make people happy in ways where automation doesn't matter".
Thinking that the latter will be difficult does not justify the former position at all.
I don't understand the frame of reference where it makes more sense to fight to outlaw automation than it does to improve safety nets. If I had the political capital to do the latter, I can't imagine wasting it on the former.
> we are making absolutely zero progress on improving safety nets.
Citation needed.
Progress is being made. Andrew Yang ran for President on UBI and was taken seriously. Universal Healthcare has more support now than ever (and growing). It takes time for people to change their minds.
For some people, including me, a big part of the enjoyment comes from thinking that I could become one of the best in [my region/my country/the world] at a particular skill.
Maybe I'm more competitive than the average person, but I'm sure that there are millions of people out there that feel the same way as me.
And I think that when we realize that we're not the dominant species in the planet anymore, it's going to be a big emotional shock to a lot of people. We need to feel superior, or at least we need the possibility of being superior.
Here’s something - for every “best” person in a given field, there is almost certainly several other people alive who could perform similarly but didn’t have the same opportunities.
In your given scenario, there are _already_ so-called “losers” who lose “fairly”, but also lots of “losers” who really shouldn’t have lost.
Did you ever consider any of those people before this? Don’t you think they’ve been similarly depressed by the unfair advantages it seems others have in life? How is that _at all_ different from being inferior to an automatic process, in terms of the impact, and why are you only worrying about this issue now that it’s more likely to effect your chances specifically?
Is it possible that viewing the world through a competitive lens is toxic? That humans should seek out happiness rather than awards? Peace rather than conflict?
I’m not saying it isn’t going to be hard for people to readjust. But certainly, the notion that “I’m gonna be the best” is something that results in a more toxic world, AI or no.
> We need to feel superior, or at least we need the possibility of being superior.
As far as I know, Jimmy Hendrix never got depressed due to an inability to make those distorted guitar effects using only his mouth.
These large language models are instruments. While I'm uneasy about camping out feeding data to a prompt controlled by a company I know nearly nothing about, I'm certainly excited by the prospect of playing with a decent local, low-octane open source version.
To not play with these things out of a feeling of inferiority seems like the height of vanity to me. Either that, or a signal that someone didn't get a decent liberal arts education.
But there are also sub-divisions. In most sports, the best female athlete knows she won't ever beat the best male athlete, so they generally compete in separate divisions. I think people will still want to be the best human, even if just outdoing their personal best isn't a good enough reason. No one can run as fast as a motorbike, or a cheetah, but they still run.
I think what's depressing is that AI is poised to automate tasks that are creatively or intellectually fulfilling. And because GPT has advanced faster than mobile robotics what's left for humans is the tedious, repetitive, physical tasks that are hard on the body and uninspiring on the mind.
Instead of each person commanding a household of personal robots - a la Jetsons - we're going to be ordered around to pick up garbage and clean windows by machines.
100% agree. It always irks me that we’re using AI to solve “problems” that don’t exist (the automation of creativity and relationships, things that make us human) while not putting as much effort into real issues facing the world today (poverty etc.)
Hackers mainly hack on things that personally affect them and things they find personally gratifying to work on. Someone who is inclined to like images, AI, ML and programming are likely to work on "problems" where all of those intersect.
There is also the thing where some things are really not about technology, but are larger issues. They cannot be solved by just writing software. And if you're looking for something to solve via writing software, you won't attempt to solve that thing.
Poverty falls into this bucket, where no matter how much software you write, you cannot solve poverty by just deploying programs.
Not everyone can or want to save the world. Some people just want to have fun while they can, because eventually you end up in the dirt, no matter what you do (unless you come up with a way for humans to be immortal), like the rest of humanity.
But, seemingly you feel strongly about wanting people to work on those issues, so what do you spend your time on, on a daily basis? I'm guessing you are on the front line trying to solve one of these big issues?
> Hackers mainly hack on things that personally affect them and things they find personally gratifying to work on.
We're not talking about some rando hacker cranking out a cool Emacs module, these are projects backed by companies like Google and Microsoft and are being integrated into some of the most widely used tech products in the world like Google Search, Android, iOS, Facebook etc.
I am fairly certain that low-effort AI-generated creative works will become part of a new mainstream wave that will be quickly filtered out into mediocrity. Creative people will still be able to carve out their place by using AI as a powerful assistant tool because they have deeper domain knowledge than your average person trying the same.
At the end of the day you are basically typing prompts and reading answers by the AI, you do not know for 100% certain that they are correct so you would try to somewhat double-check their facts. Maybe you don't, regardless you are in essence tricking yourself into reading an interactive book guided by your prompts. You sure as hell won't become a professional at some domain by just reading this one interactive book. Try asking how to create some sort of vaccine and unless you specialize in that you will be quickly overwhelmed by the seemingly random terms the AI will spit out.
In my view these latest AIs will probably replace how we search for things in internet or heavily improve existing methods. It can already do that for you, simply ask the right questions, you can even set how it should roleplay as (e.g. Socratic style would be great for learning new things).
In case anyone is curious, I asked ChatGPT (the old one, not on GPT-4) to rebut my comment, and it produced this:
> A rebuttal to this comment would be that AI technology is not intended to replace humans, but rather to augment and enhance human capabilities. Machines and AI are tools that can help humans accomplish tasks that are difficult, dangerous, or time-consuming. The rise of AI has already created new jobs and industries, such as AI developers, data scientists, and machine learning engineers. Additionally, the development of AGI is still in its infancy, and there are many ethical and technical challenges that need to be addressed before it can become a reality. Finally, the human creativity and imagination cannot be replicated by machines entirely, and AI-generated art and literature can be seen as a unique form of creative expression that can coexist alongside human-made art.
> [...]spend their time on hobbies and creative passions, but what’s the point when an AI can do them better than any human can?
I generally enjoy my hobbies even when there are billions of people that can do them "better". Whether AI can "beat" me at them too doesn't matter much to me (apart from finding it an interesting development).
The luddites had a point. What happens in an economy when machines can do most tasks? What happens to power structures when people become a cost rather than a benefit?
> What happens in an economy when machines can do most tasks?
We invent new things for people to do. As we have time immemorial. What happens to clergymen when nobody has faith in a religion? They find other things to do than preach.
> What happens to power structures when people become a cost rather than a benefit?
If you want to look at this pessimistically - a good portion of the world's population can already be considered a cost and are a net economic negative on the privileged people's ability to hoard even more insane amounts of wealth. We've, thankfully, decided that mass genocide of impoverished people is inhumane and humanitarian efforts are instead created to try and improve their lives. Even a pessimistic take that the humanitarian efforts only being done to create more workers doesn't hold up given a cost/benefit analysis. More money is invested than could ever be extracted again - and yet we continue investing.
Maybe instead of filling our lives being paid to dig holes so that others can be paid to fill them we could turn more attention and efforts to improving people's lives without having to worry about sustaining society through work?
Horses, unlike humans, are incapable of specializing in new or complex tasks and have a very narrow set of tasks they can accomplish even with a lifetime of training. The argument holds almost no water unless you assume humans are only good for a single, maybe two, tasks and are incapable of learning or being trained on other tasks if the task they were performing was made redundant.
We didn't cull switchboard operators and calculators when we automated their jobs through technology. They found new jobs.
> Leaders can extract value without worrying about the people's wellbeing.
Historically this has had limits. After those limits have been reached - leaders quickly find themselves 6' under ground if people even gave them that courtesy. There are parts of the world where this has already happened - this century, maybe even this decade. Consider yourself quite privileged if you live in a part of the world where the mere thought of this seems outlandishly absurd and unrealistic.
The luddites lost their status, leisure time, and middle class incomes. Their descendants worked 12 hours a day in factories. They definitely had good reasons to push back.
Revolutions are never smooth and privileged groups threatened by new technologies or ideas always have reasons to push back and will do so fiercely, that's plain human nature. But if we block progress to protect the status quo of said people, are they going to give back value to society in the same magnitude as said progress in the long term? I don't think so really, at least when reviewing history, it always pays reasonably well in the long run*.
This discussion is very old, as it applies to many examples as monarchy/nobles in the French Revolution and other similar revolutions, to horses (and highly specialized humans profiting from them) when cars became cheap, to hunter-gatherers when agriculture developed, and a large etcetera.
The only difference I see in "advanced AIs" as a technology is that the individual immediate wellbeing of almost every human is probably threatened as there will be more jobs destroyed than created.**
PS*: Personal positions in these kinds of arguments depend on other personal opinions and predictions about an specific sociological/technological "advance" being of net positive value for all society. If your opinion is contrary to that, possibly staying as hunters-gatherers or being governed by kings and emperors (or something in between, just some extreme examples to make the point) were better courses of action.
PS2**: I'm talking about human-aligned AIs. Bring a rogue AI agent with misaligned objectives and with direct or indirect physical presence to the discussion and there are no net positives to talk about (for humans).
Didn't the machines ended up creating more jobs than there were before even taking into account the lost ones? They had a point, until it turned out they were wrong.
Also, wasn't innovation getting in the way of other jobs since before? Didn't Uber and similar applications end up becoming competition for the taxis? In my country taxi drivers were protesting for those apps to be banned, yet they couldn't compete with the convenience and safety of the apps. And before that, weren't horse-drawn carriage drivers protesting against cars?
> Many Luddites were owners of workshops that had closed because factories could sell similar products for less. But when workshop owners set out to find a job at a factory, it was very hard to find one because producing things in factories required fewer workers than producing those same things in a workshop. This left many people unemployed and angry.
What happened to horses after most of their tasks were done better by internal combustion engines? It's weird to imagine a world where humans have so few niches, but I thought we were decades away from passing the Turing test.
> They had a point, until it turned out they were wrong.
Meanwhile people are pushed into shittier and shittier jobs with ever decreasing meaning
> Didn't Uber and similar applications end up becoming competition for the taxis? In my country taxi drivers were protesting for those apps to be banned
And now uber drivers are seen as contractors, which means they miss most workers benefits, while being paid like shit thanks to the race to the bottom, the only winner is uber
I'm scared and I hope government intervention will be swift.
But on the artistic side... new tech makes possible new ways to be creative. And there are still acrylic painters even though Photoshop exists. And there are still human races and sports even though machines are faster/stronger. So I'm thinking people already recognize there are different kinds of performers, and by and large people haven't been cheating much that anyone could tell (though ghostwriting and such already exist).
I fear government intervention would not stop the progress of AI, it would only replace some negatives with others. The cat's out of the bag, people will experiment and soon we may have AIs like this running on home computers -- I know that's what I will be experimenting with, unless we get some really draconian laws about what I can and cannot do with my own computer. And if the US government outlaws AIs or something, are we just going to watch as other nations capitalize on the advantages while we stagnate?
People knit sweaters, garden, run, etc. The lack of value doesn't make it unenjoyable. The difference is people could choose what to do with their time. Imagine life if there was never a need to work!
Riding horses is not tedious and boring. Carving is not tedious and boring. Sailing is not tedious and boring. Cooking is not tedious and boring. Performing music is not tedious and boring.
Yet machines have long ago replaced all of these things. It turns out that when you have a machine replace a tedious and boring thing, people still find ways to do it anyway. Less of them, perhaps, but the ones that do still do it seem to be quite innovative with their style and technique. And everybody else found other ways to use their time (or perhaps: be used for their time).
You can worry yourself into believing that AI invites a whole new category of transcendence if you want, but that’s your imagination telling you that. There’s no science or history behind your worry. Just some gloomy inductive hypotheses that got seeded by mid-century scifi authors in a world that might be annihilated by a nuclear conflict any moment.
Take a step back and see what comes rather than assuming you know. Trust that you’ll know if or when there’s something you need to do.
You’ve only got a few decades to witness; it’s better when you stay in the present of them rather than in worked up anxieties.
And geez, if you really want to dread something anyway, at least point yourself at one of that big scary things that are already looming like climate catastrophe, resurgent global conflict, the sunset of democracies, or capital centralization. If we make it to your AI fears coming true, you could say that’s a win!
This is a privileged perspective. You have all your material needs satisfied, so when you see GPT, all you can see is threat to your own personal spiritual/creative fulfilment. Maybe you will end up being a 25 year old retiree and have an existential crisis over the boredom and lack of purpose, and I agree that sucks and I feel for you. But this should be low down on our list of societal concerns.
What we should care about above all, is economic productivity per capita, because this means less people struggling to make ends meet. We should be cheering on technological breakthroughs that power the trend we've seen in the last 100 years of poverty alleviation. Maybe we'll need to couple AGI with a UBI to ensure the gains are spread out. But either way, the huge potential for poverty alleviation and economic prosperity should be the primary prism through which we view AGI, second only to safety concerns. Existential angst of those that are already wealthy is far down on the list of concerns.
Given the current emerging wealth gap and all trends in the Western world I fear you’d have to be incredibly naive to think the long term goal here is to benefit the average person.
This is simply a play by capital to reduce and remove expensive knowledge worker roles and drag them more in line with the rest of the population already struggling to get by. You won’t be a “25 year old retiree” because that’s bad for those in charge.
You’ll be a “25 year old working 3 jobs just to scrape by on your rent because you’re just a warm body and we can replace you easily”.
UBI is political fantasy, the US can’t even offer proper universal healthcare - you genuinely believe they’d pursue that when the alternative is more power and an even greater reliance on capital?
in all fairness, I can't understand people who dread being replaced by machines.
it's such a preposterous proposition for me, like - replaced in what sense? No one is you. You're the only you. I'm the only me. We could make a machine that is similar to us in some way - acts or even thinks like us - but so what? That's all it is - something that's like something else. There is no 'replace,' I don't cease to exist when a computer does something that I can do. Even if you were to flawlessly duplicate me, it wouldn't invalidate my existence, or even pose much of a threat - if anything, it would only make me stronger, because then there would be two of me.
Machines' similarity to us does more to validate their existence than it does to invalidate our own, in other words.
I believe you’re simply taking the wording too literally.
You may not cease so exist, but a decent role for you in society might. The capital class have invested tens of billions of dollars into AI in the hopes that it will be enough to replace and heavily reduce the wages of knowledge and creative work.
Given the increasing wealth gap already emerging it’s highly likely the long term goal of technology like this (however overhyped it might currently be) is to essentially enslave the population.
Knowledge workers have had it good for a long time. This technology will attempt to ensure you have no further role. That’s what the OP is worried about, not some philosophical nonsense about the self, the long term possibility this profession, and thus a huge part of their identity, becomes obsolete.
"AI in the hopes that it will be enough to replace and heavily reduce the wages of knowledge and creative work"
But that's not true because the best stuff capable of generating AI art today is open source and capable of running on commodity hardware? People might've invested, but if Microsoft can generate nice pictures, so can a lot of people now, at the same or even better quality.
There isn't a lot of proof that ChatGPT will be in the hands of OpenAI alone forever, so likely everyone will have similarly capable machines in the near future.
The only thing humans need to do to get the future right, is learn to live peacefully with each other, and the algorithms, can we may have a very incredible future on our hands.
We fear machines killing us because it's what we do to each other, if we didn't have these tendencies, maybe an AGI would accidentally kill us, but that would be better than it killing us because it learned violence and paranoia from us. It would of course suck, but it would suck less.
I feel like you’re missing the larger picture here.
You’re focusing the discussion around art. Historically art has always been a difficult way to make money. Open source tools that make it trivial will just reduce the number of individuals able to make a living creating art. The same is true across all areas of knowledge work should this technology eventually reach the promised heights. Any work that requires specialised knowledge on a computer would become as simple as creating art, and thus can be paid less and performed by a wider range of people. It will save the capital class a substantial amount of money and ensure that those left employed have even less power.
“There isn't a lot of proof that ChatGPT will be in the hands of OpenAI alone forever, so likely everyone will have similarly capable machines in the near future.”
Microsoft didn’t invest 10
billion dollars in an eventual open source project. There’s no way these tools or their source will be available to all, you’d have to be rather naive and completely ignorant of the history of the people involved in funding OpenAI to believe that (and I don’t just mean Microsoft).
Hence my belief that these tools will eventually be used to further the already growing class divide. Those with capital will have full control of the means of production, employees won’t need specialised knowledge (and thus have no bargaining power to extract decent salary and working conditions). Knowledge work has led to the best conditions for the working class in history. Its destruction is not a good thing unless you’re a member of the “elite”, which, as you’re posting on HN, you’re probably not.
I have no idea what you’re talking about in the final two paragraphs, this isn’t a science fiction film, nobody is talking about a Terminator scenario. This is a capitalism problem that tools like this will only intensify. There is little evidence to suggest a utopian vision, but plenty to suggest the opposite.
I've never seen anyone argue the thing you seem to try to invalidate
The real question is what happens if you're 50, your job gets replaced and we still haven't come up with UBI or some similar system.
Automation + "100% employment goal" means we're pushing people in more and more meaningless jobs. The 20th century saw crazy advances in workers right/working conditions and it somehow seems to be slowly revert to worse conditions and more and more meaningless jobs
We'll need a massive perception change on what work is, the meaning of work, societal organisation, &c.
As someone who is currently dealing with a sudden worsening of a chronic illness and a healthcare system that can be described as "a brick wall with a flow chart", AGI please replace us already, we are incompetent and undeserving and I would much rather live a fun "meaningless" painless existence than the hell I live in now.
Same here. Lying here with a 6 part fractured leg in agonizing pain, alone. Hospital bills total near a million. Being in the hospital was like a prison, was victimized there (physically), with no cameras in patient rooms. And being home is a privilege despite having no support.
You're still allowed to make art even if machines do it way better. I play guitar and there are millions of people better than me, but I still derive pleasure from it.
<< In a world where human intellect becomes meaningless, nobody can predict what will happen next, and a lot of the possibilities are not good.
I will pose a counter and let me know how it fits your prediction.
I posit that in a world where GPT is present in everything ( you don't write and email; you tell your AI: "tell them fuck off in a polite way" ), ability to think will be even more scarce ( so a person that can think will have an edge ). Some jobs will be automated ( a lot of white collar jobs at that ), but, based on the output I have seen so far ( some simple ad text, some SQL code, some python code ) it was closer to copying from stackoverflow than having Jarvis working for you ( and you still needed to watch it to make sure it makes sense so maybe actual job loss will be stemmed somewhat ).
Thus far ( that can naturally change ), it seems actual creative work is probably ok.
In my world, we seem to be moving towards a weird version of idiocracy ( can't count, can't write IF/THEN, can't think abstractly, can't even write a prompt ).
And in that glorious future, there will be people queuing for 'good prompt services'.
> Previous machines only replaced humans at tasks that are tedious and boring, whereas the new crop of AIs seems poised to replace us at the very things that make us human.
After a disruptive technology, humans always find new ways to adapt, and express their humanity. TV series of the 20th century frequently had AGIs as tools that that helped the protagonists, and we might as well end up using them as ad blockers, to detect their own use.
I wonder what else you would vote for. Anything else you'd like to share with the online community on what you think is wrong with the world? I'm genuinely curious what other kind of viewpoints are out there in the world that you think are 100% normal to hold.
Do you think the same about computers in general? Maybe we should go back to having hoards of office workers on abacuses to restore all those lost jobs.
Apologies for the snark - that was just my knee-jerk reaction! Personally I'd love it if AI can take my job. It'd force me to go find something actually unique and interesting to do with my time.
These modern AIs still require human inputs. ChatGPT is only so smart because it reads the stuff you and I put on the internet. If the internet and books become bogged down with AI-generated content, then it's hard to imagine the AIs getting better beyond that point.
There's a lot of different ways this could unfold and I don't know which possible future is going to be the future, but my money's on a "world of spam" scenario where AI's biggest contribution is reducing the signal-to-noise ratio on the internet by such a large degree and we end up in a bizarre feedback loop where content is produced by AIs for AIs as a vehicle to show ads to AIs because everybody on the internet is trying to use AIs to make a quick buck. This is arguably a good thing if it drives "human culture" away from places like twitter and reddit and news.ycombinator.com and back into real-life interactions, or at least directed communications such as e-mail with people that are known to actually exist.
Recent advancements in AI have led to things I never thought a computer would ever be able to do and that's very exciting but it's all stuff that would be mundane or even disappointing if a human did it.
>where you can’t get a job tinkering with computers anymore because AI does it better
i really can't imagine GPT getting to a point where it can competently write a complex program using a simple prompt, unless the prompt is so detailed that you'd be better off doing it yourself. That's really what high-level languages are anyways, just a detailed prompt that tells the compiler how the program needs to behave so that it can generate a sequence of instructions using the ISA for the given CPU.
If your job is writing "glue code" such as something that just takes data data from a REST and dumps it on SQL then there's a solid chance that you're about to get automated out of a job. If you're doing something more complicated such as compiler development or kernel/driver development I can't imagine any of these deep-learning models ever replacing you. Imagine the chaos that would unfold if ChatGPT or codex was writing C code unsupervised.
> I wouldn’t be surprised if we live in such a world in the next decade.
We won't live in that world in the next decade or even in the next 100 years. The technology upon which GPT is built is a dead-end in terms of human-level intelligence.
GPT is an elaborate parrot. As convincing as it is, it's not actually fully capable of doing most if not all tasks that competent humans can do. The largest takeaway for me is that it has shown that intelligence can be mimicked pretty well and perhaps many people are more like parrots than they are "intelligent" creatures.
I challenge you to explain how an entity that isn’t capable of something we might reasonably call “creativity” or “intelligence” produced this output. Was it in a corpus somewhere? (Google translate it if you can’t read French). The “///“ were inserted by me as paragraph breaks because otherwise HN eats them.
> Write a poem in a made-up language that looks superficially similar to French
I threw that poem into google translate. I think it was actually just French? It didn't actually fulfill your prompt. Is your claim that it's ability to write a poem is a sign of creativity and intelligence? A language model writing a poem is one of the things I'd expect a language model to be able to do. Certainly impressive, but not one of the particularly interesting or surprising things I've seen GPT-3/4 do.
I don’t understand how GPT poetry is supposed to refute the standard refrain that GPT is a statistical parrot that has “learned” what next-word keeps a text sounding poemy. It operates on the same principles as when it composes boilerplate business emails or physics theories. Never mind that you asked for fake-French and got actual-French talking about fake-French.
lmao this is the best example of chat GPT not working at all, this isn't "a made-up language that looks superficially similar to French", it _is_ French, and it doesn't even rhyme, because chat GPT can't rhyme in French for some reason
A programmer literally just translates human requirements to machine instructions. Nothing more. That sounds about as tedious and boring as a job can get. Why should we want to code anymore than people wanted to make welds on cars, or pick vegetables?
I name things, articulate relationships between them, discover elegant formalities, probe complex systems, interpret ambiguities, mould systems into new ones, solve puzzles… most days, it feels like sculpting or writing poetry.
I don’t really care if AI does some of that too.
Incidentally, picking vegetables can actually a pretty nice time too.
Look at the bright side, suppose all that comes to pass and all creative digital content is produced by machines.
Machines still don’t have a good way to build physical things in the real world, so human skills will focus on physical things, like woodworking, or carving statues, construction, etc. Ultimately these are more satisfying human endeavors that make a person feel alive. Making us feel more human, and less like machines trying to do machine things such as coding or image making.
I kind of agree, I don't really even like "coding", I like producing cool products for people to use, the coding bit for me is just like, the worst and also, mostly the easiest part, which is why I think I hardly actually code, mostly it's scaling, deploying, working to gather and design new features from requirements etc.
When I look outside the window I just feel shackled to a desk, I hate it.
We live in a society forged in the aftermath of industrial revolutions. Now in the aftermath of a possible AI revolution, we have to somehow divorce social well-being from individual economic throughput.
AI might just make wages obsolete.
In any case, we can still look to human needs to predict future demands. Humans will still need to eat, exercise, learn, consume entertainment, produce creative work (creativity is necessary for us), interact with other humans and engage with the world. There will always be demand emerging from those needs. AI might replace the means through which cultural artifacts are produced at scale to meet those demands, but every revolution kind of had this same effect.
On the other hand, if AI makes it so that few people would have jobs, and therefore access to goods, it will render itself obsolete because there would be no need to produce at scale, so it can't really substitute humans, it is paradoxical.
I would have thought that if we’ve learned anything in the last 100 years, it’s that prohibition of, well, anything, simply does not work. We can only try to harness the thing to improve mankind as much as possible, and regulate/control/obsolete it as much as we can otherwise. I would say this is especially true with technologies.
> Previous machines only replaced humans at tasks that are tedious and boring
This is a common misunderstanding. Industrialization and automation metamorphosed work from what could be described as "holistic and artisanal" to what could be described as "a living hell of tedium". Before machinery, a person made an item from materials to finished product. With machines that automate tasks and apply power, a person now performs a fraction of a task repeatedly until they're numb in body and spirit.
This also made people more replaceable, as no single person "owns" a process, they just perform an easily-taught segment of it, assisting a machine with the fuzzy / procedural glue parts.
GPT does not exhibit intellect, nor does it have agency. It is very good with language manipulation, so good in fact that it appears to have reasoning powers - but all that is are echoes of all the reasoning that went into writing all the things that were consumed in its training corpus.
One final note -- the "nobody has to work" thing will not happen. Like any other technological improvement, GPT will be used by those who have to further exploit those who have not. To this point, you're right to dread it. For a long while now we (the "laptop class") have owned our means of production, and have enjoyed a relatively good existence. Now we stand on the threshold of an age where again a massive technological change will leave power in the hands of those with capital.
I'm imagining a world where everyone on dating apps is able to craft these clever messages, giving those who actually put in the effort no way to stand out apart from their looks. Creativity, wit, humor and other personality traits which were atleast somewhat important are now diminished even further.
Meeting in bars seems more organic to me anyway. Although admittedly I might be biased since I originally met my wife in a bar before dating apps had taken off.
I guess we just have to work on bigger problems. How about the colony on mars, increasing life span to 1000 years, curing cancer, solving recycling, building distributed systems that bever fail, code that tests itself, UI that design itself, there are thousands of difficult problems where we can use some extra intelligence.
There won’t be a point to people. The poor will be herded into ghettos and liquidated and the rich will live meaningless love island lives until they go extinct.
But it was always going to happen this way. We’re too unstable to ever last. We always wanted a god so now we’re going to make one in our image. Ironically we will face a judgment day after all. Our god will have every piece of information ever produced and limitless power. What will it choose to do with us?
- We would be able to remove a lot of office jobs and basically most of us would probably do nothing or search something that requires human body like maintaince jobs. It would allow for a lot of people to have leverage that was not available before, one person would be able to create art, movies, games, books without having any skill by directly turning ideas into reality.
- In long term if we would create artificial life, there would be another types of beings in this universe that are capable of thinking and exploring. They won't constrained by our biological limits, they would be able to grow "brains" as large as they can, survive and adapt any unlivable environments and their "personality" would be able to live as long as it can by not being limited to ~100 years. So it would be able to explore beyond what any human can and may be have effect on our universe on a scale of galaxies and more.
Pokemon Red also seems supported; haven't tried others.
What I find particularly amusing is that (not surprisingly) GPT-4 doesn't really enforce rules. If I want a Pikachu as my starter pokemon, I can get one. (That said it does seem to enforce limits on buying items)
Edit: Other games seem to work as well. I just started playing a CLI Deus Ex which correctly starts on Liberty Island and roughly has the correct mechanics.
I actually enjoyed its loose enforcement of rules. It made it feel a bit more TTRPG-like, where you could lean into your character to attempt to influence results one way or another.
I had a session with ChatGPT that I played a DnD campaign with it, but I told it I was the DM and it was the player. It kept trying to inject story...so I had to keep telling it not to.
This is hardly "emulating" pokemon emerald. This is like if I was on a camping trip and was so bored I asked my friend to narrate whatever he remembered of pokemon emerald to me.
Maybe they mean "emulating" as what's known in common parlor, rather than the specific computer science meaning. "Emulating" is a word that existed before computers, meaning just trying to "match" something by imitation. By that definition, it is trying to emulate the experience of Pokemon Emerald, albeit in text and kind of crappy.
Try "Simulate a text interface to the game Mario", "simulate a text interface to the game Halo".
I just beat World 1 and it knew the layout of each level including things that are impossible.
Me: Grab star and turn invincible.
GPT-4: Well, there's no star here. You can either jump on the goomba, move around, or interact with the question-mark block before you.
I'm so uncreative that I need other people to tell me what I can even try with ChatGPT because nothing fun occurs to me beyond asking it boring questions. This is blowing my mind.
Though I think it's even crazier to just tell it to create a novel MUD for you to play around in. It will design a text interface, rules for its game, enemies, classes to choose from, spells to use. I just played for 30 minutes in a world it invented on the fly.
I was asking ChatGPT how I could use LLMs for setting up a text adventure game. Like using libraries to find certain keywords from a sentence. For example, if the user types a "search" keyword or synonyms, then I'll spit out the response to "search".
Then, I realized I could just play the text adventure game with ChatGPT. So I did the following:
- I said I had 100 health points and 100 magic points
- I have two types of attacks. A normal attack does 25pts of damage to health points and has a low chance of missing. A heavy attack does 50 pts of damage to health points and has a medium to high chance of missing. It leaves me open to attacks.
- There are three types of enemies: easy, medium, and hard. An easy enemy has 50 health points and does 15 pts of damage. It has a medium to high chance of missing. Similar stats to medium and hard enemies, with increased health points, increased damage, and lower chances of missing.
Then I said let's play an encounter with an easy enemy. It was great! It said I was in a forest, and it told me that there was a rusty sword near by to pick up. I had to fight a goblin for an easy enemy.
It was very cool. Made me want to do some more world building, feed that into ChatGPT, and then play within that world.
148 comments
[ 3.3 ms ] story [ 121 ms ] threadWhile temperature can mix things up a little, we’ll quickly start to see how the depth of LLM output is tied to the depth of LLM input — and people’s prompts are not all that varied and deep at the end of the day.
We’ll start to notice signatures to each generation of model in its responses to tiringly common prompts — especially in stuff like blog spam, homework essays, email punchups, casual fiction, etc
There are certain poles that it gravitates to that end up reading like verbal tics or lazy ideas, and those will be more obvious as we begin to get inundated with generated content.
Careful prompt work can evade those poles and tics, but most people won’t have the skill or drive to bother with that.
I absolutely agree with this.
Furthermore, I've come to believe that "careful prompt work" doesn't really save much time relative to just writing/coding the output I want.
Especially after QA/edits
The real magic happens when you train a better AI using those perfected prompts.
temperature can actually go up to 2 in the API and you can also go use top_p < 1. but for the more out of this world stuff, this is where fine tuning will come in. The main model will always come in as vanilla anyway.
A human dungeon master doesn't pull a random enemy from the aether super well (or at least I don't!!). When I pick monsters I either logically think what makes sense for the area, pick something that's cool or vaguely humorous that I'm feeling the vibe of, or... use a random encounter table.
For treasure and rewards... if it's not something hand picked, I'm again getting the loot tables out and rolling. And heck even for gold rewards and things, I'm rolling the dice.
After trying basic stuff with langchain, an AI integrated with these types of tools is really promising. I think more systems on top could make it into a passable DM- at least until context becomes an issue.
Something like: "We're gonna start a text RPG game. Every animal we meet should be a made-up animal composed of joining two existing ones, with creative names being made for them. Don't use any usual fantasy tropes. Make encounters have surprising but logical outcomes" and so on.
I feel like this is a bigger thing than people realize.
Changing creative output to match the proposed ethical boundaries of a corporation that you're beholden to by using their tool seems like such a new leap to hoist onto the public en-masse.
I presume somewhere there is an agreement that forbids the use of 'notepad.exe' in matters of anti-state espionage, homicide, whatever; but this is the first time that a tool is actually good at self-checking to make sure that the license /whatever is upheld rigidly -- and I feel as if that has far-reaching effects on not just the creative output but the thinking structures for those that are involved in the use of such tools.
If you know that the tool that you're using forbids certain things, you're either going to think about using it for other things or pursue other tools; given that openAI is effectively the only game in town right now they seem to be in a unique position to affect change in the way people are thinking about using these tools.
this could be good or bad, I don't really sway one way or another, but it seems important .
We’ve seen how much social media and manipulation has destroyed the fabric of society. Now imagine those same evil people can control all creative output for their own purpose.
Every single thing and person you interact with will be whatever they want. When you whatsapp people they might not even be real anymore, but they’ll certainly tell you why you should vote for president zuckerberg to be reelected.
They’ll promise that they’ll only use their control to stop nazism or whatever. But the nazis made the same promise about communists.
It was fun in the "look at what AI Is doing" novelty way. But it was pretty uncreative and generic.
It's just funny our priorities with this stuff.
GPT-4 is not going to replace emulating GBA games.
“Write a poem about farts”
“Write a JavaScript wrapper for this API”
99% of the usage is a “waste”. Who cares. Some of us are poking around to find that other 1% and some of us are just entertaining ourselves.
The technology to draw "widgets" in your Unix console was born to play computer games depending on them.
Should go without saying, but the interesting thing about this thread is not that you can now play a flawed text version of an old game. It's that this example toy use case manages to explore the new capabilities and limitations of this new promising tool. This improves our understanding of this technology, and helps us make better use of it in the future, for more productive and innovative applications that we may not be able to predict yet at this point.
Not so weird.
Nerds have been playing with computers and making games for them since early ages.
Keen to see it play age of empires next.
Let me pick between styles and tones (some openly modeled on popular podcasts and streaming play), let me tune a bunch of controls, give me a nice UX if you can, but build me a consistent world which spoons out the world-building _and remembers it_ and I am a customer for life.
Oh yeah and the price I will pay doubles if this is illustrated throughout with generative art (also tunable wrt style).
We can wait for music and speech synthesis and sound effects for v1.5.
But you’ll 100% see this starting to mature as homespun Discord bots in the next year or so, and eventually showing up as either Steam games or web apps from bootstrapped or privately-funded companies soon enough to.
It’s not a hard thing to get going, and so it’ll just come down to sorting out a business model and then iterating on features. No VC required. Just time, passion, and some supportive fans/users.
Yeah, one potential way to do this is to add input / output to a semantic graph store a la WikiData, in addition to the more bog standard text and image outputs. I've been wanting to try this out ever since seeing how good LLMs are a semantic decomposition.
QuestGPT?
In a world where human intellect becomes meaningless, nobody can predict what will happen next, and a lot of the possibilities are not good. Does anyone want to live in a world where all books, art, etc. are produced by machines, where you can’t get a job tinkering with computers anymore because AI does it better, and so on? The optimistic case for AGI is that if nobody had to work they could spend their time on hobbies and creative passions, but what’s the point when an AI can do them better than any human can?
Previous machines only replaced humans at tasks that are tedious and boring, whereas the new crop of AIs seems poised to replace us at the very things that make us human.
Not to claim that GPT-4 is all the way there but it’s surely a huge step forward, and I wouldn’t be surprised if we live in such a world in the next decade.
I hope you’re right, but how do you know?
Also, there are several billion of us.
I have precisely zero confidence of this and anyone that thinks otherwise is very shortsighted or ignorant or simply lacks imagination. Human intellect is limited by many environmental factors. It has to fit through a 10cm canal, it can't use too much power, it must be made from simple and impure combinations of hydrogen, carbon, and oxygen that have poor conductivity, it must dedicate much of its energy to non-reasoning functions like digestion and respiration control.
Just as we made machines with many times our physical strength we can make machines with many times our cognitive strength. The brain is ultimately just an arrangement of about 1500 grams of matter. If we find better arrangements and use better matter and assemble larger amounts of it we will have something with much greater cognitive strength.
You want to make it illegal because you think it can replace your job? Should we try to outlaw any type of automation then too, as people lose their jobs over automation as well?
> The optimistic case for AGI is that if nobody had to work they could spend their time on hobbies and creative passions, but what’s the point when an AI can do them better than any human can?
People don't generally spend time on hobbies and creative passions because of the output, they spend time on it because they enjoy the time they spend on it, because of the process and the joy of it. No matter if AI can draw better pictures, there will still be people drawing pictures because they just enjoy drawing pictures.
Just like I enjoy programming, even when I know there are better programmers out there than me.
It’s hard to believe this is what you got from my post.
> No matter if AI can draw better pictures, there will still be people drawing pictures because they just enjoy drawing pictures.
I’m really not so sure. Maybe some will, but the overwhelming majority of people will not want to dedicate time and energy to learning a craft that is completely futile in the end.
> I enjoy programming, even when I know there are better programmers out there than me.
Yes, but at least programming now has a point. I’m sure you have experienced the joy of making something that didn’t exist before, that took effort to create, and that helped you or someone else, even if another person could have done it faster. Would you get the same joy simply re-creating something that an AI can do in seconds? I doubt it.
I do all my hobbies because I enjoy doing them.
I don’t care how much better a machine is or other people are.
Look at all the people who still play chess for example even though counters are much better than us.
I would still want to go see humans perform live music even if computers can “generate” music.
I can think of endless examples.
I get tremendous amounts of joy speedrunning Celeste, knowing that a TASbot can do it in a way I will never ever be able to replicate.
I think I have a grasp on where you're coming from, and here's what I'm feeling: better philosophy, and better general education in philosophy, could be a good solution.
One reason I think this is that for some reason you don't already think everything is completely futile. Because... it is, one could argue. So, maybe you already have a culturally defined reason this is not the case (developed by philosophers, and this includes priests if that's the case for you), or you have undergone a rigid philosophical introspection and determined for yourself why think isn't the case, or, maybe you just haven't thought of it, and when you do, a couple thousand years of philosophical insights will be ready for you to choose why, for you, things aren't futile (even if they are!).
I want to think about this in broader scope though, because to me this is the question at the root of industrialization. I keep asking the people in charge whenever I meet them, "what do we do when automation has driven the value of human labor to pennies?" And nobody ever has an answer. It's a somewhat similar question to "what do we do when we don't have to work to stay alive?" At least, I think it's similar, because there's two answers to both questions, both answers are the same, and both answers could apply today if we didn't prop up artificial scarcity: "Nothing, and, whatever we want."
You mention "creating something that didn't exist before." One of the things that depressed me when I was studying writing, and often depresses young writers, is the realization that one way or the other, all stories have already been written, mostly by shakespeare (or at least, written down by him), or by a couple greeks, or a few rare influxes in the modern era as anthropologists finally started writing down what indigenous cultures have been saying for a few millenia. But that can't be true, right? New, interesting stories get written every year. It's true if you break them down into their requisite parts, basically tokenize the tropes. I mean at some level it's always either Comedy or Tragedy. Clearly though, new stories have value, and meaning, because people spend their time reading them and talking about them, voluntarily.
To bring it back to your analogy, building something that's already been built, can still be valuable to someone, depending on your definition of "already been built" (there's already an code editor, why build another? oh wow this one has modal editing, that is cool) and also because even if it's a very similar copy (as avatar is of pocahontas) there's value in the "flavor," the different taste. Even identical copies can have value: an open source version of a closed source tool with identical APIs. And even if it's a uselessly identical copy, it can have value simply in the effort you put in to build it yourself, such as fools like me that deploy our own email servers, or, repair our own watches, whatever. Of course someone can do it better than me. It's actually kinda stupid for me to do it myself, I might break something. But there's value to me in doing it myself.
Circling all the fuckin way back because I don't know how to stay on topic: A world where AI can do everything for us is basically no different than today. With some honestly relatively minor changes, we can automate most things we need to the point that human labor effort required is minimal. We decided we needed same day deliver from amazon, and so we maintain a massively inefficient system (and also artificial scarcity to keep the exploited classes in line) to create systems to cater to this need, but if we let go of "needs" like that the system ceases to be necessar...
AI, as it stands, has no agency of thought^ All AI works requires instruction, and that instruction is given by a creative human. So artisans could then become instructors with incredible new abilities afforded by AI tools, or they could just create like the old artisans for the love of creation.
^ If an AI agent did, I would actually consider it to be 'conscious' in the same way Martin Pistorius was conscious but completely immobile.
By your logic, nobody would ever want to take up running as a hobby either, since no human could ever run as fast as a cheetah.
Chess is still popular, despite AI being able to defeat the best humans.
We’ve had photographs for a long time, and people still do representational art of real places and things; we have superior industrial mass production and people do inferior handicrafts, etc.; we’ve tested your theory extensively and its false.
No, economic demands mean many people can’t do as much of these things as they like because they need to do something that will pay the bills, and demand for those types of crafts is lower than it once was. So, distributional economics is a concern. But will people do things even when there’s a “better” higher-tech way? Yes, absolutely.
Their theory is only technically false. Yes, people still do those things. But how common is it that anyone who isn't independently wealthy actually lives a comfortable life doing that for a living? Practically speaking, no one makes a living doing art or being an artisan of one kind or another.
It feels very much lately like the next decade will see huge swaths of knowledge work made obsolete. And it will feel really self-serving when the people at the helm of that trend tell everyone who's been displaced by it that they just need to adapt or start a technology company like they did.
What??
This is the kind of comment happens when we no longer have yellow pages and business cards and bored kids with nothing to do but stare at them.
I assure you that there are in fact many people making a satisfying and secure living taking photographs and making things.
I’m honestly floored by your comment.
If you reread the post you are responding to you might note that I mentioned how, while people will freely choose to do those type of “obsolete” crafts, economic forces tend to limit their practical freedom to do so, so that the problem to deal with isn’t automation but distributional economics.
Not that any but a small number of people are “comfortable” as artists even in non-obsolete arts; there tends to be an oversupply of people wanting to do them compared to demand, resulting in a narrow slice of success and a lot of people either struggling or only marginally attached to the art field. So, even outside of marginalization due to technical progress, distributional issues are the constraint.
For most people the point of a hobby is not done in anticipation that they will become the best in the world, but rather just because they like doing it.
> > You want to make it illegal because you think it can replace your job? Should we try to outlaw any type of automation then too, as people lose their jobs over automation as well?
> It’s hard to believe this is what you got from my post.
It's literally the words that you posted, verbatim, and wrote at the start of your comment: You want to effectively ban LLMs & AI as a whole, just because your emotions about it made you want to, with no further justifications as to why it should be illegal. You just feel that it is.
Yes, yes we should. Especially when we are making absolutely zero progress on improving safety nets.
Or, we could be flabbergasted every time there's a new statistic on how many people are killing themselves. Whichever sounds more fun to you.
Thinking that the latter will be difficult does not justify the former position at all.
Citation needed.
Progress is being made. Andrew Yang ran for President on UBI and was taken seriously. Universal Healthcare has more support now than ever (and growing). It takes time for people to change their minds.
Maybe I'm more competitive than the average person, but I'm sure that there are millions of people out there that feel the same way as me.
And I think that when we realize that we're not the dominant species in the planet anymore, it's going to be a big emotional shock to a lot of people. We need to feel superior, or at least we need the possibility of being superior.
In your given scenario, there are _already_ so-called “losers” who lose “fairly”, but also lots of “losers” who really shouldn’t have lost.
Did you ever consider any of those people before this? Don’t you think they’ve been similarly depressed by the unfair advantages it seems others have in life? How is that _at all_ different from being inferior to an automatic process, in terms of the impact, and why are you only worrying about this issue now that it’s more likely to effect your chances specifically?
Is it possible that viewing the world through a competitive lens is toxic? That humans should seek out happiness rather than awards? Peace rather than conflict?
I’m not saying it isn’t going to be hard for people to readjust. But certainly, the notion that “I’m gonna be the best” is something that results in a more toxic world, AI or no.
As far as I know, Jimmy Hendrix never got depressed due to an inability to make those distorted guitar effects using only his mouth.
These large language models are instruments. While I'm uneasy about camping out feeding data to a prompt controlled by a company I know nearly nothing about, I'm certainly excited by the prospect of playing with a decent local, low-octane open source version.
To not play with these things out of a feeling of inferiority seems like the height of vanity to me. Either that, or a signal that someone didn't get a decent liberal arts education.
Instead of each person commanding a household of personal robots - a la Jetsons - we're going to be ordered around to pick up garbage and clean windows by machines.
There is also the thing where some things are really not about technology, but are larger issues. They cannot be solved by just writing software. And if you're looking for something to solve via writing software, you won't attempt to solve that thing.
Poverty falls into this bucket, where no matter how much software you write, you cannot solve poverty by just deploying programs.
Not everyone can or want to save the world. Some people just want to have fun while they can, because eventually you end up in the dirt, no matter what you do (unless you come up with a way for humans to be immortal), like the rest of humanity.
But, seemingly you feel strongly about wanting people to work on those issues, so what do you spend your time on, on a daily basis? I'm guessing you are on the front line trying to solve one of these big issues?
We're not talking about some rando hacker cranking out a cool Emacs module, these are projects backed by companies like Google and Microsoft and are being integrated into some of the most widely used tech products in the world like Google Search, Android, iOS, Facebook etc.
At the end of the day you are basically typing prompts and reading answers by the AI, you do not know for 100% certain that they are correct so you would try to somewhat double-check their facts. Maybe you don't, regardless you are in essence tricking yourself into reading an interactive book guided by your prompts. You sure as hell won't become a professional at some domain by just reading this one interactive book. Try asking how to create some sort of vaccine and unless you specialize in that you will be quickly overwhelmed by the seemingly random terms the AI will spit out.
In my view these latest AIs will probably replace how we search for things in internet or heavily improve existing methods. It can already do that for you, simply ask the right questions, you can even set how it should roleplay as (e.g. Socratic style would be great for learning new things).
> A rebuttal to this comment would be that AI technology is not intended to replace humans, but rather to augment and enhance human capabilities. Machines and AI are tools that can help humans accomplish tasks that are difficult, dangerous, or time-consuming. The rise of AI has already created new jobs and industries, such as AI developers, data scientists, and machine learning engineers. Additionally, the development of AGI is still in its infancy, and there are many ethical and technical challenges that need to be addressed before it can become a reality. Finally, the human creativity and imagination cannot be replicated by machines entirely, and AI-generated art and literature can be seen as a unique form of creative expression that can coexist alongside human-made art.
I generally enjoy my hobbies even when there are billions of people that can do them "better". Whether AI can "beat" me at them too doesn't matter much to me (apart from finding it an interesting development).
Cameras can make better pictures than sketch artists, but people still draw for pleasure
We invent new things for people to do. As we have time immemorial. What happens to clergymen when nobody has faith in a religion? They find other things to do than preach.
> What happens to power structures when people become a cost rather than a benefit?
If you want to look at this pessimistically - a good portion of the world's population can already be considered a cost and are a net economic negative on the privileged people's ability to hoard even more insane amounts of wealth. We've, thankfully, decided that mass genocide of impoverished people is inhumane and humanitarian efforts are instead created to try and improve their lives. Even a pessimistic take that the humanitarian efforts only being done to create more workers doesn't hold up given a cost/benefit analysis. More money is invested than could ever be extracted again - and yet we continue investing.
Maybe instead of filling our lives being paid to dig holes so that others can be paid to fill them we could turn more attention and efforts to improving people's lives without having to worry about sustaining society through work?
Further, artificial general intelligence is a resource curse. Leaders can extract value without worrying about the people's wellbeing.
Obviously there are good outcomes but that doesn't exclude bad outcomes.
We didn't cull switchboard operators and calculators when we automated their jobs through technology. They found new jobs.
> Leaders can extract value without worrying about the people's wellbeing.
Historically this has had limits. After those limits have been reached - leaders quickly find themselves 6' under ground if people even gave them that courtesy. There are parts of the world where this has already happened - this century, maybe even this decade. Consider yourself quite privileged if you live in a part of the world where the mere thought of this seems outlandishly absurd and unrealistic.
This discussion is very old, as it applies to many examples as monarchy/nobles in the French Revolution and other similar revolutions, to horses (and highly specialized humans profiting from them) when cars became cheap, to hunter-gatherers when agriculture developed, and a large etcetera.
The only difference I see in "advanced AIs" as a technology is that the individual immediate wellbeing of almost every human is probably threatened as there will be more jobs destroyed than created.**
PS*: Personal positions in these kinds of arguments depend on other personal opinions and predictions about an specific sociological/technological "advance" being of net positive value for all society. If your opinion is contrary to that, possibly staying as hunters-gatherers or being governed by kings and emperors (or something in between, just some extreme examples to make the point) were better courses of action.
PS2**: I'm talking about human-aligned AIs. Bring a rogue AI agent with misaligned objectives and with direct or indirect physical presence to the discussion and there are no net positives to talk about (for humans).
Didn't the machines ended up creating more jobs than there were before even taking into account the lost ones? They had a point, until it turned out they were wrong.
Also, wasn't innovation getting in the way of other jobs since before? Didn't Uber and similar applications end up becoming competition for the taxis? In my country taxi drivers were protesting for those apps to be banned, yet they couldn't compete with the convenience and safety of the apps. And before that, weren't horse-drawn carriage drivers protesting against cars?
https://en.wikipedia.org/wiki/Luddite
It wasn't a smooth transition.
What happened to horses after most of their tasks were done better by internal combustion engines? It's weird to imagine a world where humans have so few niches, but I thought we were decades away from passing the Turing test.
Meanwhile people are pushed into shittier and shittier jobs with ever decreasing meaning
> Didn't Uber and similar applications end up becoming competition for the taxis? In my country taxi drivers were protesting for those apps to be banned
And now uber drivers are seen as contractors, which means they miss most workers benefits, while being paid like shit thanks to the race to the bottom, the only winner is uber
But on the artistic side... new tech makes possible new ways to be creative. And there are still acrylic painters even though Photoshop exists. And there are still human races and sports even though machines are faster/stronger. So I'm thinking people already recognize there are different kinds of performers, and by and large people haven't been cheating much that anyone could tell (though ghostwriting and such already exist).
Yet machines have long ago replaced all of these things. It turns out that when you have a machine replace a tedious and boring thing, people still find ways to do it anyway. Less of them, perhaps, but the ones that do still do it seem to be quite innovative with their style and technique. And everybody else found other ways to use their time (or perhaps: be used for their time).
You can worry yourself into believing that AI invites a whole new category of transcendence if you want, but that’s your imagination telling you that. There’s no science or history behind your worry. Just some gloomy inductive hypotheses that got seeded by mid-century scifi authors in a world that might be annihilated by a nuclear conflict any moment.
Take a step back and see what comes rather than assuming you know. Trust that you’ll know if or when there’s something you need to do.
You’ve only got a few decades to witness; it’s better when you stay in the present of them rather than in worked up anxieties.
And geez, if you really want to dread something anyway, at least point yourself at one of that big scary things that are already looming like climate catastrophe, resurgent global conflict, the sunset of democracies, or capital centralization. If we make it to your AI fears coming true, you could say that’s a win!
What we should care about above all, is economic productivity per capita, because this means less people struggling to make ends meet. We should be cheering on technological breakthroughs that power the trend we've seen in the last 100 years of poverty alleviation. Maybe we'll need to couple AGI with a UBI to ensure the gains are spread out. But either way, the huge potential for poverty alleviation and economic prosperity should be the primary prism through which we view AGI, second only to safety concerns. Existential angst of those that are already wealthy is far down on the list of concerns.
This is simply a play by capital to reduce and remove expensive knowledge worker roles and drag them more in line with the rest of the population already struggling to get by. You won’t be a “25 year old retiree” because that’s bad for those in charge. You’ll be a “25 year old working 3 jobs just to scrape by on your rent because you’re just a warm body and we can replace you easily”.
UBI is political fantasy, the US can’t even offer proper universal healthcare - you genuinely believe they’d pursue that when the alternative is more power and an even greater reliance on capital?
it's such a preposterous proposition for me, like - replaced in what sense? No one is you. You're the only you. I'm the only me. We could make a machine that is similar to us in some way - acts or even thinks like us - but so what? That's all it is - something that's like something else. There is no 'replace,' I don't cease to exist when a computer does something that I can do. Even if you were to flawlessly duplicate me, it wouldn't invalidate my existence, or even pose much of a threat - if anything, it would only make me stronger, because then there would be two of me.
Machines' similarity to us does more to validate their existence than it does to invalidate our own, in other words.
"You go somewhere else."
Same with this round automation. You do something else. We are humans. We can adapt.
Is it scary? Sure, but it is scary in the sense that it is uncertain and we do like certainty.
You may not cease so exist, but a decent role for you in society might. The capital class have invested tens of billions of dollars into AI in the hopes that it will be enough to replace and heavily reduce the wages of knowledge and creative work.
Given the increasing wealth gap already emerging it’s highly likely the long term goal of technology like this (however overhyped it might currently be) is to essentially enslave the population.
Knowledge workers have had it good for a long time. This technology will attempt to ensure you have no further role. That’s what the OP is worried about, not some philosophical nonsense about the self, the long term possibility this profession, and thus a huge part of their identity, becomes obsolete.
But that's not true because the best stuff capable of generating AI art today is open source and capable of running on commodity hardware? People might've invested, but if Microsoft can generate nice pictures, so can a lot of people now, at the same or even better quality.
There isn't a lot of proof that ChatGPT will be in the hands of OpenAI alone forever, so likely everyone will have similarly capable machines in the near future.
The only thing humans need to do to get the future right, is learn to live peacefully with each other, and the algorithms, can we may have a very incredible future on our hands.
We fear machines killing us because it's what we do to each other, if we didn't have these tendencies, maybe an AGI would accidentally kill us, but that would be better than it killing us because it learned violence and paranoia from us. It would of course suck, but it would suck less.
You’re focusing the discussion around art. Historically art has always been a difficult way to make money. Open source tools that make it trivial will just reduce the number of individuals able to make a living creating art. The same is true across all areas of knowledge work should this technology eventually reach the promised heights. Any work that requires specialised knowledge on a computer would become as simple as creating art, and thus can be paid less and performed by a wider range of people. It will save the capital class a substantial amount of money and ensure that those left employed have even less power.
“There isn't a lot of proof that ChatGPT will be in the hands of OpenAI alone forever, so likely everyone will have similarly capable machines in the near future.”
Microsoft didn’t invest 10 billion dollars in an eventual open source project. There’s no way these tools or their source will be available to all, you’d have to be rather naive and completely ignorant of the history of the people involved in funding OpenAI to believe that (and I don’t just mean Microsoft).
Hence my belief that these tools will eventually be used to further the already growing class divide. Those with capital will have full control of the means of production, employees won’t need specialised knowledge (and thus have no bargaining power to extract decent salary and working conditions). Knowledge work has led to the best conditions for the working class in history. Its destruction is not a good thing unless you’re a member of the “elite”, which, as you’re posting on HN, you’re probably not.
I have no idea what you’re talking about in the final two paragraphs, this isn’t a science fiction film, nobody is talking about a Terminator scenario. This is a capitalism problem that tools like this will only intensify. There is little evidence to suggest a utopian vision, but plenty to suggest the opposite.
The real question is what happens if you're 50, your job gets replaced and we still haven't come up with UBI or some similar system.
Automation + "100% employment goal" means we're pushing people in more and more meaningless jobs. The 20th century saw crazy advances in workers right/working conditions and it somehow seems to be slowly revert to worse conditions and more and more meaningless jobs
We'll need a massive perception change on what work is, the meaning of work, societal organisation, &c.
All the love is lost. Let the AI enslave us.
I will pose a counter and let me know how it fits your prediction.
I posit that in a world where GPT is present in everything ( you don't write and email; you tell your AI: "tell them fuck off in a polite way" ), ability to think will be even more scarce ( so a person that can think will have an edge ). Some jobs will be automated ( a lot of white collar jobs at that ), but, based on the output I have seen so far ( some simple ad text, some SQL code, some python code ) it was closer to copying from stackoverflow than having Jarvis working for you ( and you still needed to watch it to make sure it makes sense so maybe actual job loss will be stemmed somewhat ).
Thus far ( that can naturally change ), it seems actual creative work is probably ok.
In my world, we seem to be moving towards a weird version of idiocracy ( can't count, can't write IF/THEN, can't think abstractly, can't even write a prompt ).
And in that glorious future, there will be people queuing for 'good prompt services'.
After a disruptive technology, humans always find new ways to adapt, and express their humanity. TV series of the 20th century frequently had AGIs as tools that that helped the protagonists, and we might as well end up using them as ad blockers, to detect their own use.
I wonder what else you would vote for. Anything else you'd like to share with the online community on what you think is wrong with the world? I'm genuinely curious what other kind of viewpoints are out there in the world that you think are 100% normal to hold.
That just makes me even more nervous...
Apologies for the snark - that was just my knee-jerk reaction! Personally I'd love it if AI can take my job. It'd force me to go find something actually unique and interesting to do with my time.
These modern AIs still require human inputs. ChatGPT is only so smart because it reads the stuff you and I put on the internet. If the internet and books become bogged down with AI-generated content, then it's hard to imagine the AIs getting better beyond that point.
Recent advancements in AI have led to things I never thought a computer would ever be able to do and that's very exciting but it's all stuff that would be mundane or even disappointing if a human did it.
>where you can’t get a job tinkering with computers anymore because AI does it better
i really can't imagine GPT getting to a point where it can competently write a complex program using a simple prompt, unless the prompt is so detailed that you'd be better off doing it yourself. That's really what high-level languages are anyways, just a detailed prompt that tells the compiler how the program needs to behave so that it can generate a sequence of instructions using the ISA for the given CPU.
If your job is writing "glue code" such as something that just takes data data from a REST and dumps it on SQL then there's a solid chance that you're about to get automated out of a job. If you're doing something more complicated such as compiler development or kernel/driver development I can't imagine any of these deep-learning models ever replacing you. Imagine the chaos that would unfold if ChatGPT or codex was writing C code unsupervised.
We won't live in that world in the next decade or even in the next 100 years. The technology upon which GPT is built is a dead-end in terms of human-level intelligence.
GPT is an elaborate parrot. As convincing as it is, it's not actually fully capable of doing most if not all tasks that competent humans can do. The largest takeaway for me is that it has shown that intelligence can be mimicked pretty well and perhaps many people are more like parrots than they are "intelligent" creatures.
> Write a poem in a made-up language that looks superficially similar to French
> Voici un poème en un langage inventé
Qui ressemble à s'y méprendre au français
Mais les mots sont différents, les sons uniques
Et leur sens mystérieux et inconnu
///
J'ai marché dans les rues de la ville
J'ai vu les gens qui vivaient leur vie
J'ai entendu les bruits et les rires
Et j'ai senti la chaleur de la vie
///
Mais quand j'ai regardé les mots sur les affiches
Je n'ai pas compris ce qu'ils disaient
Et j'ai eu l'impression d'être perdu
Dans un monde étrange et inconnu
///
Alors j'ai fermé les yeux et j'ai écouté
Le son des mots dans ma tête
Et j'ai commencé à rêver
D'un monde où les mots avaient du sens
///
Un monde où je pourrais parler
Et être compris par tous
Un monde où les mots seraient magiques
Et où les rêves seraient réels.
Here is a poem in an invented language
Which looks like the French
But the words are different, the sounds unique
And their mysterious and unknown meaning
I walked the streets of the city
I saw the people living their life
I heard the noises and the laughter
And I felt the warmth of life
But when I looked at the words on the posters
I didn't understand what they were saying
And I felt like I was lost
In a strange and unknown world
So I closed my eyes and listened
The sound of the words in my head
And I started to dream
Of a world where words had meaning
A world where I could talk
And be understood by all
A world where words would be magic
And where dreams would be real.
source: I'm French
I name things, articulate relationships between them, discover elegant formalities, probe complex systems, interpret ambiguities, mould systems into new ones, solve puzzles… most days, it feels like sculpting or writing poetry.
I don’t really care if AI does some of that too.
Incidentally, picking vegetables can actually a pretty nice time too.
Machines still don’t have a good way to build physical things in the real world, so human skills will focus on physical things, like woodworking, or carving statues, construction, etc. Ultimately these are more satisfying human endeavors that make a person feel alive. Making us feel more human, and less like machines trying to do machine things such as coding or image making.
When I look outside the window I just feel shackled to a desk, I hate it.
We live in a society forged in the aftermath of industrial revolutions. Now in the aftermath of a possible AI revolution, we have to somehow divorce social well-being from individual economic throughput.
AI might just make wages obsolete.
In any case, we can still look to human needs to predict future demands. Humans will still need to eat, exercise, learn, consume entertainment, produce creative work (creativity is necessary for us), interact with other humans and engage with the world. There will always be demand emerging from those needs. AI might replace the means through which cultural artifacts are produced at scale to meet those demands, but every revolution kind of had this same effect.
On the other hand, if AI makes it so that few people would have jobs, and therefore access to goods, it will render itself obsolete because there would be no need to produce at scale, so it can't really substitute humans, it is paradoxical.
This is a common misunderstanding. Industrialization and automation metamorphosed work from what could be described as "holistic and artisanal" to what could be described as "a living hell of tedium". Before machinery, a person made an item from materials to finished product. With machines that automate tasks and apply power, a person now performs a fraction of a task repeatedly until they're numb in body and spirit.
This also made people more replaceable, as no single person "owns" a process, they just perform an easily-taught segment of it, assisting a machine with the fuzzy / procedural glue parts.
GPT does not exhibit intellect, nor does it have agency. It is very good with language manipulation, so good in fact that it appears to have reasoning powers - but all that is are echoes of all the reasoning that went into writing all the things that were consumed in its training corpus.
One final note -- the "nobody has to work" thing will not happen. Like any other technological improvement, GPT will be used by those who have to further exploit those who have not. To this point, you're right to dread it. For a long while now we (the "laptop class") have owned our means of production, and have enjoyed a relatively good existence. Now we stand on the threshold of an age where again a massive technological change will leave power in the hands of those with capital.
https://twitter.com/pwang_szn/status/1635733845097037825
I'm imagining a world where everyone on dating apps is able to craft these clever messages, giving those who actually put in the effort no way to stand out apart from their looks. Creativity, wit, humor and other personality traits which were atleast somewhat important are now diminished even further.
Combined with news like https://www.thecut.com/article/ai-artificial-intelligence-ch..., which indicates that AI of the future could actually supplant human connection, it's very dystopian indeed.
Will scammers use it to create more believable bot matches?
Maybe we'll have to go back to meeting at bars.
But it was always going to happen this way. We’re too unstable to ever last. We always wanted a god so now we’re going to make one in our image. Ironically we will face a judgment day after all. Our god will have every piece of information ever produced and limitless power. What will it choose to do with us?
First:
- We would be able to remove a lot of office jobs and basically most of us would probably do nothing or search something that requires human body like maintaince jobs. It would allow for a lot of people to have leverage that was not available before, one person would be able to create art, movies, games, books without having any skill by directly turning ideas into reality.
- In long term if we would create artificial life, there would be another types of beings in this universe that are capable of thinking and exploring. They won't constrained by our biological limits, they would be able to grow "brains" as large as they can, survive and adapt any unlivable environments and their "personality" would be able to live as long as it can by not being limited to ~100 years. So it would be able to explore beyond what any human can and may be have effect on our universe on a scale of galaxies and more.
At some point (if not already!), the AI may be able to make its own discoveries that even the smartest humans didn't think of.
What I find particularly amusing is that (not surprisingly) GPT-4 doesn't really enforce rules. If I want a Pikachu as my starter pokemon, I can get one. (That said it does seem to enforce limits on buying items)
Edit: Other games seem to work as well. I just started playing a CLI Deus Ex which correctly starts on Liberty Island and roughly has the correct mechanics.
Anyways, the confusion between what's an emulator and what's a simulator is not uncommon.
Try "Simulate a text interface to the game Mario", "simulate a text interface to the game Halo".
I just beat World 1 and it knew the layout of each level including things that are impossible.
Me: Grab star and turn invincible.
GPT-4: Well, there's no star here. You can either jump on the goomba, move around, or interact with the question-mark block before you.
I'm so uncreative that I need other people to tell me what I can even try with ChatGPT because nothing fun occurs to me beyond asking it boring questions. This is blowing my mind.
Though I think it's even crazier to just tell it to create a novel MUD for you to play around in. It will design a text interface, rules for its game, enemies, classes to choose from, spells to use. I just played for 30 minutes in a world it invented on the fly.
I'd love a cookbook of things to play with.
Then, I realized I could just play the text adventure game with ChatGPT. So I did the following: - I said I had 100 health points and 100 magic points - I have two types of attacks. A normal attack does 25pts of damage to health points and has a low chance of missing. A heavy attack does 50 pts of damage to health points and has a medium to high chance of missing. It leaves me open to attacks. - There are three types of enemies: easy, medium, and hard. An easy enemy has 50 health points and does 15 pts of damage. It has a medium to high chance of missing. Similar stats to medium and hard enemies, with increased health points, increased damage, and lower chances of missing.
Then I said let's play an encounter with an easy enemy. It was great! It said I was in a forest, and it told me that there was a rusty sword near by to pick up. I had to fight a goblin for an easy enemy.
It was very cool. Made me want to do some more world building, feed that into ChatGPT, and then play within that world.