Holy cow, the robots are definitely coming. We really are at the ground floor of a technology that is going to change humanity, I am certain of that. Changes greater than any changes we've seen before.
The history of innovation compounds. One cannot improve on what hasn't been invented yet, but afterward, it can happen at any time afterward, even if the unimproved original has since been rendered obsolete.
If you think of it in terms of "200 years ago" versus "200 years from now" you might think there would be equal magnitudes of progress. But now is 200 years since 1818, and 2218 is 400 years from 1818 AND 200 years from now. The future has more to build on, and taller shoulders to stand on.
The center of history, at the exact moment where as much has changed since the idea "maybe we could just plant some seeds between the Tigris and Euphrates, and maybe not wander around so much," and from then until the present, may be shorter than 50 years ago, and getting closer every year. Thousands of years on one side of the balance, and tens of years on the other. With that in mind, today may be as different from 1818 as 2038 is from today. 2218 would be just inconceivable.
Well, if you're thinking sentient, AI beings, then no-- they are still a long way off. Unless we can give any meaning behind why a robot should do something, for example, have and use this kind of dexterity, it's all mechanical tricks. Cool tricks, nonetheless.
They don’t have to be fully sentient just more sentient than the bottom 10% of people, a goal function like energy storage with a counterfacuals algo will probably yield surprisingly familiar emergent behaviors
I agree with the person you replied to but I'm not thinking about intelligent machines. I'm just thinking about the automation of everything. Look how close we are to self driving cars without needing a sentient robot behind the wheel. Mechanical tricks are going to eliminate the jobs of a lot of people.
> Look how close we are to self driving cars without needing a sentient robot behind the wheel. Mechanical tricks are going to eliminate the jobs of a lot of people.
Let’s say we’re close to self-driving cars, i.e. it’ll happen in 10 years or so. How much will it cost? How much the maintainance will cost? How many years will be needed until everybody owns a self-driving car? Unless more than a handful people have that kind of car you won’t kill a lot of jobs.
"We observed that for precision grasps, such as the Tip Pinch grasp, Dactyl uses the thumb and little finger. Humans tend to use the thumb and either the index or middle finger instead. However, the robot hand’s little finger is more flexible due to an extra degree of freedom, which may explain why Dactyl prefers it. This means that Dactyl can rediscover grasps found in humans, but adapt them to better fit the limitations and abilities of its own body."
The learning of "emergent" behavior, specifically when it creates improvements to natural human motion is one of the main reasons why this type of work is so important. Similar to the way that we imitate design from nature (e.g. wings, suction cups), we can now accelerate development by observing how the bots perform the task in a variety of environments
It's a really cool phenomena, it also means we have to make our simulations better. These sorts of RL algorithms are so good at finding "exploits" in the physics engine they are in that help them "cheat" sometimes, compared to what the researcher wanted.
I agree, but FWIW in the linked work they did randomize some of the engine parameters during training to avoid fitting too much to a specific set of assumptions. Certainly though more accurate simulations, as long as they were still fast to compute, would be very useful!
yeah, I think a big reason why they needed to do randomization in the first place is because of inaccuracies in the simulation compared to the real world. And the extra randomization required almost two orders of magnitude more training time!
otoh, maybe finding "exploits" is all we ever do. I don't grip with my thumb and little finger because it hurts the back of my hand, but that isn't a problem for Dactyl.
This means that Dactyl can rediscover grasps found in humans, but adapt them to better fit the limitations and abilities of its own body.
Then why not evolve commensurate dexterity with mechanically simpler manipulators than a human hand? I'd bet that a robot with 4 arms with 4 different specialist manipulators and a few specialist tools (like a generalized screw-threading tool) could eventually be more efficient than a human with 2 human arms. You can even see this happening in real life, powered by human brains. The kind of dexterity people can get out of a crude instrument like a backhoe is very impressive.
The simpler device will always have an economic advantage.
The simpler device might or might not have an economic advantage. There are a lot of variables.
A backhoe is actually very complex - the simple device is a stick. A thousand humans with a stick can do as much work in a week as a single human with a backhoe can do in a day. It only takes a few weeks to pay off the more complex backhoe. Of course your humans can use their bare hands for a further reduction in productivity.
A backhoe is less complex than a horizontal drill, and the drill is less versatile overall. However the drill can go under a structure without harming it which can be a big economic win. If you are just doing a shallow pipe through an open field they are fairly competitive in price though.
The simple device has an economic advantage when the task is not repeated often enough to pay off the costs of the more complex machine (this includes maintenance costs which can be more than the initial investment)
But it's quite a bit less complex than a scaled up anatomic analogue human arm. It's just complex enough to be a general-purpose excavation and construction tool. My point is that the evolved complexity of a human hand is too complex for the general purpose manipulation task. Evolution isn't perfect. It just did a very good job given it had a bunch of fish bones to work with.
Please note I said "simpler" device, not "simplest possible" device. US artillery in WWII had commensurate functionality to German artillery, but did it with nearly half of the number of moving parts. US tanks were individually less capable than their German counterparts, but were more efficient to manufacture and easier to repair. That is what is meant by the economic advantage of the "simpler." Not using a trebuchet instead of a cannon.
> My point is that the evolved complexity of a human hand is too complex for the general purpose manipulation task.
Maybe if you're constraining 'general purpose manipulation' to mean 'rearranging blocks'. That complexity (and especially the extra brain power to run it) costs energy. If it wasn't useful, we wouldn't have it.
Maybe if you're constraining 'general purpose manipulation' to mean 'rearranging blocks'.
I'm thinking more along the lines of "can build a PC" or "repair a machine." I don't think we'll need to lap flint spearheads in 2018 and beyond. I don't think we need to have repair bots play the fiddle so much on the surface of Mars. I do think that the manipulation tasks useful to a 21st century civilization are "within the grasp" of simpler manipulators than the human hand. The human hand is freakishly complex. If we can get 80% of the functionality for 25% the cost, that will be a win. (For the most difficult 20%, there are still humans.)
That complexity (and especially the extra brain power to run it) costs energy. If it wasn't useful, we wouldn't have it.
Of course it's useful! No one disputes that! It doesn't matter. You're fallacious in supposing that 1) all of the complexity and capability is absolutely essential in current and future contexts and 2) that evolution had bought it with maximal possible efficiency. What we understand about evolution tells us that the 1st isn't necessarily true, and that the 2nd is probably not!
Yes, there will be a place for human hands. But some huge fraction of the current uses of human hands will probably be replaced by very capable but much simpler manipulators -- simply due to economics!
Interestingly on a related note I just watched a documentary called "The Workers Cup" about laborers building the venues for the Qatar world cup and there were many shots of the laborers manually shoveling rocks and gravel in places where you would typically see a machine doing it here in North America. Apparently, for them, it's cheaper to use cheap labor to hand dig rocks and dirt than to use a machine to do it.
Yes, if you can treat workers like machines (i.e. no “human rights”) they are actually more efficient per calorie/dollar than a rotary engine for many tasks.
This is why slavery didn’t just die upon invention of the engine.
> The simpler device will always have an economic advantage.
The recent history of technology suggests otherwise. General-purpose devices displace simpler single-purpose devices. Consider all the specialized, but relatively simple, circuits displaced by the desktop computer.
Yes, but simpler general-purpose devices displace more complex general-purpose devices, so long as they're also suitable to the tasks. A robot with a couple of graspers, a picker, a suction manipulator, plus some graspable special-purpose tools could be as versatile as a humanoid robot with anatomically inspired human-like hands, but be several times simpler and several times more reliable.
haha I just read it and thought that's a magnitude less than I expected. Pretty often it is. A lot of papers from high profile institutions have a lot of computing power availiable.
First, it seems to be a lot and be really expensive, but think of it in man-hours. It quickly diminishes.
Not always but a lot of machine learning techniques now are effectively just brute forcing and highly expensive band wasteful to compute. Machine learning is getting close but I don't believe we will get there with our current methods
Well if you look at the plot in the "Learning progress" section, you'll see that they did require almost two orders of magnitude more training time due to the randomizations they were adding to the simulation. Without these the policy isn't very robust but also takes a lot less time to train.
Is it the cores that throws you off? (Those are used for the simulation, not the training). Second, I believe those were preemptible cores, so that's $60/hr for the cores and then $20/hr for V100s (which is what I think they used). $80/hr isn't bad considering how much a (small!) team of researchers costs.
This is a perfect example of how AI is taking over the world by storm. I don't know how people don't realize that there will be no jobs left for billions of people.
Yes, billions. Not Millions.
I don't quite get the "New Jobs will be created" fallacy.
Let me explain:
What is job? An Abstract way of looking at it: A job is something that requires a set skills to accomplish a task.
What most politicians don't get: Researchers like OpenAi teach machines SKILLS not jobs.
A little thought experiment:
Let's say humans are capable of 100 skills.
Skills can be anything from: driving, seeing, hearing, reading, walking, carrying, drawing etc.
Usually, a low paying job requires little to no traning.
For example: Someone in a warehouse that picks the stuff you have ordered. The skill that are required are: walking, picking and using a device.
A High paying jobs usually requires more skills and/or experience.
We train machines to see better, hear better, sort faster etc.
Any new job will require some sort of skills out the set of skills that can be trained.
But the moment you create this job, it will be automated, because a machine can do it better and faster.
We need to adress this now, otherwise i don't see a bright future for the generations to come.
The big "Oh shit" moment will be when AI and robots can perform any task a human can perform better and/or cheaper than a human can, which would make it fiscally unwise to pay a human for any kind of labor. Even if humans could still be better at creative pursuits (such as writing, music, and art, until AI possibly betters us at that too), that is not feasible for 99% of people to survive on.
Eh, I have some pretty terrible data collection and matching work that cannot be done by a computer due to needing to understand similar words, what is in a combo, what is important in a combo, or the strange situation where things are free after you pay for an upfront cost.
Ive made attempt to automate this, but I find that constantly the rework needed is too extreme and incomplete.
These things are the future of employment. This problem is non-trivial as my hires dont understand and struggle for a long time. It takes teaching them for them to 'get it'. Still we have to make decisions.
Labor will be automated, this is good.
The future will be using minds, even uneducated minds will be put to use.
The solution is pretty easy though: Widespread enough ownership of robots. Making sure there are good open source versions of the robots should allow everyone to benefit from robot labor. There will still be scarcity when it comes to land, energy and raw materials. We will have to tackle inequality of ownership of to these things, at least as long as we are earth bound.
> Once robots are doing all the labor, and you have open source plans and code, the cost is only that of raw materials and energy.
You still have to pay the people who write those open-source plans and code, plus the ones who build these robots (or the one who build the robots that build the robots), and the ones who sell it. Also, maintainance and updates costs.
With the current state of AI, the situation you’re describing won’t exist before a century, if it ever exists. You can’t call such thing an "easy" solution.
> I don't quite get the "New Jobs will be created" fallacy.
Nobody 20 years ago would have imagined the job of mobile app developer. The mobile phone replaced many devices and probably many jobs in manufacturing, but also created new domains that we couldn't have imagined and empowered people in the developing world (and elsewhere).
> We need to address this now, otherwise i don't see a bright future for the generations to come.
You look at things the wrong way. Humans have always had a job which can't be taken away by corporations - the job of caring for oneself and one's needs. If we don't have corporate jobs, then we can become self reliant at individual, community and country level and find ways to support ourselves. We can build houses, teach children, provide medical care and many other things with jobless people for jobless people. We can even use automation for our own benefit, like we do with open source software.
Jobless people can't build the factory to manufacture the components to build the homes, though. Building a factory requires capital which (currently) cannot be acquired in process you're outlining.
We can also build homes with simpler construction materials and lots of hard work. We can make our own bricks and panels of wood.
Think of it this way: what would people who have lots of free time (no job) and lots of unfulfilled needs do? They would work to be self reliant if that would mean having a better life. There would be plenty of manpower. All we need is land and raw materials.
What you fail to address is that the success of software is that it does so much more with so much fewer people. A mobile app developer might be a new job but it actually replaces (indirectly) the jobs of dozens to hundreds of people. That's why it's a success in the first place.
My job as a developer is, in a real sense, to eliminate as much work from people as possible. If I wasn't doing that, there'd be no point to my job. We don't just make software for the hell of it.
No, what you're failing to understand is that the cell phone has created new opportunities even for the poorest people of the world. It opens up commerce, payments, short time borrowing, education, hiring, finding a spouse and many other things that lead to a successful life. On the whole it was a boon for humanity - in other words, it was worse for all of us, rich or poor, before it existed.
The world may very well be a better place and frankly saving people from work is actually a good thing. But I disagree with the idea that the computer/mobile/AI revolution is adding more jobs than it takes away. There are not more app developers than their were factory laborers.
Most people would be surprised that US manufacturing is at the highest level in history. And they are surprised because manufacturing employment is at the lowest levels.
Is it good that Americans are not doing highly physically demanding manufacturing jobs? Sure. But what are the long term consequences of productivity without people? Every industry is more productive with drastically fewer people and they're improving on that equation every day. Not just factories but also white collar office work too. When self-driving vehicles become the norm, a massive amount of people will no longer have jobs.
This "new technology will create new jobs" is the biggest lie that economics ever told. The crises in the midwest in this country and the subsequent election of Donald Trump is a direct result of the displacement of American workers by technology and offshoring.
Yep, every boss that there is would replace their employees with a single computer if they could, it's basic economics not a single doubt about it, 99.99% would do it in a heartbeat. The thing is that wasn't a problem for hundreds of years cause computers/robots couldn't do most of what humans do, but as computers get everyday closer and even better at what humans can do, this artificial balance we call capitalism of what humans can do and what other humans are willing to pay for it starts to crash as the former are no longer needed; and we realize that capitalism is an anarchy of sorts, just that it was mostly stable for a few centuries so it kind of works but soon it will not.
Either the AI way will be more capable than a human mind or the human mind will be more capable. Jobs will always exist for the more capable mind... because it is more capable.
If the AI becomea superior to the human mind then you’ll have much more to worry about than jobs.
Plus at the base level there will always be the job of taking care of yourself and keeping yourself alive. If a robot can take that hob then great, that means you don’t have to work anymore.
Comparative advantage is exactly why so many people will loose their jobs.
If a small number of people, with the aid of machines, can do the equivalent work of thousands of workers, how will the free market support the higher cost of human labour in comparison to the robots?
Its not that people will have nothing to do. But for a huge number of people, there will be no way to get paid as much as it costs them to live.
Comparative advantage is an economic theory that says there is still gain from trade between asymmetric producers.
It is possible to have an absolute advantage in production of all goods, but still gain from trading with your inferior partner.
This is based on another of the foundational concepts in economics, that of opportunity cost.
Economics is debate-ably a science, but it is certainly a mature field of study. Much like other mature fields of study and technical fields, it contains jargon. Economics suffers exceptionally from the challenge of its jargon sounding like vernacular language.
You are not using comparative advantage correctly. The wikipedia article is relatively short and clear.[0]
That being said, your argument seems to be "efficiencies in production will drive the prices of goods down" and "humans will earn less money." There is a pretty big jump to "humans will not earn enough to pay the prices of the (now cheaper) goods they require to live."
Let's engage on that argument. Is it a fair (though obviously simplified) statement of your position? What leads you to believe that wages will fall to a greater extent than prices?
Late response here. Yeah I clearly missed the reference to the economics term, but that makes sense.
To respond on the main debate, my argument is not that "efficiencies in production will drive the prices of goods down" but instead that "efficiencies in production will drive the production costs of goods down".
Just because it becomes cheaper to make a product, doesn't mean that the consumer price will drop the same amount. Especially if that cheaper production can only be utilized by a few companies with automation skills.
The economic benefits of automation may trickle down to consumers, but will largely be taken by the few large companies capable of such automation.
"This is a perfect example of how AI is taking over the world by storm."
Because they taught a robot hand to rotate a cube well... ?
Take it from an AI researcher, it's one thing to make a demo of a technique solving a narrow very simple problem and quite another to use that technique to solve a real world need.
"Any new job will require some sort of skills out the set of skills that can be trained" - even if we do reach the level of AI there this would actually hold, we are NOWHERE near that today, and this result certainly does not demonstrate we are.
Dextrous manipulation is a big deal though. Typical stuff we've seen like generating synthetic faces using GANs is not commercially useful, but eye-hand coordination is 90% of commercial activity worldwide.
That is true (and I am well aware of this, as I do research on robotic grasping https://sites.google.com/view/task-oriented-grasp ). But, this would very hard to generalize to more complex manipulation where the object is not already in-hand etc. ; it's yet another piece of the puzzle, but it by itself does not get us that much closer to general purpose training of robust complex manipulation.
Well, i can see that you are a expert in this field, but i still have to say the method they demonstrate, domain randomization is a big deal because that can then be applied to anything else like picking up stuff. Domain randomization is a year old thing now, but it's a big deal - if you can build a "crappy" simulator for it, you will be able to do anything. I feel like domain randomization isnt being promoted enough in the media
sure, but they demonstrate it for a very simple use case of a single object with no background etc. ; domain randomization has yet to be demonstrated to work on more complex environments/tasks
One of the last things not automated at Amazon fulfillment centers is identifying and picking up the item from the shelf brought by the robots which contain it.
sure, and there has already been a ton of work on grasping (see eg DexNet 2.0, Closing the loop for robotic grasping). This stuff is already in the process of being commercialized, and this research does not advance it much.
Would you ever go see a robot performer[0]? Like, a robotic comedian, or a robot ballet dancer, or a robotic football player? Would you ever go see a robotic therapist if you're suicidal? Would you let a robot feed, and raise your infant? Would you get guided through a third world country on a mountaineering expedition by a robot? Can a robot write/perform an entire feature film? Would you watch a late-night talk show of one robot chatting with another robot?
Would you let robots run a country? Or a state? Or a town?
> A little thought experiment: Let's say humans are capable of 100 skills. Skills can be anything from: driving, seeing, hearing, reading, walking, carrying, drawing etc.
Can a robot be more human than human?
Am I going to fall in love with a robot? Will the robot show perfect empathy? Will they become enlightened?
> Let me explain: What is job? An Abstract way of looking at it: A job is something that requires a set skills to accomplish a task.
Given that definition AI is no threat. Of course your post implies the financial impact of AI upon people, in this context I think it's important to correctly frame a Job as "A way for individuals to use their skills to extract worth from an economy, for the purpose of trading that worth for other goods in the _same_ economy".
The emphasis is key, Jobs are not independent of the value of products sold... e.g taking the "AI will destroy all jobs" narrative to be true and then following it to it's extreme: A world where no one (or very few) have a job, in this world no one has any worth to trade for the value being produced by AI, it's a complete catch 22. The realistic way this could be possible is by living in a star trek universe devoid of "money". But this is not binary, in between there is not some post apocalyptic world where humans go live in the desert and AI meanwhile gradually destroys everyone's source of income, there is an in between:
AI is not as special as everyone thinks, the way it's being used is very applied, it's just an extension of automation... Just like all automation before it - the worth being created by AI is cheaper to create, and therefore _can_ be cheaper to buy, given enough gradual economic impact it also _must_ be cheaper to buy as peoples buying power decreases and the product has no value if it cannot be sold. The net result over time is reduced cost of living.
Note that i've refrained from attacking the easiest thing here which is that: AI is not as clever as the media hype train likes to make everyone think. The chasm between conscious human mind and current engineered NN that is as functionally intelligent as 0.1 fruit flies is astronomically large and n-dimensional we are not talking about something as simplistic as koomeys law here... but the media likes to apply "infinite exponential growth" to every aspect of technology, reality is far more subtle.
> We train machines to see better, hear better, sort faster etc. Any new job will require some sort of skills out the set of skills that can be trained. But the moment you create this job, it will be automated, because a machine can do it better and faster.
Except that you haven’t cited any skill that is currently (or in the near future) better performed by a machine than by a human –maybe sorting but that’s a rather limited skill in itself–.
I am firmly in the camp that we have a glut of capability in terms of what an average individual can accomplish using the low cost, power efficiency, and enormous functionality of modern devices like microcontrollers, motors, and sensors.
But we also have an extreme paucity of people coming up with those ideas for what to do with our staggering collective potential; the skill to produce creative solutions to problems which may not have been identified yet is one that I believe we will have some difficulty teaching to machines in the short or medium term.
What you see as an intractable problem, I see as a deficit in training, education, and investment in workers. These days, people are fully capable of learning about any topic which sparks their interests; there are tutorials and how-to's from basic to advanced levels in both text and multimedia formats on everything from genetic engineering to programming to circuit design to working with materials like wood/leather/metal/plastic...the list goes on.
People either don't seem to realize that they can retrain themselves, or they don't have the resources and especially time to do so. We can help with both, but there doesn't seem to be much appetite to cough up any money for educating adults.
What AI cannot learn and will never have is an experience of being human. It never can, as you can never have an experience of being a robot. Yes, perhaps one day you can teach it too, but it will be learned, not lived.
Where this experience reflects the most? Art and how it communicates and resonates with you, because you can connect, relate. Even if robots would learn to play jazz like Davis, Coltrane and Parker combined, I wonder if there ever will be that human feeling and reflection of player's experience and life.
Empathy may be another field. Taking care of elders or other people in need. Connecting to the experience of other, relating to it. Knowing, that your life is finite.
Maybe a way how to solve this problem is for us to become more human. Finally, one may want to add.
We arguably even had the knowledge to build the neural nets to run them. Had more people been exposed to functional, declarative and data-driven programming back then, I think it would have seemed straightforward to wire up large networks as spreadsheets. Sadly, most of those older approaches have been replaced with opaque and buzzwordy approaches that bury concepts in terminology.
Arguably there was no market back then for AI. But I think what really happened is that AI arrived simultaneously with neoliberalism and supply-side economics which treat workers as commodities. Rather than letting everyone replace themselves with robots and keep their paychecks, they were instead forced to work longer and longer hours for less pay and compete with companies overseas that have few labor or environmental protections.
The problem isn't the technology, it's the political climate that can't see beyond jobs and so-called handouts. Which means that alternative societies are going to have to tackle problems all at once rather than piecemeal. There's going to be tremendous pressure to undercut human-oriented economies that focus on self-actualization over the mundane tasks of running the daily rat race (just like we've seen with organic, high efficiency, solar, wind and recycling being disincentivized).
> We arguably even had the knowledge to build the neural nets to run them. Had more people been exposed to functional, declarative and data-driven programming back then, I think it would have seemed straightforward to wire up large networks as spreadsheets.
The problem back then was computing power, not people not being exposed to these paradigms.
Well if they even agreed on millions, that would still be an improvement over the current thinking, i.e., if one type of job is eliminated, a new type of job would magically appear and we'll keep living in the same rainbows and unicorns economy that we are in.
Progress in robotics for the last several decades has been steady, but plodding and incremental. This is just one small step. I think it's amazing, don't get me wrong, but there is still a Mount Everest of progress to be made before we get to anything like a general purpose robot that can, say, do the housework.
Not only that, but consider how many jobs we could create if only we banned the use of combine harvesters, tractors, various machines in factories all over the world etc.
I guess someone has to be the negative one: I can't help feeling it's route to the correct face looks entirely accidental (and I don't mean that in a good way)... I'm sure it's "learned" some methods, but they don't look that efficient, reliable, purposeful or controlled. In a more noisy and dynamic environment I'd expect them to fail. Granted is possible these could be more due to training conditions than an inherent limitation of the underlying model.
It looks that way because they're moving rapidly from one face configuration to another. But there's no way that's happening by random. I would guess that even just holding the cube constant in a dynamic grip is quite difficult.
I agree it looks sloppy, but that doesn’t mean it isn’t reliable. All it has to do in any given moment is make progress towards the goal of having the cube in the proper orientation, on average. It may be that it can do that very reliably even with noisy inputs and outputs.
> Learning to rotate an object in simulation without randomizations requires about 3 years of simulated experience
It's interesting to me that this is about the same amount of time it takes humans to develop similar levels of motor control. I don't know enough about AI or neuroscience to say whether it's likely to be a coincidence or not, though.
Interesting observation. I suspect it's probably coincidence though. Other tasks which humans are able to learn (such as [playing Dota][1]) have taken OpenAI much longer to master. OpenAI Five spends 180 years of training per day, per hero in order to learn Dota, and it still isn't at the level of professional players (though that may change soon).
Though I suppose you could argue that Dota benefits more from high-level reasoning, whereas basic motor control is a more intuitive skill. (And therefore better suited for this type of AI.)
Also, the time referenced in the article is presumably three years of non-stop training – given that an infant has a calendar packed with other things like sleeping, crying, and other non-motor activities, total human time logged on learning fine motor control is probably half that, if not less.
I don't doubt that it is coincidence. But it's interesting that vertebrates' brains seems to be using specialized structure (cerebellum) for motor coordination. And here we have far simpler artificial system without any evolutionary priors.
Humans learn with entirely different stimuli and experience (can you imagine subjecting a person to learning this object manipulation task in the same way as this robot?).
In addition, Alpha Go Zero demonstrated an order of magnitude better efficiency in training time than Alpha Go due to only algorithmic differences. Humans are about converged to 3 year training time for babies learning these skills, but I doubt that these learning algorithms are as efficient as they will ever be.
They already have a good estimate of the finger tip pose from the angular measurements of all the internal degrees of freedom (presumably from angular encoders?). And I'm not sure any IMU small enough to fit into the fingertip will be accurate enough to provide really useful additional pose information.
This is a great example of why AI innovation is not moving at the pace we are told to believe. This is using the same basic algorithms we've known about for decades, just more compute and differently formulated problems. We need a paradigm shift!
Let's be honest - the only thing we care about is "are the programming jobs safe?!" Well, are they?
P.S. I am trying to help a newer dev atm, and I realize I always have only one question for them while basically doing their work "What. the. hell. are. the. business. requirements?"
Suddenly, this makes me feel much more like a business analyst than a code monkey, though being a decent code monkey is definitely a pre-req.
> Let's be honest - the only thing we care about is "are the programming jobs safe?!" Well, are they?
As a sofware developer myself, I’d love to ever see a world where my work is not needed anymore. Wouldn’t that be awesome to have worked so hard toward automation that you can automate your own job?
I find it strangely correlated with the way the camera is set up. If it uses the middle finger then the camera might not see correctly the cube's face. You can see it using it at the last resort.
But I don't see why this would matter in the simulation phase.
That's very impressive. Robotic grasping is getting pretty good[1] but in-hand manipulation is a whole 'nother kettle of fish and this is really exciting.
TLDR (quick-ish skim, feel free to correct) they train a deep neural network to control a robot hand to choose desired joints state changes (binned into 11 discrete values; eg rotate this joint by 10 degrees) for a 20-joint hand given low-level (non-visual; so, current and desired 3D orientation of the object and exact numeric state of the joints) input of the state of a particular object and the hand. They also train a network to extract the 3D pose of a given object given RGB input. All this training is done in simulation with a ton of computation, and they use a technique called domain randomization (changing colors and textures and so friction coefficient and so on) to make these learned models pretty much work in the real world despite being trained only in simulation.
It's pretty cool work, but if I may pull my reviewer hat on not that interesting in terms of new ideas - still, it's cool OpenAI is continuing to demonstrate what can be achieved today with established RL techniques and nice distributed compute.
It's pretty amusing/amazing how well domain randomization works, but it seems like they train the pose detector in the real world and not in simulation:
"To transfer to the real world, we predict the object pose from 3 real camera feeds with the CNN, measure the robot fingertip locations using a 3D motion capture system, and give both of these to the control policy to produce an action for the robot."
I am continually impressed by OpenAI, whenever we think that something is too difficult for our currently understanding of AI. With their Dota AI and this they have shown that more can be done with a lot less than previously thought.
Not to be too negative, it's cool work, but I'd argue unlike the OpenAI result it is not so surprising this was doable with the techniques they used ; see eg this paper from Google http://www.roboticsproceedings.org/rss14/p10.pdf and this one from Stanford/DeepMind http://www.roboticsproceedings.org/rss14/p09.pdf . Yes there is the additional aspects of an object in hand, but fundamentally the techniques are the same.
Of course these works are cited in related works of paper as they should be; perhaps the OpenAI blog should also provide more context on where this stands wrt prior work, as many non-researchers may read this is may be quite misleading...
Does anyone know a good graduate program/route for this kind of work? My undergrad was CS with some experience in (dumb) robotics and mechanical design but no ML. I am interested in applying ML/CV to physical systems like this however am I bit weary of going back to a CS program. I have seen some Mechanical programs with an emphasis on control that let you 'build your own degree'. If I could take a mix of ML/CV, control systems, kinematics I would be happy. Just looking for some input from people in this field.
Worth noting: it's a well-supported route to join OpenAI without any special graduate training. Many of our teams (including our robotics team!) hire experienced software engineers, teaching them whatever ML they need to know, or our Fellows program lets people do a more formal curriculum (https://blog.openai.com/openai-fellows/). We also have a number of software engineers who focus on what looks like traditional software engineering: see for example https://www.youtube.com/watch?v=UdIPveR__jw.
I am a 2nd year Phd at Stanford and you could definitely do such work here! Also at CMU, Georgia Tech, Berkeley, U Washington, and others. You can enter PhD via EE/MechE or CS - once you are focused on research it does not matter much. The FAIR/Google Residency programs may also be of interest.
Take a look at position 44, where it seems to get stuck, with no move to make forward progress, and two fingers straight out. Did it lack image recognition to tell it what block rotation was needed?
It doesn't seem to work by discovering strategies for rotating the block one face at a time, then combining those. It's solving the problem as a whole. That has both good and bad implications.
>> We’ve trained a human-like robot hand to manipulate physical objects with unprecedented dexterity.
To be precise, the "physical objects" appear to invariably be cubes of the same dimensions. Not arbitrary "physical objects". Which is probably the best that can be done by training only in a simulated environment.
But why?? Why should robots' hands resemble human hands? They could have any number of fingers, or tentacles, or magnets, why should they be like human hands??
It seems "AI" really means "as close as possible to human behavior", even if we're not really that clever in said behavior.
Also, human intelligence being at least debatable, it's not obvious that the obsessive imitation of humans is the best way to attain "AI".
Because most objects are made for human hands. So it is better to have a robot with human-like hands (or body) than to change the shape of all the things we have already created. So future robots can use our human-made stuff.
We have built this world for human hands so that has become the best shape overall. It does depend on the situation but I'm guessing for many, an improved human shape is best.
Yep, backwards compatibility, not just hands but bodies overall, if we ever make a robot that can drive existing cars it will pretty much resemble a human body, and our cities were created for human bodies/interactions (walking up stairs, etc)
Human hands are incredible manipulators. Really, compared to what’s in robotics today they’re fabulous. There’s some other promising developments in non human hand style manipulators, but human hands are still really good.
It’s really good practice for your AI system to try it on a human hand. If you can make it work with a human hand you can probably make it work for other manipulators, but it’s a great place to start!
141 comments
[ 3.1 ms ] story [ 163 ms ] threadIf you think of it in terms of "200 years ago" versus "200 years from now" you might think there would be equal magnitudes of progress. But now is 200 years since 1818, and 2218 is 400 years from 1818 AND 200 years from now. The future has more to build on, and taller shoulders to stand on.
The center of history, at the exact moment where as much has changed since the idea "maybe we could just plant some seeds between the Tigris and Euphrates, and maybe not wander around so much," and from then until the present, may be shorter than 50 years ago, and getting closer every year. Thousands of years on one side of the balance, and tens of years on the other. With that in mind, today may be as different from 1818 as 2038 is from today. 2218 would be just inconceivable.
Let’s say we’re close to self-driving cars, i.e. it’ll happen in 10 years or so. How much will it cost? How much the maintainance will cost? How many years will be needed until everybody owns a self-driving car? Unless more than a handful people have that kind of car you won’t kill a lot of jobs.
David Copperfield should be OK a while longer though
"We observed that for precision grasps, such as the Tip Pinch grasp, Dactyl uses the thumb and little finger. Humans tend to use the thumb and either the index or middle finger instead. However, the robot hand’s little finger is more flexible due to an extra degree of freedom, which may explain why Dactyl prefers it. This means that Dactyl can rediscover grasps found in humans, but adapt them to better fit the limitations and abilities of its own body."
The learning of "emergent" behavior, specifically when it creates improvements to natural human motion is one of the main reasons why this type of work is so important. Similar to the way that we imitate design from nature (e.g. wings, suction cups), we can now accelerate development by observing how the bots perform the task in a variety of environments
Then why not evolve commensurate dexterity with mechanically simpler manipulators than a human hand? I'd bet that a robot with 4 arms with 4 different specialist manipulators and a few specialist tools (like a generalized screw-threading tool) could eventually be more efficient than a human with 2 human arms. You can even see this happening in real life, powered by human brains. The kind of dexterity people can get out of a crude instrument like a backhoe is very impressive.
The simpler device will always have an economic advantage.
A backhoe is actually very complex - the simple device is a stick. A thousand humans with a stick can do as much work in a week as a single human with a backhoe can do in a day. It only takes a few weeks to pay off the more complex backhoe. Of course your humans can use their bare hands for a further reduction in productivity.
A backhoe is less complex than a horizontal drill, and the drill is less versatile overall. However the drill can go under a structure without harming it which can be a big economic win. If you are just doing a shallow pipe through an open field they are fairly competitive in price though.
The simple device has an economic advantage when the task is not repeated often enough to pay off the costs of the more complex machine (this includes maintenance costs which can be more than the initial investment)
But it's quite a bit less complex than a scaled up anatomic analogue human arm. It's just complex enough to be a general-purpose excavation and construction tool. My point is that the evolved complexity of a human hand is too complex for the general purpose manipulation task. Evolution isn't perfect. It just did a very good job given it had a bunch of fish bones to work with.
Please note I said "simpler" device, not "simplest possible" device. US artillery in WWII had commensurate functionality to German artillery, but did it with nearly half of the number of moving parts. US tanks were individually less capable than their German counterparts, but were more efficient to manufacture and easier to repair. That is what is meant by the economic advantage of the "simpler." Not using a trebuchet instead of a cannon.
Maybe if you're constraining 'general purpose manipulation' to mean 'rearranging blocks'. That complexity (and especially the extra brain power to run it) costs energy. If it wasn't useful, we wouldn't have it.
I'm thinking more along the lines of "can build a PC" or "repair a machine." I don't think we'll need to lap flint spearheads in 2018 and beyond. I don't think we need to have repair bots play the fiddle so much on the surface of Mars. I do think that the manipulation tasks useful to a 21st century civilization are "within the grasp" of simpler manipulators than the human hand. The human hand is freakishly complex. If we can get 80% of the functionality for 25% the cost, that will be a win. (For the most difficult 20%, there are still humans.)
That complexity (and especially the extra brain power to run it) costs energy. If it wasn't useful, we wouldn't have it.
Of course it's useful! No one disputes that! It doesn't matter. You're fallacious in supposing that 1) all of the complexity and capability is absolutely essential in current and future contexts and 2) that evolution had bought it with maximal possible efficiency. What we understand about evolution tells us that the 1st isn't necessarily true, and that the 2nd is probably not!
Yes, there will be a place for human hands. But some huge fraction of the current uses of human hands will probably be replaced by very capable but much simpler manipulators -- simply due to economics!
This is why slavery didn’t just die upon invention of the engine.
Qatar 2022 https://www.amnesty.org/en/latest/campaigns/2016/03/qatar-wo...
Russia 2018 https://www.hrw.org/news/2018/06/06/russia-world-cup-labor-a...
Brazil 2014 https://www.aljazeera.com/humanrights/2014/07/world-cup-work...
(a bit of a threadjack so I'll stop here)
The recent history of technology suggests otherwise. General-purpose devices displace simpler single-purpose devices. Consider all the specialized, but relatively simple, circuits displaced by the desktop computer.
Yes, but simpler general-purpose devices displace more complex general-purpose devices, so long as they're also suitable to the tasks. A robot with a couple of graspers, a picker, a suction manipulator, plus some graspable special-purpose tools could be as versatile as a humanoid robot with anatomically inspired human-like hands, but be several times simpler and several times more reliable.
That seemed an order of magnitude higher than I expected. Is training usually this computationally expensive?
First, it seems to be a lot and be really expensive, but think of it in man-hours. It quickly diminishes.
Is it the cores that throws you off? (Those are used for the simulation, not the training). Second, I believe those were preemptible cores, so that's $60/hr for the cores and then $20/hr for V100s (which is what I think they used). $80/hr isn't bad considering how much a (small!) team of researchers costs.
I don't quite get the "New Jobs will be created" fallacy.
Let me explain: What is job? An Abstract way of looking at it: A job is something that requires a set skills to accomplish a task. What most politicians don't get: Researchers like OpenAi teach machines SKILLS not jobs.
A little thought experiment: Let's say humans are capable of 100 skills. Skills can be anything from: driving, seeing, hearing, reading, walking, carrying, drawing etc.
Usually, a low paying job requires little to no traning. For example: Someone in a warehouse that picks the stuff you have ordered. The skill that are required are: walking, picking and using a device. A High paying jobs usually requires more skills and/or experience.
We train machines to see better, hear better, sort faster etc. Any new job will require some sort of skills out the set of skills that can be trained. But the moment you create this job, it will be automated, because a machine can do it better and faster.
We need to adress this now, otherwise i don't see a bright future for the generations to come.
Ive made attempt to automate this, but I find that constantly the rework needed is too extreme and incomplete.
These things are the future of employment. This problem is non-trivial as my hires dont understand and struggle for a long time. It takes teaching them for them to 'get it'. Still we have to make decisions.
Labor will be automated, this is good.
The future will be using minds, even uneducated minds will be put to use.
"Get everybody rich" is a solution to a lot of problems, but it’s not easy.
> Making sure there are good open source versions of the robots should allow everyone to benefit from robot labor.
Open-sourcing is a great thing, but does it really reduce the cost of building a robot?
You still have to pay the people who write those open-source plans and code, plus the ones who build these robots (or the one who build the robots that build the robots), and the ones who sell it. Also, maintainance and updates costs.
Nobody 20 years ago would have imagined the job of mobile app developer. The mobile phone replaced many devices and probably many jobs in manufacturing, but also created new domains that we couldn't have imagined and empowered people in the developing world (and elsewhere).
> We need to address this now, otherwise i don't see a bright future for the generations to come.
You look at things the wrong way. Humans have always had a job which can't be taken away by corporations - the job of caring for oneself and one's needs. If we don't have corporate jobs, then we can become self reliant at individual, community and country level and find ways to support ourselves. We can build houses, teach children, provide medical care and many other things with jobless people for jobless people. We can even use automation for our own benefit, like we do with open source software.
Think of it this way: what would people who have lots of free time (no job) and lots of unfulfilled needs do? They would work to be self reliant if that would mean having a better life. There would be plenty of manpower. All we need is land and raw materials.
My job as a developer is, in a real sense, to eliminate as much work from people as possible. If I wasn't doing that, there'd be no point to my job. We don't just make software for the hell of it.
Most people would be surprised that US manufacturing is at the highest level in history. And they are surprised because manufacturing employment is at the lowest levels.
Is it good that Americans are not doing highly physically demanding manufacturing jobs? Sure. But what are the long term consequences of productivity without people? Every industry is more productive with drastically fewer people and they're improving on that equation every day. Not just factories but also white collar office work too. When self-driving vehicles become the norm, a massive amount of people will no longer have jobs.
If the AI becomea superior to the human mind then you’ll have much more to worry about than jobs.
Plus at the base level there will always be the job of taking care of yourself and keeping yourself alive. If a robot can take that hob then great, that means you don’t have to work anymore.
AI does not remove scarcity.
Comparative advantage is a real thing. It is well studied and well understood.
The common argument seems to conflate AI, automation, robotics, and similar things with the removal of scarcity.
In the presence of scarcity, comparative advantage tells us that we're unlikely to see the vast majority of the world's population with nothing to do.
If a small number of people, with the aid of machines, can do the equivalent work of thousands of workers, how will the free market support the higher cost of human labour in comparison to the robots?
Its not that people will have nothing to do. But for a huge number of people, there will be no way to get paid as much as it costs them to live.
It is possible to have an absolute advantage in production of all goods, but still gain from trading with your inferior partner.
This is based on another of the foundational concepts in economics, that of opportunity cost.
Economics is debate-ably a science, but it is certainly a mature field of study. Much like other mature fields of study and technical fields, it contains jargon. Economics suffers exceptionally from the challenge of its jargon sounding like vernacular language.
You are not using comparative advantage correctly. The wikipedia article is relatively short and clear.[0]
That being said, your argument seems to be "efficiencies in production will drive the prices of goods down" and "humans will earn less money." There is a pretty big jump to "humans will not earn enough to pay the prices of the (now cheaper) goods they require to live."
Let's engage on that argument. Is it a fair (though obviously simplified) statement of your position? What leads you to believe that wages will fall to a greater extent than prices?
[0] https://en.wikipedia.org/wiki/Comparative_advantage
To respond on the main debate, my argument is not that "efficiencies in production will drive the prices of goods down" but instead that "efficiencies in production will drive the production costs of goods down".
Just because it becomes cheaper to make a product, doesn't mean that the consumer price will drop the same amount. Especially if that cheaper production can only be utilized by a few companies with automation skills.
The economic benefits of automation may trickle down to consumers, but will largely be taken by the few large companies capable of such automation.
Because they taught a robot hand to rotate a cube well... ?
Take it from an AI researcher, it's one thing to make a demo of a technique solving a narrow very simple problem and quite another to use that technique to solve a real world need.
"Any new job will require some sort of skills out the set of skills that can be trained" - even if we do reach the level of AI there this would actually hold, we are NOWHERE near that today, and this result certainly does not demonstrate we are.
Would you let robots run a country? Or a state? Or a town?
> A little thought experiment: Let's say humans are capable of 100 skills. Skills can be anything from: driving, seeing, hearing, reading, walking, carrying, drawing etc.
Can a robot be more human than human?
Am I going to fall in love with a robot? Will the robot show perfect empathy? Will they become enlightened?
[0] Captured! By Robots! Doesn't count. https://www.youtube.com/watch?v=_zvU165DEYc
Given that definition AI is no threat. Of course your post implies the financial impact of AI upon people, in this context I think it's important to correctly frame a Job as "A way for individuals to use their skills to extract worth from an economy, for the purpose of trading that worth for other goods in the _same_ economy".
The emphasis is key, Jobs are not independent of the value of products sold... e.g taking the "AI will destroy all jobs" narrative to be true and then following it to it's extreme: A world where no one (or very few) have a job, in this world no one has any worth to trade for the value being produced by AI, it's a complete catch 22. The realistic way this could be possible is by living in a star trek universe devoid of "money". But this is not binary, in between there is not some post apocalyptic world where humans go live in the desert and AI meanwhile gradually destroys everyone's source of income, there is an in between:
AI is not as special as everyone thinks, the way it's being used is very applied, it's just an extension of automation... Just like all automation before it - the worth being created by AI is cheaper to create, and therefore _can_ be cheaper to buy, given enough gradual economic impact it also _must_ be cheaper to buy as peoples buying power decreases and the product has no value if it cannot be sold. The net result over time is reduced cost of living.
Note that i've refrained from attacking the easiest thing here which is that: AI is not as clever as the media hype train likes to make everyone think. The chasm between conscious human mind and current engineered NN that is as functionally intelligent as 0.1 fruit flies is astronomically large and n-dimensional we are not talking about something as simplistic as koomeys law here... but the media likes to apply "infinite exponential growth" to every aspect of technology, reality is far more subtle.
Except that you haven’t cited any skill that is currently (or in the near future) better performed by a machine than by a human –maybe sorting but that’s a rather limited skill in itself–.
But we also have an extreme paucity of people coming up with those ideas for what to do with our staggering collective potential; the skill to produce creative solutions to problems which may not have been identified yet is one that I believe we will have some difficulty teaching to machines in the short or medium term.
What you see as an intractable problem, I see as a deficit in training, education, and investment in workers. These days, people are fully capable of learning about any topic which sparks their interests; there are tutorials and how-to's from basic to advanced levels in both text and multimedia formats on everything from genetic engineering to programming to circuit design to working with materials like wood/leather/metal/plastic...the list goes on.
People either don't seem to realize that they can retrain themselves, or they don't have the resources and especially time to do so. We can help with both, but there doesn't seem to be much appetite to cough up any money for educating adults.
Is AI and robots really cheaper then manual labor for a lot of things?
How close really are we to have AI replace even simple tasks like flipping burgers? What about mopping the floor? Taking the trash?
Why do we work? What do we work for?
Where this experience reflects the most? Art and how it communicates and resonates with you, because you can connect, relate. Even if robots would learn to play jazz like Davis, Coltrane and Parker combined, I wonder if there ever will be that human feeling and reflection of player's experience and life.
Empathy may be another field. Taking care of elders or other people in need. Connecting to the experience of other, relating to it. Knowing, that your life is finite.
Maybe a way how to solve this problem is for us to become more human. Finally, one may want to add.
https://en.wikipedia.org/wiki/Short_Circuit_(1986_film)
We arguably even had the knowledge to build the neural nets to run them. Had more people been exposed to functional, declarative and data-driven programming back then, I think it would have seemed straightforward to wire up large networks as spreadsheets. Sadly, most of those older approaches have been replaced with opaque and buzzwordy approaches that bury concepts in terminology.
Arguably there was no market back then for AI. But I think what really happened is that AI arrived simultaneously with neoliberalism and supply-side economics which treat workers as commodities. Rather than letting everyone replace themselves with robots and keep their paychecks, they were instead forced to work longer and longer hours for less pay and compete with companies overseas that have few labor or environmental protections.
The problem isn't the technology, it's the political climate that can't see beyond jobs and so-called handouts. Which means that alternative societies are going to have to tackle problems all at once rather than piecemeal. There's going to be tremendous pressure to undercut human-oriented economies that focus on self-actualization over the mundane tasks of running the daily rat race (just like we've seen with organic, high efficiency, solar, wind and recycling being disincentivized).
The problem back then was computing power, not people not being exposed to these paradigms.
Well if they even agreed on millions, that would still be an improvement over the current thinking, i.e., if one type of job is eliminated, a new type of job would magically appear and we'll keep living in the same rainbows and unicorns economy that we are in.
It's interesting to me that this is about the same amount of time it takes humans to develop similar levels of motor control. I don't know enough about AI or neuroscience to say whether it's likely to be a coincidence or not, though.
Though I suppose you could argue that Dota benefits more from high-level reasoning, whereas basic motor control is a more intuitive skill. (And therefore better suited for this type of AI.)
[1]: https://blog.openai.com/openai-five/
Humans learn with entirely different stimuli and experience (can you imagine subjecting a person to learning this object manipulation task in the same way as this robot?).
In addition, Alpha Go Zero demonstrated an order of magnitude better efficiency in training time than Alpha Go due to only algorithmic differences. Humans are about converged to 3 year training time for babies learning these skills, but I doubt that these learning algorithms are as efficient as they will ever be.
P.S. I am trying to help a newer dev atm, and I realize I always have only one question for them while basically doing their work "What. the. hell. are. the. business. requirements?"
Suddenly, this makes me feel much more like a business analyst than a code monkey, though being a decent code monkey is definitely a pre-req.
As a sofware developer myself, I’d love to ever see a world where my work is not needed anymore. Wouldn’t that be awesome to have worked so hard toward automation that you can automate your own job?
[1] He said, tooting his employer's horn.
TLDR (quick-ish skim, feel free to correct) they train a deep neural network to control a robot hand to choose desired joints state changes (binned into 11 discrete values; eg rotate this joint by 10 degrees) for a 20-joint hand given low-level (non-visual; so, current and desired 3D orientation of the object and exact numeric state of the joints) input of the state of a particular object and the hand. They also train a network to extract the 3D pose of a given object given RGB input. All this training is done in simulation with a ton of computation, and they use a technique called domain randomization (changing colors and textures and so friction coefficient and so on) to make these learned models pretty much work in the real world despite being trained only in simulation.
It's pretty cool work, but if I may pull my reviewer hat on not that interesting in terms of new ideas - still, it's cool OpenAI is continuing to demonstrate what can be achieved today with established RL techniques and nice distributed compute.
"To transfer to the real world, we predict the object pose from 3 real camera feeds with the CNN, measure the robot fingertip locations using a 3D motion capture system, and give both of these to the control policy to produce an action for the robot."
Of course these works are cited in related works of paper as they should be; perhaps the OpenAI blog should also provide more context on where this stands wrt prior work, as many non-researchers may read this is may be quite misleading...
Worth noting: it's a well-supported route to join OpenAI without any special graduate training. Many of our teams (including our robotics team!) hire experienced software engineers, teaching them whatever ML they need to know, or our Fellows program lets people do a more formal curriculum (https://blog.openai.com/openai-fellows/). We also have a number of software engineers who focus on what looks like traditional software engineering: see for example https://www.youtube.com/watch?v=UdIPveR__jw.
See our open positions here: http://openai.com/jobs!
https://news.ycombinator.com/newsguidelines.html
Take a look at position 44, where it seems to get stuck, with no move to make forward progress, and two fingers straight out. Did it lack image recognition to tell it what block rotation was needed?
It doesn't seem to work by discovering strategies for rotating the block one face at a time, then combining those. It's solving the problem as a whole. That has both good and bad implications.
To be precise, the "physical objects" appear to invariably be cubes of the same dimensions. Not arbitrary "physical objects". Which is probably the best that can be done by training only in a simulated environment.
But why?? Why should robots' hands resemble human hands? They could have any number of fingers, or tentacles, or magnets, why should they be like human hands??
It seems "AI" really means "as close as possible to human behavior", even if we're not really that clever in said behavior.
Also, human intelligence being at least debatable, it's not obvious that the obsessive imitation of humans is the best way to attain "AI".
It’s really good practice for your AI system to try it on a human hand. If you can make it work with a human hand you can probably make it work for other manipulators, but it’s a great place to start!