It's common for young people to not care what Microsoft does, when they haven't experienced a different world. Apple doesn't look much different from MS of today, so it seems perfectly reasonable to see software slowly weaponized against developers. Microsoft has viciously abused their marketshare in the past and it's likely they will do so again. How does that affect you? Doesn't seem to right now (unless you're unlucky, right?). Check back in 20 years.
It's basically thinking "this doesn't affect me now, so it will never affect me" combined with "as long it isn't my problem, I refuse to care about it"
Systems like Copilot and Dall-E and so on turn their training data into anonymous common property. Your work becomes my work. This may appeal to naive people (students, hippies, etc.), for whom socialist/communist ideas are attractive, but it's poison in the real world.
These systems are a mechanism that can regurgitate (digest, remix, emit) without attribution all of the world's open code and all of the world's art.
With these systems, you're giving everyone the ability to plagiarize everything, effortlessly and unknowingly. No skill, no effort, no time required. No awareness of the sources of the derivative work.
My work is now your work. Everyone and his 10-year old brother can "write" my code (and derivatives), without ever knowing I wrote it, without ever knowing I existed. Everyone can use my hard work, regurgitated anonymously, stripped of all credit, stripped of all attribution, stripped of all identity and ancestry and citation.
It's a new kind of use not known (or imagined?) when the copyright laws were written.
Training must be opt in, not opt out.
Every artist, every creative individual, must EXPLICITLY OPT IN to having their hard work regurgitated anonymously by Copilot or Dall-E or whatever.
If you want to donate your code or your painting or your music so it can easily be "written" or "painted", in whole or in part, by everyone else, without attribution, then go ahead and opt in.
But if an author or artist does not EXPLICITLY OPT IN, you can't use their creative work to train these systems.
All these code/art washing systems, that absorb and mix and regurgitate the hard work of creative people must be strictly opt in.
If you don't care about this, it's naivete, or a lack of foresight, or apathy as these companies pillage the commons. Not something to be proud of.
Microsoft and OpenAI (and others) are robbing us and you should care.
Here is the MIT License. Note the very important requirement for attribution ("you must give me credit for my hard work") italicized below:
Copyright <YEAR> <COPYRIGHT HOLDER>
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
The reason I'm thinking maybe it's not so bad, is because which snapshot does it use? How does it know which snapshot of an algorithm is correct and which has a bug? What if you have code that's perfectly fine but then you add several new branches, each one with a different critical security vulnerability added in that's intentional, and malevolent? Will the AI be able to detect these vulnerabilities and choose the correct version? It seems so easy to sabotage this thing. Why would anyone be stupid enough to use it? This thing seems like the perfect stupidity detector.
Personally I think the modern hero-worshipping auteurship culture is far more harmful than anything else. You don't matter, your name doesn't matter. Culture is commons almost by definition; all works are derivative and stand on the shoulders of anonymous giants.
"All works are derivative" does not imply that just any kind of derivation is or should be OK. I can't write a Harry Potter novel and profit off of it (without being sued), for example, so clearly there are legal and ethical frameworks in place to prevent some kinds of "standing on the shoulders of giants".
Frankly, it almost seems like you're saying that since all works are derivative I shouldn't care how my own works get used -- it should all be thrown in the commons for anyone, including giant corporations, to use as they wish. Is that the case? It's not obvious to me why.
IP rights are a cancer on society and have held back progress for generations.
From drugs, to technology, I would say IP rights have done more harm than good. Especially when you consider the number of patent trolls that waste countless of hours and money.
Humans are not islands, nothing you make is yours. It is likely a remix of someone else's idea or influence.
I believe in property rights, but patenting ideas leads to such perverse incentives that the benefits rarely outweigh the cost. Often times the person isn't even the first to come up with the idea! They're just the first to patent it.
Look at the field of psychedelics for example, where there's a mad scramble to patent things as absurd as the process of administering the psychedelic.
With open source software you receive something very valuable: social capital, credit, respect.
Communism is where you do the work (or don't) and everybody is rewarded equally.
That's the Copilot model: you work hard to write the code, and receive nothing in return, because now everyone and their 10-year old brother can write it simply by asking for it... and your name never appears.
I wasn't robbed; I gave it away on purpose. I don't care if my name appears; credit was never the point. Sharing back to the community which has shared so much with me is enough.
I care, very much. I will no longer host any new personal projects on Github, and I will not use Github at companies I lead. I'm looking for alternatives, major one at the moment being Gitlab.
My problem is the that copilot (actually codex) training data and model isn't available. If it was derived from open source code, that work must be released.
I'm bewildered why nobody else has brought this up.
If it just took patterns out of open source and isn't overfit (there is evidence that it is overfit though) it seems ok. Viewing code doesn't actually taint you, clean room reimplementations are just done in a strict manner in corporations to remove all doubt legally, but aren't an actual legal requirement.
I find the legal and ethical implications more interesting than the technology as it stands. Maybe I just don't do the kind of work it's suited to, but I didn't find it terribly useful when I gave it a go. I had an experience that went "oh wow, that turned out a lot of code fast and it looks pretty good" followed by "oh, it made the exact subtle mistakes everyone makes when they write this kind of thing". No surprise given the nature of ML.
On the other hand, I find myself torn between "information wants to be free and this is one more nail in the coffin of our odd and ahistorical concepts of 'intellectual property' and 'plagiarism'" and "oh great, another way for giant corporations to reap all the benefits from work done by individuals and smaller businesses".
I don't think I'll ever use the thing, and I have ~0 power over the societal implications, so overall - yeah, can't get that exercised over it either.
In a world with 8 billion people and billions before you, if you have to ask “Am I the only one that _____”, just quietly whisper to yourself “no, I’m not”, and move along.
Why should I care if you care. If you value your time you'll maybe be interested in having it write unit tests for you (It worked for me™). If you value protecting intellectual property you might care that it's sucking up a lot of it and making available to people who do care. I think it's a losing game because there's enough people willing to give it their intellectual property for free that by the time your get your stuff removed it's already found something similar somewhere else (Drainage my boy!)
> I think it's a losing game because there's enough people willing to give it their intellectual property for free that by the time your get your stuff removed it's already found something similar somewhere else (Drainage my boy!)
I don't think many would find that objectionable; I don't think people who object to the manner GitHub (and OpenAI, etc) has gone about this generally object to the existence of Copilot (or large language models or image generating AIs) itself, so I don't see think we'd be "losing a game". I personally would see it as a great result if these companies were respecting licensing in a rigorous way, or otherwise ensuring that this was more of an opt-in system (I'm not a supporter of intellectual property broadly).
Ahh yeah two points got mushed together. I agree they should fight for their IP. I meant more that the value of their snippet of code will go down as others fill in with their own IP.
I think most of the authors of opne source code only care that their code is being stripped of credits, not that it's being used.
It's not a lot to ask.
If it IS somehow an impossible technical challenge that this commercial entity can't manage, but they still want to persue the potential of this technology, they are free to pay other commercial software developers for licences that grant this usage explicitly just like any other commercial use/redistribution license.
If that pool of software is too small to be as useful, and too expensive to be practical, so what? Tough shit.
I see no reason to excuse how they are currently just not even bothering to do either option, or address the issue in any other way, and are simply outlaw right now.
Agreed, it's in the same vein as self-driving cars.
Sure, it could put a lot of programmers out of a job in theory.
In practice, the emergency brake alert goes off for cars waiting to turn in the oncoming lane, the blind spot warnings trigger on cars that are ahead of you, the lane departure warnings are usually wrong, and so on.
I'm not worried, and I prefer to avoid the uncertainty even if it means outsourcing a bit less effort to the magic AI pixies.
No, you are not the only one. There are unfortunately plenty of people who don't care about massive corporations asserting ownership over the work of other people whilst jealously guarding their own IP, and even some apologists for them.
I am ignoring it for the time being. and maybe I am misunderstanding its usefulness. I'm having a hard enough time with less experienced engineers generating large blocks of code and pushing it on me to play find the errors; the idea of an AI doing it as part of my workflow doesn't sound very appealing.
Seriously! Some of the most frustrating coworkers I've had to deal with over the years are the ones who just churn out reams of lightly-considered code, as though they are getting paid by the line.
I would be far more impressed with an AI which could spot hidden redundancies and suggest opportunities for code reduction.
I tried it out on the kind of work I do (Spark data pipelines, machine learning), and found it thoroughly useless. Getting it to generate code that was remotely close to what I wanted was pointlessly difficult. I tried throwing it at a parsing function in a date library I maintain and it spit out nonsense that, I suppose, looked like it was doing something reasonable (but wasn't, which is worse).
Maybe it's good for some things, but I wasn't impressed. My job's safe for a little while at least.
Do you only care about things that directly affect you negatively and personally? There are a lot of things that don’t affect me directly personally that I still care about.
I don’t write open source public software with a restricted license, but I understand why some people do. I respect that, and I probably use a lot of the software without realizing it. I can understand why they’d be bothered by theft of their work, and I could see downstream effects such as them stopping their work that would eventually affect me.
I trialled it. I found that most of the code it wrote was wrong so I didn't bother paying for a subscription. It was like pairing with a super enthusiastic developer that is eager to write code at every opportunity but doesn't understand what we're doing.
I have no interest in it either. I am fascinated tho by how software developers have played themselves again. No wonder management and corporations treat most of them like children.
Yea it basically is concerning if you have code in GitHub or you want to play with copilot. If anyone can reply to me that uses copilot in a business setting because to me it’s a nightmare to use because of the probability of it being a liability.
63 comments
[ 4.5 ms ] story [ 80.5 ms ] threadThese systems are a mechanism that can regurgitate (digest, remix, emit) without attribution all of the world's open code and all of the world's art.
With these systems, you're giving everyone the ability to plagiarize everything, effortlessly and unknowingly. No skill, no effort, no time required. No awareness of the sources of the derivative work.
My work is now your work. Everyone and his 10-year old brother can "write" my code (and derivatives), without ever knowing I wrote it, without ever knowing I existed. Everyone can use my hard work, regurgitated anonymously, stripped of all credit, stripped of all attribution, stripped of all identity and ancestry and citation.
It's a new kind of use not known (or imagined?) when the copyright laws were written.
Training must be opt in, not opt out.
Every artist, every creative individual, must EXPLICITLY OPT IN to having their hard work regurgitated anonymously by Copilot or Dall-E or whatever.
If you want to donate your code or your painting or your music so it can easily be "written" or "painted", in whole or in part, by everyone else, without attribution, then go ahead and opt in.
But if an author or artist does not EXPLICITLY OPT IN, you can't use their creative work to train these systems.
All these code/art washing systems, that absorb and mix and regurgitate the hard work of creative people must be strictly opt in.
If you don't care about this, it's naivete, or a lack of foresight, or apathy as these companies pillage the commons. Not something to be proud of.
Microsoft and OpenAI (and others) are robbing us and you should care.
What a terribly pessimistic view of sharing. MIT license gives ability to copy for any reason and it's very popular.
Copyright <YEAR> <COPYRIGHT HOLDER>
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
Frankly, it almost seems like you're saying that since all works are derivative I shouldn't care how my own works get used -- it should all be thrown in the commons for anyone, including giant corporations, to use as they wish. Is that the case? It's not obvious to me why.
From drugs, to technology, I would say IP rights have done more harm than good. Especially when you consider the number of patent trolls that waste countless of hours and money.
Humans are not islands, nothing you make is yours. It is likely a remix of someone else's idea or influence.
I believe in property rights, but patenting ideas leads to such perverse incentives that the benefits rarely outweigh the cost. Often times the person isn't even the first to come up with the idea! They're just the first to patent it.
Look at the field of psychedelics for example, where there's a mad scramble to patent things as absurd as the process of administering the psychedelic.
Communism is where you do the work (or don't) and everybody is rewarded equally.
That's the Copilot model: you work hard to write the code, and receive nothing in return, because now everyone and their 10-year old brother can write it simply by asking for it... and your name never appears.
You were robbed.
The rest of us aren't so selfless.
I'm bewildered why nobody else has brought this up.
On the other hand, I find myself torn between "information wants to be free and this is one more nail in the coffin of our odd and ahistorical concepts of 'intellectual property' and 'plagiarism'" and "oh great, another way for giant corporations to reap all the benefits from work done by individuals and smaller businesses".
I don't think I'll ever use the thing, and I have ~0 power over the societal implications, so overall - yeah, can't get that exercised over it either.
I don't think many would find that objectionable; I don't think people who object to the manner GitHub (and OpenAI, etc) has gone about this generally object to the existence of Copilot (or large language models or image generating AIs) itself, so I don't see think we'd be "losing a game". I personally would see it as a great result if these companies were respecting licensing in a rigorous way, or otherwise ensuring that this was more of an opt-in system (I'm not a supporter of intellectual property broadly).
Can it do this? Does it provide good branch coverage?
It's not a lot to ask.
If it IS somehow an impossible technical challenge that this commercial entity can't manage, but they still want to persue the potential of this technology, they are free to pay other commercial software developers for licences that grant this usage explicitly just like any other commercial use/redistribution license.
If that pool of software is too small to be as useful, and too expensive to be practical, so what? Tough shit.
I see no reason to excuse how they are currently just not even bothering to do either option, or address the issue in any other way, and are simply outlaw right now.
The legal and ethical aspects are fascinating, but I have no interest in that debate.
I care much more about my job security as a software engineer and systems architect, and on that front Copilot does nothing to challenge that.
Sure, it could put a lot of programmers out of a job in theory.
In practice, the emergency brake alert goes off for cars waiting to turn in the oncoming lane, the blind spot warnings trigger on cars that are ahead of you, the lane departure warnings are usually wrong, and so on.
I'm not worried, and I prefer to avoid the uncertainty even if it means outsourcing a bit less effort to the magic AI pixies.
I would be far more impressed with an AI which could spot hidden redundancies and suggest opportunities for code reduction.
Maybe it's good for some things, but I wasn't impressed. My job's safe for a little while at least.
I don’t write open source public software with a restricted license, but I understand why some people do. I respect that, and I probably use a lot of the software without realizing it. I can understand why they’d be bothered by theft of their work, and I could see downstream effects such as them stopping their work that would eventually affect me.
I don't actually see myself using it, and all my source is out there (for the most part, anyway), as MIT-licensed.