Will there be an API for this for digital-only, high resolution pics?
Some feedback too:
1) when submitting it was a bit weird that I have to upload pics in order vs explicitly 'this is my pic', 'this is my art pic'
2) a lot of people won't have a catalog of digital art to upload as their reference pic, some samples to select from would be nice
3) after uploading my source + reference pics and clicking 'submit artwork' it takes me to a login/signup page for AMANUFACTORY.COM. That button really stands out as what-you-should-do to finish the process!
4) would be nice if instead of selecting one painting it generated lots of different styles
I hacked this in one day using some UI for existing stuff, so the UI will be a bit weird.
After uploading your source + reference, you don't have to do anything. The Submit button at the bottom is UI for other people to submit a resulting image. I'll probably remove it since it's for the other stuff.
As far as API, the process is fairly expensive (uses EC2 GPU instance), so any heavy application type usage would probably be better served by setting up your own instance. We use implementations found on github (credit at the bottom of the page).
I'd be really surprised if someone isn't already hard at work on an iOS app that uses this tech. The scalability is of course a problem, but I'd pay 50 cents per photo (assuming I got a small preview of it first) or something of that order to support the costs.
arxiv says it was submitted 26 Aug, so about a week ago. Near the end of the paper they explain how to implement it, so I guess it was a matter of reading the paper and sitting with caffe to toy/hack an implementation -- most of the heavy work was "already done".
I'm sure they're trying to patent it. (eg DeepMind has been patenting everything they can, even stuff like dropout and deep q-learning!) Which raises an interesting question: Instapainting is a commercial service and this is targeted at customers:
> After your artwork is generated, you are free to use it for any purpose. Upload it to Instapainting.com as an order and an artist will physically hand-paint it!
So how does that interact with the patent application? Are they liable for damages once the patents go through or do they just have to take it down?
The kids who know what's up will know where to do the research. That should be incentive enough. Considering you can't stop another organization from building on your research, the "competition" is a little hard to explain.
A university should be run like a school, not a business.
You should look up the financial statements for one of your local colleges and see if it can't be run like a business. Just one of them costs a lot of money to keep going..
That's why they have to protect IP and commercialise it. Because if they don't, the colleges can't keep teaching as it all costs so much.
Seriously quick. I thought I'd take a stab at it and asked what the license was for the reference implementation. Haven't even check the answer yet :-/
Am I using it commercially? The results are given away for free. If you want s human artist to paint it (what instapainting does) you have to upload your result as a reference image yourself.
My use would fit under the CC definition of non commercial since the neural net results are handed out for free.
I accidentally submitted something four different times, since I thought the form wasn't loading. Does it just start as soon as you post two images, without a submit button?
42 comments
[ 16.0 ms ] story [ 149 ms ] threadSome feedback too:
1) when submitting it was a bit weird that I have to upload pics in order vs explicitly 'this is my pic', 'this is my art pic'
2) a lot of people won't have a catalog of digital art to upload as their reference pic, some samples to select from would be nice
3) after uploading my source + reference pics and clicking 'submit artwork' it takes me to a login/signup page for AMANUFACTORY.COM. That button really stands out as what-you-should-do to finish the process!
4) would be nice if instead of selecting one painting it generated lots of different styles
After uploading your source + reference, you don't have to do anything. The Submit button at the bottom is UI for other people to submit a resulting image. I'll probably remove it since it's for the other stuff.
As far as API, the process is fairly expensive (uses EC2 GPU instance), so any heavy application type usage would probably be better served by setting up your own instance. We use implementations found on github (credit at the bottom of the page).
No wonder universities are getting super serious about IP protection/licensing/commercialisation
Edited some typos.
> After your artwork is generated, you are free to use it for any purpose. Upload it to Instapainting.com as an order and an artist will physically hand-paint it!
So how does that interact with the patent application? Are they liable for damages once the patents go through or do they just have to take it down?
That being said, a human artist can do a much better job than these algorithms!
Aren't most convnets trained using dropout these days?
Edit: it seems the implementation that this site uses does as well:
https://github.com/kaishengtai/neuralart/blob/master/models/...
Patents need to go :(.
Aren't most convicts trained as dropouts these days?
Thought he was contracting out prisoners to paint for him...
oh god, the knowledge might be free with only attribution and no revenue! the horror!
A university should be run like a school, not a business.
That's why they have to protect IP and commercialise it. Because if they don't, the colleges can't keep teaching as it all costs so much.
edit: Leon A. Gatys, Alexander S. Ecker, Matthias Bethge, A Neural Algorithm of Artistic Style
Oh, and since you're basically using this commercially you might also want to take a look at the license of the VGG model: https://gist.github.com/ksimonyan/3785162f95cd2d5fee77#file-...
My use would fit under the CC definition of non commercial since the neural net results are handed out for free.
A DeepDream for audio would be very interesting.
EDIT: Increased to 768px max size.