It's not really "auto-draw" as much as it's a visual search in which you suggest shapes and it looks across the collection for visually similar icons. Impressive and fun, but not yet a huge advancement over just typing "house" or "cake" to search the image library.
I'm not sure what you mean by "compositional", but you can keep drawing after you've matched a shape and it will start suggesting matches for your new shape as well--though unfortunately it doesn't seem to auto-scale the icon you pick to the size of your original drawing, so unless they're already the size you want it's not as helpful as one might hope.
I guess GP means, I start drawing a cat, and it becomes a nicely drawn cat, then I add wings and a horn and a pistol and it becomes a flying laser unicorn cat.
I assumed this was the big idea in TFA, but it seems it's a collection of clip arts, with a terrible interface for looking them up.
I guess GP means, I start drawing a cat, and it becomes a nicely drawn cat, then I add wings and a horn and a pistol and it becomes a flying laser unicorn cat.
Yes, exactly. And then you start sketching a few rough buildings, a beam, some comets, some explosions, and a helicopter: it becomes a drawing of a giant flying unicorn laser cat from space, attacking Tokyo.
OP's example is maybe a little odd, but I admit that the very first thing I tried was "compositional" as well. I drew a mountain, clicked the icon to make it into a mountain, and then drew a bike going up it. However, there was no way to have a drawing with both a mountain and a bike.
I could have sworn none of those controls were there an hour ago. At any rate, now that I can scale things here's a random icon I drew to demonstrate the point: https://www.autodraw.com/share/G2IIQMITW0BB
If you mean that the algorithm was non-trivial, that's probably true. But I don't see what else you could do with it besides recognising a hand-drawn shape.
Their description made it sound like a really cool lower-level tool, so obviously it ends up being a letdown.
Drawing/art programs generally have a line smoothing feature - just smoothing your wobbly lines as you draw, using relatively simple algorithms. The description here made me hope for something more "medium-level", half-way between the two. It wouldn't just smooth your lines - it would adjust them according to context, based on a corpus of more precise line drawings, and perhaps predict/suggest the next strokes. It might be difficult to pull off though, if implemented naively it would probably just work against the artist.
This kind of functionality sort of exists in a basic form in the default mail on iOS using a feature called Markup. Markup tries to guess if you drew an arrow or a circle and suggests it based on your drawing.
Indeed ... Google docs has had this feature for some time. If you want to insert a special character or symbol, it gives the option to draw it and then shows similar characters.
In some cases, yes its easier to search, but it does fill a use case. I'm not an illustrator yet often need icons. I tend to have a rough idea of what I want but can struggle to find the right keywords. Visual search here is very useful, and allows an element of play for finding the icon. (Hopefully play, not horrible frustration)
1. Make a sketch of your choice
2. Pick the first AutoDraw suggestion (or randomly one of the first N)
3. Feed that to google image search
4a. Google's best guess for this image is a prompt for the next human sketch. Repeat from 2.
OR
4b. Pick a sketch-like image from the results of 3 and reproduce on the AutoDraw canvas. Repeat from 2.
I got an amazing result on my first attempt at 1 - 3:
Fun idea but doesn't really work. Just sorta replaces your random doodle with a random piece of clip art. Any trace of your original drawing is gone. Disappointing.
Yes, that is the point of this tool, and it probably beats slapping together a bunch of clipart based on google image search, but I was hoping it was something more than that. The tagline is misleading because it's not really helping anyone draw -- it's just a visual search for sketches.
I sketched a really rough palm tree and it suggested a bunch of tree drawings, one of which was a palm. That's helpful, but everyone who wants a palm gets the same palm. Wouldn't it be great if the tool recognized that I was trying to draw a palm and then improved mine by adjusting it according to what it knows about sketches of palms (smoothing the lines, adjusting angles, etc)?
Just one of my many fun throwaway projects :P It used to be up at skrch.com, but went down a while ago. Couldn't figure out how to monetize/sell it so I moved on -- I'm still not sure what sector could use something like it. The original idea actually came about in a dream (true story!) and I wondered if I could actually implement it. Took me about a month or two as I had never used OpenCV before.
The search was done with a very simple histogram analysis algorithm and the image database had about 10,000 pictures from Flickr. Results were pretty decent, but sometimes hit and miss[1]. Database costs were pretty high as I don't think there's any database out there that has any way to efficiently hash 2d histograms (so everything was stored in memory). That could be a fun challenge.
Whats the process for Google to make this sort of thing? Does some 7 figure exec say we need to make it easier to draw bikes and then Google gets their army of 10x engineers to make this happen?
It looks like Google persistently feels guilty for getting enormous amounts of money without bringing too much of a value (Ads). So they try to compensate that by giving back. Most of the stuff they offer is honestly crap, but this one (Autodraw) and stuff like GMail are very decent.
For stuff like this, it usually starts from the bottom. Engineers have ideas, convince others to help them work on their ideas, build prototypes (alone or with others), sometimes get help from product managers to develop a business plan, then pitch it to senior leadership to get some funding.
It takes a lot of skill, tact, and product acumen to get things out the door -- probably the same set of skills as you would need outside Google. (Except that within, you have access to more and better resources, but the bar is much higher.)
Obviously, this doesn't mean that every idea will stick... a lot of them won't -- some don't make money, some don't provide real value, and some are just terrible ideas. But it's a much better process than just top-down alone.
[Edited because I'm dumb and can't count figures] I've mostly seen this kind of thing happen because some engineer(s) wanted to try an idea, not because it was imposed from above.
This would be great for flowcharts and diagrams. Sketch out a rough diagram on a tablet, and then have the shapes and lines "snap" to crisp versions as soon as they are identified. Even better if I could draw it on a whiteboard, take a photo, upload it, and get a response back as soon as it's done being converted.
There are bunch of apps that do this on ipad and Android... Plus Microsoft's note taking app, Lenovo/IBM's old X-series apps, and I'm sure others. Heck, the Newton did it.
If you're curious, try one of them out. It gets frustrating pretty quick.
Could you please name some? There seems to be an even bigger bunch of apps that do plain drawing, and it can be hard to find the needle (apps that convert rough sketches to clean line art) in the haystack (many apps for sketching; most just replicating the paper experience on a screen without adding functionality). Thanks.
Awesome. As a board game designer, I could see myself using this to make prototype cards that look decent much easier. Although I'm sure I'll still need Illustrator to take it to the next level. But for a quick and dirty prototype, it should work great.
Much better than searching the web for hours for icons that have a similar-ish art style that have what I need.
I keep forgetting about the noun project. Also, those icons by solis look like they could be useful, thanks for letting me know about that. I was aware of an old card game design series he did, but not his Patreon. I've also picked up a few of his games that are still on my Wall of Board Game Shame and need to get played.
interesting, it definitely supports the narrative of AI replacing changing our jobs, in this case the designer.
For less artistic folks like me, this tool is from heavens. How many times did you want to illustrate a simple diagram but couldn't draw or use photoshop?
Having said that I can see Autodraw still needs more work done. It failed to recognize a phallus.
I was surprised how poorly it ran on my very modern phone. And then how tiny everything was on my desktop.
When I looked past that and tried to draw a cat, it wasn't all that useful. I mean cool, you saw I was drawing a face and gave me 50 options. But what am I supposed to do with that?
It feels like a rehash of what the Newton would do when you tried to draw stuff. But it does it better. I think if I could skip the "pick what I meant" step, it would be cool for whiteboarding in the office.
That's because your very modern phone has a very puny CPU compared to even the average desktop CPU. I'm surprised about how few people know that their "2 GHz multi-core" phone is 5-10x slower than an average 5 year old desktop on common tasks.
(Edit: hehe, as evidenced by this post being downvoted. The HN audience doesn't know any better either?)
I think it's more because you're making a straw man argument. Nobody disagrees that they're slower. I'm saying it's not enjoyable on my phone despite them saying it's good on phones.
Probably downvoted because you're wrong? (Not that I did.) But this is with the caveat that this is comparing a desktop Mac to an iPhone and I haven't the faintest clue about top Android phones, although I have the understanding that the A10 destroys the current Qualcomm SoCs.
The relevant quote:
>The most remarkable thing about this is how similar it looks to the Mac results above. Looking back at the old tests, the iPhone was orders of magnitude slower. An Objective-C message send, for example, was about 4.9ns on the Mac, but it took an eternity on the iPhone at nearly 200ns. A simple C++ virtual method call took a bit over a nanosecond on the Mac, but 80ns on the iPhone. A small malloc/free at around 50ns on the Mac took about 2 microseconds on the iPhone.
>Comparing the two today, and things have clearly changed a lot in the mobile world. Most of these numbers are just slightly worse than the Mac numbers. Some are actually faster! For example, autorelease pools are substantially faster on the iPhone. I guess ARM64 is better at doing the stuff that the autorelease pool code does.
>Reading and writing small files stands out as an area where the iPhone is substantially slower. The 16MB file tests are comparable to the Mac, but the iPhone takes nearly ten times longer for the 16-byte file tests. It appears that the iPhone's storage has excellent throughput but suffers somewhat in latency compared to the Mac's.
It's really cute. I wonder if Google is going to use all the classification that people will do of their own sketches to teach its machines... to recognize hand-drawn sketches.
That was my first thought as well. But I do wonder about the quality of submissions given that most people can't draw with a mouse as well as they can with a writing utensil (assuming a drawing tablet or touchscreen is not used either).
149 comments
[ 374 ms ] story [ 954 ms ] thread[1] https://quickdraw.withgoogle.com/
I assumed this was the big idea in TFA, but it seems it's a collection of clip arts, with a terrible interface for looking them up.
I am super confused by the existence of this.
Yes, exactly. And then you start sketching a few rough buildings, a beam, some comets, some explosions, and a helicopter: it becomes a drawing of a giant flying unicorn laser cat from space, attacking Tokyo.
Edit: something like this [0].
[0] https://s-media-cache-ak0.pinimg.com/564x/78/9c/99/789c99430...
Drawing/art programs generally have a line smoothing feature - just smoothing your wobbly lines as you draw, using relatively simple algorithms. The description here made me hope for something more "medium-level", half-way between the two. It wouldn't just smooth your lines - it would adjust them according to context, based on a corpus of more precise line drawings, and perhaps predict/suggest the next strokes. It might be difficult to pull off though, if implemented naively it would probably just work against the artist.
https://webdemo.myscript.com/views/math.html
1. Make a sketch of your choice 2. Pick the first AutoDraw suggestion (or randomly one of the first N) 3. Feed that to google image search 4a. Google's best guess for this image is a prompt for the next human sketch. Repeat from 2. OR 4b. Pick a sketch-like image from the results of 3 and reproduce on the AutoDraw canvas. Repeat from 2.
I got an amazing result on my first attempt at 1 - 3:
Autodraw (Cat > Raccoon): http://imgur.com/a/Fy00K
Google Images (Raccoon > "Suppression of Enemy Air Defenses"): http://imgur.com/a/F3z1T
It'd be hilarious to automate this, set it running, and just watch it go.
I sketched a really rough palm tree and it suggested a bunch of tree drawings, one of which was a palm. That's helpful, but everyone who wants a palm gets the same palm. Wouldn't it be great if the tool recognized that I was trying to draw a palm and then improved mine by adjusting it according to what it knows about sketches of palms (smoothing the lines, adjusting angles, etc)?
http://detexify.kirelabs.org/classify.html
Reminds me of a little toy project I made 5 years ago: https://www.youtube.com/watch?v=3WswSywx6TI
No live website anywhere unfortunately.
The search was done with a very simple histogram analysis algorithm and the image database had about 10,000 pictures from Flickr. Results were pretty decent, but sometimes hit and miss[1]. Database costs were pretty high as I don't think there's any database out there that has any way to efficiently hash 2d histograms (so everything was stored in memory). That could be a fun challenge.
I open sourced it a while ago here: https://github.com/dvx/skrch
[1] https://stackoverflow.com/questions/5332212/feature-blob-cor...
http://i.imgur.com/NmpdbT2.png
Drew a face and it proposes ovens and random jitters as closest matches???
http://imgur.com/a/4mjz0
It takes a lot of skill, tact, and product acumen to get things out the door -- probably the same set of skills as you would need outside Google. (Except that within, you have access to more and better resources, but the bar is much higher.)
Obviously, this doesn't mean that every idea will stick... a lot of them won't -- some don't make money, some don't provide real value, and some are just terrible ideas. But it's a much better process than just top-down alone.
https://youtu.be/VWSKqgHOEy0?t=5m32s
If you're curious, try one of them out. It gets frustrating pretty quick.
Much better than searching the web for hours for icons that have a similar-ish art style that have what I need.
For less artistic folks like me, this tool is from heavens. How many times did you want to illustrate a simple diagram but couldn't draw or use photoshop?
Having said that I can see Autodraw still needs more work done. It failed to recognize a phallus.
Yeah, that's the web for you. With all the obsession with apps in recente years, I'm glad to hear that being advertised.
Maybe we're hitting an App saturation point.
When I looked past that and tried to draw a cat, it wasn't all that useful. I mean cool, you saw I was drawing a face and gave me 50 options. But what am I supposed to do with that?
It feels like a rehash of what the Newton would do when you tried to draw stuff. But it does it better. I think if I could skip the "pick what I meant" step, it would be cool for whiteboarding in the office.
What phone and what browser? Ran great in chrome on my mid-range android.
(Edit: hehe, as evidenced by this post being downvoted. The HN audience doesn't know any better either?)
Here's an instructive article from last year comparing a 2013 Mac Pro and an iPhone 6s: https://www.mikeash.com/pyblog/friday-qa-2016-04-15-performa...
The relevant quote: >The most remarkable thing about this is how similar it looks to the Mac results above. Looking back at the old tests, the iPhone was orders of magnitude slower. An Objective-C message send, for example, was about 4.9ns on the Mac, but it took an eternity on the iPhone at nearly 200ns. A simple C++ virtual method call took a bit over a nanosecond on the Mac, but 80ns on the iPhone. A small malloc/free at around 50ns on the Mac took about 2 microseconds on the iPhone.
>Comparing the two today, and things have clearly changed a lot in the mobile world. Most of these numbers are just slightly worse than the Mac numbers. Some are actually faster! For example, autorelease pools are substantially faster on the iPhone. I guess ARM64 is better at doing the stuff that the autorelease pool code does.
>Reading and writing small files stands out as an area where the iPhone is substantially slower. The 16MB file tests are comparable to the Mac, but the iPhone takes nearly ten times longer for the 16-byte file tests. It appears that the iPhone's storage has excellent throughput but suffers somewhat in latency compared to the Mac's.
Given the prevalence of mobile devices, some of which use styluses—even ignoring touchscreen laptop and desktop screens—why would you assume that?