53 comments

[ 0.18 ms ] story [ 65.1 ms ] thread
Still an amazing hack today and I love it. However, I heard Apple are developing a touch screen MacBook this year, and I simply don't get why they're doing that. I don't know what's worse, the ergonomics or the fingerprints.
Is there a coating you can apply to the glass to help with smudge marks?
Using an external webcam is that not more than $1? cool project though; reminds me of how you could use a Wii remote to create a interactive whiteboard.
Love it! I appreciate the ethos of doing more with existing hardware. Adding an actual touchscreen would add real COGs to a macbook, and many potential failure points. Using the existing camera hardware + software seems to produce a "good enough" result for most people for casual use. I'm sure with some time and eng, Apple could make the "hack" shippable. But it doesn't earn product managers the big big bonuses, so it'll never happen.
I wonder how well this would work with my bright blue fingernails that are about .5" longer than my finger.

I then wonder how much recalibration I would have to do when one of them broke and I was poking directly at the screen.

You chose to suffer not just with touchscreens. That said, it would probably work just fine.
Checking this profile of a random hacker in 2018, of course they are now working on AI.
I wouldn't want a touchscreen MBP even if it was free, anyone else feel similar?

I don't get the draw - we already optimize for keyboard commands to avoid living our fingers over to a touchpad. Why would I want to start clicking on my screen?

If you're using your computer for tasks (rather than entertainment) and you're not a visual designer, I don't get why Apple are apparently going to be putting them into the new MBP line later this year.

While I'm the same and totally agree with you, the few times I've been using touchscreen I find the habit sticks so hard that for days I keep touching my macbook screen, so there is definitely some subconscious desire for this (or I would have defaulted to using the trackpad even if my brain thought touch was available)
I agree. I've never wanted a touch screen on my laptop. My screen gets smudged enough already.
It would make sense if the screen folded over. In a laptop form factor a touch screen is just annoying because it keeps pushing the screen back.
I have 2-3 old touchscreen laptops lying around. The touchscreen is useless to me. Worse than useless. If I ever use it, it’s accidentally, and I end up annoyed.
Yes, I feel like it'll be a degrade in quality if they do this with any of their current line up. If they want to make a Macbook Ultra or whatever with it, that's fine -- I would have no interest in it.
Why? Better than a track pad.

Use a Surface Pro some time. If you are just casually browsing or reading a website. I find it much nicer to just tap on a link or swipe to scroll.

Sometimes I feel the urge to do some art, and the bigger surface might allow that. Perhaps in lieu, make a bigger trackpad.
I feel like the point isn't "there should be a touch screen MacBook" but more "holy shit we simulated a working touch screen by looking at reflections coming off the glass, isn't that cool".
But the Touch Bar was such a resounding success …
Well, when I am doing rather thinking work, so not type in commands as fast as possible - I very much do like my laptop to have a touchscreen. It is way more ergonomic and comfortable, but yes, slower. But when the real work happens in my head, I like to be rather comfortable.

(Also I can immediately test touch features of the apps I develope)

I completely disagree. I've got a laptop with a touch screen, and it's occasionally very useful. It's rarely my primary input method, but when you're not constantly using the mouse, how often do you lose track of where the mouse cursor is? Instead of reaching for the mouse, figuring out where the cursor is, and then carefully maneuvering it over the button I want to click, I can just reach out to the screen.

A touch screen is incredibly useful when you're not currently already holding your mouse. It's easier to switch from keyboard to touch than from keyboard to mouse.

> I wouldn't want a touchscreen MBP even if it was free, anyone else feel similar?

I don’t want a touchscreen MBP, but as long as touching the screen is an optional interaction and everything else is the same, I see no reason to reject it if it was free. I can just not touch the screen.

> we already optimize for keyboard commands to avoid living our fingers over to a touchpad.

“We” is a much smaller percentage of people than you’re likely thinking of. We’re outliers, not the norm. Yes, even amongst professionals.

Tech-reviewers keep harping on the MacBook for not having a touch option, but I think it's mostly of check a box.

Something no one seems to address is that it makes no sense to have touch on the laptop screen, because you honestly don't use it much, at least in a professional setting. You'll always dock your laptop anyway, either for comfort, or legal compliance (or both). My 27" monitor doesn't have touch, that's what I use 99% of the time, the laptop screen is a small auxiliary screen on the side. Why I reach out and touch it? That's also why the touch bar made no sense, it was on a keyboard that I almost never use.

Seems like it only makes sense if it's a hybrid tablet laptop like the Yoga. Otherwise it's a nice gimmick. I can also see Apple being terrified at someone's dirty fingers smudging the laptop, though they'd have some anti-smudge coating built in at that point
Maybe they solved the greasy fingers leaving smudges on your screen problem with a new surface. :D
Touch screens are not pleasant for laptops. I prefer not to have them.
This is amazing. They should start to install upward looking cameras to implement this officially.
I think I could do this for less than 15 cents: four small peices of double sided tape, and the tiny mirror, and two hair pins... but the software? Priceless.
It feels real because of the dirty touchscreen.
I don’t want to encourage people touch my screen and smudge things up.
Neeeeveeeer!!! please let macbooks be as they are .. why would I ever choose to put fingers on that beautful screen ... I don't get it!
I was laughing so much. Thank you. Unexpected tech!
The reason we buy macbooks is because they aren't touchscreens.
What a super neat application of computer vision. Cool writeup. Thanks for sharing the code and making it open source too!
As other people mentioned this is obviously not something I would want in my notebook... but I can still appreciate the cool tech!

I can also definitely see this kind of thing being used in things budget outdoor displays, specially if the UI is made to accommodate the lack of accuracy, and the camera is positioned on the side (since these displays are usually vertical).

Difficult to capture reflections across a large screen while also dealing with outdoor lighting, glare, and moisture. The touchscreen part isn't usually what makes outdoor signage expensive compared to IP65, temperature control, and a secure housing, all of which would still need to apply here.

This looks like a neat option for retrofitting, and I suspect it'd work for some non-screen glass applications too. A combined IR/visible light solution would be interesting too, since I suspect those are complimentary (IR touch has issues with radiant light, while this wouldn't; this would have issues with low/no light, while IR wouldn't).

This is cool. Simple prototype. Is it dependent on lighting ... what if you are outside or backlit or glare etc...?
People use their laptops under various lighting conditions. I can imagine it would be difficult (or likely impossible) to bring this PoC to a solid production level technology. It looks like a fun project though.
Don't love touchscreens that much.

But I did love my Toshiba Satellite. It was like writing on paper!

Down with capacitive screens and long live Active Digitizers!

"We've done tons of user testing on this, and it turns out it doesn't work. Touch surfaces don't want to be vertical. It gives great demo but after a short period of time, you start to fatigue and after an extended period of time, your arm wants to fall off. it doesn't work, it's ergonomically terrible."

-Steve Jobs, 2010

https://www.businessinsider.com/steve-jobs-touch-screen-mac-...

Ignoring whether touchscreen laptops are actually a good idea, I "OOF"ed out loud at this line.

> Filter for skin colors and binary threshold

Skin has an extremely broad range of colors that are also lighting dependent. I'd have gone with background subtraction.

I always say, people who want a touchscreen on their Laptop never used a really good trackpad. I never missed a touchscreen on my MacBook but when I do something on someone else’s Windows Laptop I often prefer to touch the screen because the trackpad is just terrible.