upvote
Turning a MacBook into a touchscreen with $1 of hardware (2018)

(anishathalye.com)

People use their laptops under various lighting conditions. I can imagine it would be difficult (or likely impossible) to bring this PoC to a solid production level technology. It looks like a fun project though.
reply
I wouldn't want a touchscreen MBP even if it was free, anyone else feel similar?

I don't get the draw - we already optimize for keyboard commands to avoid living our fingers over to a touchpad. Why would I want to start clicking on my screen?

If you're using your computer for tasks (rather than entertainment) and you're not a visual designer, I don't get why Apple are apparently going to be putting them into the new MBP line later this year.

reply
I have 2-3 old touchscreen laptops lying around. The touchscreen is useless to me. Worse than useless. If I ever use it, it’s accidentally, and I end up annoyed.
reply
I don’t understand touchscreens on laptops that aren’t designed to fold flat. It’s got the feel of finger painting an unconstrained birthday balloon.
reply
I had a laptop that folded to 180, without touch screen, and had a webcam hidden under F7 so it either looked straight up your nose or showed your huge fingers
reply
Sometimes, if I’ve been using my iPad for awhile and switch over to my MBP, I might reach out and touch the screen out of habit. I can’t be the only one.
reply
I had the opposite problem when work issued me a ThinkPad - I would accidentally brush my screen with my caveman knuckles once a day and somehow nuke a dozen lines of code.
reply
Macs are definitely not optimized for keyboard commands. If you feel the software you use is keyboard optimized, odds are it's not really Mac software.
reply
macOS has been one of the best keyboard OSes for over a decade, maybe longer. Nearly everything is bindable without additional software or third party apps. This can be done on globally or app-specific. A lot of this comes from the deep script ability that used to be a priority but has fallen by the wayside in recent years.
reply
Huh? Of all the wonky shit about my Mac, the flawless keyboard navigation is really none of that
reply
I'm surprised you feel that way. I fight with my mac every day for one reason or another. At least it's not as bad as the days where some software used Cmd + letter and some used ctrl +letter, but for instance Cmd tab will switch to the wrong window when I go back and I have to use the mouse. Window switching in general is a lot harder if you only have the keyboard because the laptop is docked without a magic trackpad
reply
strange. Some keyboard shortcuts in os x are kinda weird and not intuitive to linux or windows users, but they are there. It's totally possible to use mac without trackpad. even cmd+tab switcher has a lot of hidden (but googlable) things: while still holding cmd after initial cmd+tab, you can close apps with q, switch to other apps with tab and (cmd+)shift+tab or left/right arrows, show app windows with down, etc. There's also a cmd+` for switching between one app's windows. I still find that distinction weird from usability perspective, but it's not too hard to adapt to it.
reply
Really? I find that on MacOS apps are very inconsistent about whether popping open a menu shows me hints for selecting items in that menu. Those same apps are consistent about it on Linux.

And then there's the bonkers window manager which can't move focus directionally (e.g. Super + left) and so you have to fall back to Cmd + tab tab tab tab but even then there's no consistency about whether you're switching between app instances or windows instances within the same app...

reply
Cmd+Shift+Tab goes in the opposite direction.
reply
Specific applications sure, but the base OS interface is unusable without a trackpad.
reply
“Flawless” is absolutely the opposite of how I’d describe the third class keyboard navigation in MacOS.

It’s actually more intuitive to use a magic keyboard on the iPad than on the desktop OS.

reply
What do you find missing from macOS keyboard navigation?

I've been using macs since the 90s so I'm quite used to it, so I'd love to know what I've been missing out on.

reply
I have a lot of complaints but I would say my three big gripes are:

- Window navigation within (rather than between) open programs. Mainly if one is on an external monitor, this is just a nightmare and I end up using expose and clicking the window instead.

- Window positioning (I installed 3rd party software called Rectangle for this last year so it’s kind of solved but if we’re talking about the vanilla experience this is a big one)

- Having to switch focus to the dock and navigate one by one through shortcuts to open them instead of the Super+Dock position shortcuts that Windows and KDE expose

reply
> Window navigation within open programs

Isn’t table cmd + ~

reply
At least we have trackpads that are worth a crap.
reply
I do adore the macOS trackpads, they blow anything else I’ve used out of the water.

The keyboard (physically) is also just very pleasant to type on.

reply
While I'm the same and totally agree with you, the few times I've been using touchscreen I find the habit sticks so hard that for days I keep touching my macbook screen, so there is definitely some subconscious desire for this (or I would have defaulted to using the trackpad even if my brain thought touch was available)
reply
> I don't get why Apple are apparently going to be putting them into the new MBP line later this year.

Apple has apparently being going to put a touchscreen in a laptop every year since the iPad came out, and it's never materialized.

reply
Previously, those were rumors from enthusiasts who wanted to see it. Now it's an internal leak so there's a lot more credibility to those rumors.
reply
No, there were internal "leaks" in the past as well.

https://archive.ph/xOgtp

reply
> Based on current internal deliberations, the company could launch its first touch-screen Mac in 2025

It looks like those leaks aren't too far off what I'm saying. Deadlines slipping by 1-2 years isn't way off especially for such a new/different product direction. And the rumor also said "could" which means even internally, it wasn't a strong claim.

reply
> January 11, 2023

> Based on current internal deliberations, the company could launch its first touch-screen Mac in 2025

Even if it didn't come to pass, just a few years ago is a more relevant leak than the every-year-since-the-iPad-released "rumors."

reply
Yes and it's an article about a leak 3 years ago. And there were more "leaks" before that. I just can't be bothered to research and link the obvious to argument against an "opinion".
reply
It just feels ancient and weird now that I can tap every screen I own, except my Mac. I don't want to replace the Mac's keyboard & mouse with a touchscreen, I would simply like it to support touch.

(This also made me realize the impending obsolescence of the Studio Monitor XDR: no touch support.)

reply
It would make sense if the screen folded over. In a laptop form factor a touch screen is just annoying because it keeps pushing the screen back.
reply
I wouldn't want a touch screen to become the primary input device, but I think it would be useful on occasion. Not entirely unlike how we still have touchpads even though we try to use keyboard commands.
reply
I very much would want a touchscreen for my use cases.
reply
The benefit of a touchscreen MBP is that Apple will be forced to make their screens more protective.
reply
I agree. I've never wanted a touch screen on my laptop. My screen gets smudged enough already.
reply
as long as it works well, would rather have it than not (but don't want to pay extra, so yeah... leave it out)
reply
The ergonomic aspects are horrible. I believe there's actual research on this from the 70s/80s/90s.
reply
All my Windows laptops have touch screens and I love it. What is the problem with having another input method available? You only use it when it’s appropriate.
reply
This is cool. Simple prototype. Is it dependent on lighting ... what if you are outside or backlit or glare etc...?
reply
Touch screens are not pleasant for laptops. I prefer not to have them.
reply
It's actually quite pleasant user experience for scrolling. Some interactions are better with a pointer, others are better with touch.

You can try it on an iPad with Magic Keyboard attached, it's very good to be able to do precision through the trackpad and then casually move large things on the screen with your fingers.

reply
Honestly I just hate having fingerprints on a screen. And I use pageup/pagedown mostly which to me is better than scrolling.

Trackpad is nice for a device you can lay flat on a table or keep on one hand while sitting on the sofa, not too much when the device has a keyboard permanently attached to it and it cannot fold. I know I have a thinkpad like that and I never use the touchscreen.

reply
Yesterday someone online told me I'm a boomer because (among the many other issues I mentioned) I said that apple computers lack page up/down keys which is annoying.
reply
Option-up/option-down?

Two keys rather than one, but makes up for it by not being way off in some oddball part of the keyboard. You can one-hand it pretty easily, since there's an "option" right next to the arrow keys.

reply
Agree for iPad. But for a laptop trackpads ftw!
reply
You don't have to use it.
reply
As long as there's a way to maintain the current display density, that would be just fine.

However, like on Windows, I suspect macOS would increase the tap target size on lots of the touchable elements. Even if I don't use the touchscreen, I would still have to pay the touch target real estate tax in my applications.

reply
That's a fair ask. My dream would be a simple toggle in something like control center for macOS that can flip between "touch mode" and "desktop mode" with most of the under the hood stuff being the same and just UI changes for the task. No doubt this would create new hurdles for software devs but again I'm dreaming here. Windows 10 actually had this with "tablet mode" in the notification center but I think they already soured people on the touch Windows thing by this point. I think Apple could reasonable do it better if they had the will but they'd much rather you buy and iPad for touch and a mac for desktop and everyone who doesn't want an extra device for certain use cases is left out in the rain.
reply
Note on Windows you can disable the touch device and it goes back to the old density. Don't know if Macs support it.
reply
you will accidentally touch the screen more often that you think.
reply
What a super neat application of computer vision. Cool writeup. Thanks for sharing the code and making it open source too!
reply
I was laughing so much. Thank you. Unexpected tech!
reply
As other people mentioned this is obviously not something I would want in my notebook... but I can still appreciate the cool tech!

I can also definitely see this kind of thing being used in things budget outdoor displays, specially if the UI is made to accommodate the lack of accuracy, and the camera is positioned on the side (since these displays are usually vertical).

reply
Difficult to capture reflections across a large screen while also dealing with outdoor lighting, glare, and moisture. The touchscreen part isn't usually what makes outdoor signage expensive compared to IP65, temperature control, and a secure housing, all of which would still need to apply here.

This looks like a neat option for retrofitting, and I suspect it'd work for some non-screen glass applications too. A combined IR/visible light solution would be interesting too, since I suspect those are complimentary (IR touch has issues with radiant light, while this wouldn't; this would have issues with low/no light, while IR wouldn't).

reply
This is amazing. They should start to install upward looking cameras to implement this officially.
reply
Love it! I appreciate the ethos of doing more with existing hardware. Adding an actual touchscreen would add real COGs to a macbook, and many potential failure points. Using the existing camera hardware + software seems to produce a "good enough" result for most people for casual use. I'm sure with some time and eng, Apple could make the "hack" shippable. But it doesn't earn product managers the big big bonuses, so it'll never happen.
reply
The reason we buy macbooks is because they aren't touchscreens.
reply
It feels real because of the dirty touchscreen.
reply
Using an external webcam is that not more than $1? cool project though; reminds me of how you could use a Wii remote to create a interactive whiteboard.
reply
Internal with a small mirror
reply
I think I could do this for less than 15 cents: four small peices of double sided tape, and the tiny mirror, and two hair pins... but the software? Priceless.
reply
Is there a coating you can apply to the glass to help with smudge marks?
reply
Oleophobic coating is standard on phones and tablets, which is part of why they don’t pick up fingerprints as easily.

Some brands offer coating you can DIY yourself (eg ProofTech OLEOPEL) but these seem mostly designed for phone screens. I don’t know whether they’d be as effective on laptop screens

reply
And this is why modern screens (and eyeglasses) should be cleaned with a damp microfiber cloth and no aggressive cleaners. These coatings are fragile.

I do carefully clean the nosepads with soapy water, however.

reply
I wonder how well this would work with my bright blue fingernails that are about .5" longer than my finger.

I then wonder how much recalibration I would have to do when one of them broke and I was poking directly at the screen.

reply
You could still use the keyboard and track pad
reply
You chose to suffer not just with touchscreens. That said, it would probably work just fine.
reply
Brilliant!
reply
Checking this profile of a random hacker in 2018, of course they are now working on AI.
reply
I was working on AI in 2018 too :)

At that time, I was quite interested in adversarial examples and ML security.

reply
[dead]
reply
[dead]
reply
Neeeeveeeer!!! please let macbooks be as they are .. why would I ever choose to put fingers on that beautful screen ... I don't get it!
reply
> why would I ever choose to put fingers on that beautful screen ... I don't get it!

I'm not sure, but bare in mind that the iPad is almost as large of a market as the Mac at this point, and the iPhone has long surpassed Mac revenue. Touching your computer is a very popular sentiment among the grimy-handed public.

reply
There is a reason why the MacBook hasn't been replaced by an iPad with a keyboard and trackpad attached to it. Very different use case.
reply
Still an amazing hack today and I love it. However, I heard Apple are developing a touch screen MacBook this year, and I simply don't get why they're doing that. I don't know what's worse, the ergonomics or the fingerprints.
reply
i used to have a bad touch screen laptop like 7 years ago and back then it made the mobile development more pleasant (both native and web based)
reply
So you mean they're developing the iPad, an insanely popular device, and you're not sure why they would make such a device?
reply
I have been around touch screen Windows laptops for I don’t know how many years now, and I have never felt even the slightest compulsion to touch the screen.
reply
It might be a generational thing; my kids get touchscreen laptops from their school, and they interact with them almost exclusively by touching the screen. I agree, I'd much rather use a mouse (or even better, a trackball; i wish most laptops still had those)
reply