Ask HN: What do you wish digital assistants (Siri, Alexa, etc.) could do?
I mostly use Allo/Google Now but I've spent time playing with Cortana and Siri as well.
Some random things I wish they could do include:
Tell me when the high/low tides will be.
Do things at a later time (tomorrow at 5 message Jack to bring the frisbee)
Of course we'd all like a good API to make our own stuff.
What would you want the assistants to do that would make them more helpful?
71 comments
[ 2.1 ms ] story [ 151 ms ] threadThe compeitors: Cortana accepts both voice and text input. Google Now/Allo does too (although the new Assistant in the Pixel is only voice though). Alexa is only voice.
Get my toaster to talk to my dishwasher! Or my refrigerator to talk to my oven!
Oh wait, those were the stupid selling points for "home automation" that haven't changed in 20 years...
Um... open the pod-bay doors?
Another thing I was working on at Microsoft back in the day was contextual deep voice search mixed with touch. Essentially the UI pattern was tap and hold on an app, then speak. The voice command would be sent directly to the app itself so you could have it be recognized by it. Example: hold your finger on the pictures app and say, "show me Mike". It'd then bring up pictures of Mike.
Maybe I can set them up in a circle and let them babble away to each other?
Completely offline with local processing on the device of choice.
https://experimental-platform.github.io
https://www.indiegogo.com/projects/protonet-zoe-start-your-s...
I'd also like to be able to ask "How many steps have I taken today?" Siri responds with "I can't answer that on your iPhone but you can find it in the Health app: Open the Health app"
This may feel like a big ask considering the majority of the basics aren't covered on the platform I'm using, but compound questions would be wonderful – "show me the thirty largest US cities" "remove any that do not have a moderate climate" "which one has the lowest cost of living?"
If platforms already provide these services and I'm simply using the wrong one – oops.
However, it would be nice if you could tell Siri to play an episode of a show on a specific TV, but I think they would want you to have an Apple TV for every TV in your home, not just one to control all of the TVs.
I've got a bad case of Apple lock in – Apple TV, iPhone, iPad, MacBooks. Saying, to my phone, "Play The Walking Dead on the TV" brings up TWD in the TV app (iOS 10.2, I haven't been paying attention, this is possibly beta track) which prompts me to start watching it... but it then plays on the phone. I can cast it to the TV, but I can't hand it off to the TV.
Maybe that's precisely how most people would expect and want it to work, but it seems unintuitive to me.
"Hey Siri" on the Mac would be good. So would more interaction between devices - so I could set up an alarm on one particular device from any other device.
Cloud things are still clumsy from that POV. A lot more could be integrated.
My biggest (minor) annoyance is not being able to toggle switches.
I can say "Alexa, lights on" and "Alexa, lights off".
But I can't just say "Alexa, lights" and have the app read the current state and flip it - which is annoying because it would be efficient and useful, but also because it's so close, and yet so far, from living in a Star Trek TNG episode.
"Please analyze the traffic from Y and let me know if there's any anomalous traffic regarding ISIS" --anyone
"Please start a server on local port 8080 from my computer and serve all of my birthday pictures from when I was 10 until 20, and then download the files from my phone and save it into a new album called 'Birthday Teens'" --anyone who knows what a server is
"Please transfer the files from my computer in directory X to my phone in a new album with the same name as X" --anyone
"Please send a request to bing for the first 50 pages of cat images, and save the files into Y directory, then open the first image" --anyone
"Please Open up Steam and start up Skyrim" --anyone
"After that, send a message to Henry and ask him if we wants to play again" --anyone
"Please get me a list of all of the processes about mongo" --anyone who knows what a computer is
"Please close the windows or tabs on reddit" --anyone
"Please open up my school portal email" --anyone
Thinking things into existence. That gap is still pretty big. It's easy to think of ideas, but putting them into action is hard. That gap is going to get smaller. At some point, pretty much everyone will be a commander of AI, which will be like a team of programmers working for them. When that happens, we have a reason to be scared.
It is really embarrassing because I really only use her for converting from F to C, asking the weather while I am getting dressed, waking me up and setting cooking alarms.
Basically all of those can be answered with a Google search but it is a nice hands-free, from the kitchen or bed thing.
Also geofencing reminders seem to kill my battery and constantly make the location icon show up.