A lot of the changes just don't make any sense? Some of the features removed:
- Using your voice to send an email, video or audio message. You can still make calls and send text messages
- Rescheduling an event in Google Calendar with your voice. You can still schedule a new event.
- Asking to take certain actions by voice, such as send a payment, make a reservation, or post to social media. You can still ask Assistant to open your installed apps.
- Asking to meditate with Calm. You can still ask for meditation options with media providers such as YouTube.
All of these seem to fall under the umbrella of "features that actually make the assistant an assistant"/connecting the assistant to other apps, which I imagine is exactly the opposite of where the Assistant trend is going, especially with LLMs. Just speaking to a device about which action you want to take and not needing to think which app you need to open and navigate feels like the UX of the future, whatever this is seems like the opposite.
My guess is that a lot of these features are hard-coded, and they are deprecating them in order to replace them with a more generic LLM-based assistant.
Perhaps, but it seems like a strange approach. I would assume they would retain these features and then gradually replace each one with an LLM-based approach.
They are probably statistically some of the lesser used features and since there were layoffs in Assistant ( https://news.ycombinator.com/item?id=38947224 ) they are probably looking to shrink the codebase being maintained.
Assistant has trained our household into thinking that its pretty limited in what it can do so everyone in our home only uses it for basic things. Since Google's assistant can't accomplish more than most basic tasks people don't use more than the basic tasks. No one wants to learn the appropriate subset of English to speak the Google assistant dialect. You really need the voice assistants to be reliable and basic or extremely capable. There is no real middle ground here for most users.
Hopefully once LLMs get more integrated with voice assistants we will move more towards the extremely capable side of the spectrum.
Just because an LLM can better parse what you're saying it does not mean the business logic to act on it exists. The feature discoverability and churn problem will still exist.
This feature already exists for LLM's -- you can provide them with the list of actions that it can do. This is how you integrate with an API. You describe your "turn on the lights" endpoint and so when you say "I need a bit more light" and it knows it can do something about it.
The users of LLM-based products don't know that; its programmers do. And what happens when an integration is added or removed; how is the user supposed to know?
So, a programmer with LLM knowledge will have a startup idea to wrap all of this up in a nice little app. You say "turn on the lights", the app passes that to the LLM.
The LLM, having been pre trained on what to do, calls the API to turn on the lights.
I suspect it's org politics - but yes, in search of money and metrics.
Assistant alienated a lot of other departments from 2016-2020 with their rapid rise and rapid growth in headcount (and ability to push integrations through whether they were a good idea or not). Then they failed to make significant money, right into an economic environment where making money was prioritized much more highly than speculative researchey new markets. These changes are them trying to make themselves indispensable to other PA's metrics, so that when budgets are set, they can argue "You can't cut Assistant, look at the drop in searches & YouTube views that would result in." Same reason why they were hit harder in the layoffs than other more profitable products.
My primary use-case is creating reminders. For this I use (of course), the microphone in the search bar. I guess I'll have to find the next best way. Maybe it will end up being better.
Unless things have changed recently, you can't even do that if you use a workspace account. No explanation of why, it just silently fails.
I'm down to three gestures with assistant:
- play white noise. 50% success rate. Half the time it plays white stripes or some random death metal, which is great when my kids are trying to sleep.
- "ok google, stop". This works reasonably reliably.
- "I wasn't talking to you". For the 3-6 times per day when it activates for seemingly no reason and where no activation logs are ever created.
If I can find a decent internet-attached photo frame to replace it I'm out.
I was really hoping something had forced Google to allow the full disabling of the assistant. I really don't find it useful and accidentally trigger it more often than I care to admit.
Android indeed, or anything that's not Apple nor Amazon nor some other "all your data are belong to us".
I know there are some cool DIY hacker projects out there, maybe I should really get my hands dirty tbh? In that case, does anyone know any good links to things they tried recently? Especially with Whisper.cpp and so on it may not be TOO hard on a Raspberry Pi... right?
Instructions from first search result for "disable google assistant" might work? I found the option buried about 5 menus deep[1], but I left it on since it never triggers for me anyways, probably because I didn't set it up.
[1] Settings -> Google -> Google applications -> Search and assistant -> Google Assistant -> General -> Disable
My phone UI language is not English, the list above are my translations, actual text will likely be different.
Wow that's a big list of surprisingly useful features being ripped out.
I'd already noticed my new phone (pixel 8, I fucking hate it) had trouble setting a simple timer with a voice command ( last time I tried it gave me a shitty youtube video result of a 10 minute timer!?!), but this list of removed features goes further, removing other basic functionality from voice assistance.
If all a voice assistant can do is google my "command" and read me the results, that's a terrible experience. The whole selling point (to me) is the ability to do something magic with what I'm asking.
Taking a guess, based on experiences with using Google Assistant extensively:
What do you do if you have statistics saying that, say, a feature is used by a small fraction of users, and 40% of the activations of the feature were in fact not what the user wants, and instead were misunderstandings of requests for something else?
So ask for clarification. State your interpretation and give an opportunity for the speaker to confirm or clarify. This isn't some new intractible issue, this has always been a fundamental aspect of communication in a natural language.
What do you hate about the Pixel 8? I have one and find it pretty good, although I'm a very casual mobile phone user (USA-based, on Google Fi). I like that it's at least slightly smaller than the Pixel 7.
It's hard to describe what exactly I don't like. Initially I thought it was just a muscle memory thing but I've had it long enough now that I've got used to the different UI for everyday things and try to use it's shortcuts on my old phone.
But overall I don't like it.
I don't like how it handles notifications, it seems to hide most of them, and the ones it does show it doesn't show in a useful way compared to my old phone. What exactly is different I can't say, but it's weird.
It also handles permissions differently. Some apps when I disable certain permissons get stuck in a permission loop because they can't cope with the idea of only having a particular permission denied. I never had this problem with my old phone despite it also having granular permissions. Seems to be related to a change in how notification permissions are handled exactly.
I don't like how I can't quickly change the ringer volume. It used to be a separate slider when I hit the volume on my old phone. Changing now is a gamble and finding how to get it to vibrate mode seems beyond me.
1Password used to allow biometric unlock on my old phone. I can't get that to work on my new phone so have to type the master password (extremely long password) on a mobile device, which makes it useless to me. I'm not going to type my master password on a phone keypad in public, that's asking for it to leak.
The fingerprint sensor is okay, but I preferred the below-screen sensor on my old phone.
It's fiddly to get back to the home screen. On my old phone if I scanned my thumbprint it would go back to home. On the pixel it's a finicky swipe-up-from-the-bottom thing which sometimes goes home and sometimes goes to an app-switcher.
Setting up the phone required giving google rather more permissions than I was comfortable with, but denying them locked out key features of the phone so I felt forced to accept.
The pixel 8 is also slightly smaller than my old phone, though of course I knew that when I bought it. I didn't realise how much 0.1inches was going to feel like a major loss. I didn't want to go over-sized with the pixel 8 pro though.
Overall a downgrade and really horrible experience compared to my old phone, which I only replaced because it was so old and stopped getting regular updates. It was a Huawei P20 pro and in terms of general use still feels just as fast as it did when it was new.
The only feature I like that the pixel 8 has which my old phone doesn't is the wireless charging. That's a game changer when it comes to preventing wires wearing out.
>I don't like how it handles notifications, it seems to hide most of them, and the ones it does show it doesn't show in a useful way compared to my old phone.
If an app's notification is set to "silent", it'll push it below a certain divider line, and some notifications may be hidden while in DND mode, and then revealed when out of DND, which is a disjointed experience and not the best, but _is_ configurable.
>I don't like how I can't quickly change the ringer volume. It used to be a separate slider when I hit the volume on my old phone. Changing now is a gamble and
Yeah, this used to be easier. Now you have to click the ellipsis at the bottom of the volume slider to open up the other volumes, but it's clearly labeled.
>finding how to get it to vibrate mode seems beyond me.
This is simple: it's the phone icon at the top of the volume interface when you change volume.
>1Password used to allow biometric unlock on my old phone.
This seems to work for me on my P8Pro
>It's fiddly to get back to the home screen. On my old phone if I scanned my thumbprint it would go back to home. On the pixel it's a finicky swipe-up-from-the-bottom thing which sometimes goes home and sometimes goes to an app-switcher.
I absolutely hate the gesture navigation but I solved this by sticking with the old school 3-button navigation, which you can change in settings.
Ah, totally fair, I was thinking more about hardware than the OS stuff. On my side, I prefered the rear fingerprint sensor and plastic (lighter, less slippery) on some earlier pixels. Nexus 5 was my favorite, I think I'd be happy with new guts in that phone (although waterproofing is nice).
On the OS side of things, when switching between activities, very rarely my last activity is to the right in the carousel rather than to the left. Because I can't predict when it happens, I can't mindlessly switch to my previous activity, which is surprisingly annoying.
> last time I tried it gave me a shitty youtube video result of a 10 minute timer!?!
A YouTube video has the chance to earn them advertising revenue. A 10-minute timer does not.
However, they are clearly missing an opportunity: "Your 10-minute timer, sponsored by Burger King, has finished. Would you like to order a Whopper to be delivered by Uber Eats?"
Another step in Android's steady progression of become less and less useful hands-free. It's incredible to me that my experience with my Nexus One in 2010 was better than it is today with a Pixel 7. The fact that it arbitrarily decides to not recognize some contacts on some days. The fact that it can't handle me spelling out a street name when it insists on replacing the street name that I'm saying with something completely different. The fact that YouTube Music would always play "some driving music" that it chooses over my playlist literally called "Driving Music", when I would say "Play my Driving Music Playlist on YouTube Music". And now the assistant is getting even less personalized, which means it will care even less about what you're literally saying, and just send you into a swamp of generic assumptions.
Assistants were SO much more usable when they would require strict trigger language, and interpret it literally and formulaically. Yes you would have to learn its language, but once you did, you could actually accomplish what you wanted to accomplish, unlike today.
Yep. It is a pretty useless device if you cannot hold it in your hand and unlock it. So for example, when I ride my bike I can pause the music or receive a call and not much else.
I wonder how many road deaths their declining hands-free quality has contributed to? I'd wager the number has more than two digits. It's one thing to never have supported something hands-free, but when something that you used to be able to regularly do hands-free all of a sudden doesn't work, drivers are bound to get frustrated and use the device hand-held.
Google needs to toss Sundar and get a competent CEO who can forcefully smash the org back into line.
Google has turned into these little micro clusters of ideologies and functional philosophies, leading to a horrifically fragmented mess of google branded products. All which come loaded now with end-of-life anxiety as google just farts out products that seem to dissipate just as fast.
The fact that most google apps function better on iOS than Pixel phones should be enough to get any sane board to take action. This is without even mentioning the disaster that search has become, or completely dropping the ball on LLMs.
I think upper management at big tech thinks having these internal warring factions somehow creates better products. What I hear from friends in FAANG is the VPs and directors don't even know what they're supposed to be working on most of the time.
Mine decided to helpfully alert me that there were three birthdays on January 1st, because it had somehow reset some contacts' birthdays to Jan 1, 1970.
Except when I went to check the Contacts to fix them, they had no birthday at all.
another thing your pixel 7 cannot do: copy Chinese text.
even on apps like google maps. open any place with Chinese chars in the name. toggle the app switcher carousel. try to select the name of the place. only non Chinese text will be copied.
I'm pretty convinced this is because the app switcher can recognize _whether_ a part of an app's UI is a native text field and not just an image, but it's not smart enough to pull the text out. I've seen it make number 0 -> letter O and other such mistakes before, so I'm convinced it's using OCR. Which is probably harder for Chinese.
It's crazy to me that it can't just use the accessibility APIs.
> Asking to take certain actions by voice, such as send a payment, make a reservation, or post to social media. You can still ask Assistant to open your installed apps.
This seems to imply that apps which feature 'app actions' would no longer work properly and will need to be opened via assistant separately...
Sounds like a major regression for those scenarios with needing to issue a separate command to open an app.
To me the problem isn't lack of language understanding - it's more lack of integration with useful actions, although LLM support would certainly help with feature discovery and flexible invocation of actions.
Presumably Google Assistant is on it's way to being replaced by ChatGPT with plugins, although these would need access to phone APIs to do local stuff.
It says you can only add new events now and not reschedule...does that mean when Assistant gets the info wrong for the event I'll have to go in and manually change it? It screws up constantly, so it sounds like a headache
I'm quite torn on this (to be fair, I rarely use voice commands at all...I've found it's usually more effort to fix things when it gets it wrong than the cumulative sum of all the times it may save me any time whatsoever).
1. I can see how this is absolutely frustrating for someone who uses one of these commands regularly.
2. At the same time, one of the issues with voice commands relative to say keyboard input is the lack of delineation. If I hit Ctrl + Enter on my keyboard, there's no way for the computer to interpret that any differently. However, that's not the case with voice commands. It needs to keep determining (a) what I said, (b) whether it's a command or just voice, (c) whether it's a command it's supposed to execute and that's before it even figures out waht to execute. But the problem is that as the number of voice commands increases, the number of false "this is a command and not just voice" triggers will increase.
There's probably a genuine benefit for Google's users in the universe of commands being very small as long as the command that's removed is not one they use.
I've noticed several of the options are "you can use a custom routine to do this instead". Maybe Google should have included the custom routine and made it togglable.
To me this highlights the core failure with all these voice-driven UIs: you have absolutely no idea what is possible and what isn't. Discoverability is zero, which makes big changes like this even more disruptive.
I've already decided that I'm done with Google's smart assistant stuff in any case. I have a Google Home with a screen in my kitchen and the most-used feature (aside from just existing as a photo frame) was an integration with a really useful shopping list app called AnyList. It certainly wasn't complex, we'd say "Hey Google, add <x> to the shopping list" and it would do it. But it was very useful: I'd have something in my hands I just pulled from the fridge (e.g. milk) and be able to add it to the list without interrupting what I'm doing. If it had to wait until I was done for me to pull out my phone I'd inevitably forget.
Then one day Google decided to disable that integration. Now the only shopping list you can add to is one Google provides (which naturally has way fewer features than AnyList). They've never provided even the remotest defense for why they've removed it, it's very obviously to lock us into the Google ecosystem. So our Google Home is now a glorified photo frame that plays music from time to time (and even then prioritizes cover versions and YouTube videos over actual songs, presumably because $$$)
The removal of the AnyList integration drove us to get an Alexa assistant device in the kitchen. It still works there
Never thought amazon would have the better assistant ecosystem. Google already has my email and calendar and other stuff, Amazon I have to auth into them like a third party. But it's become true
I've been meaning to get around to trying an Apple HomePod Mini, the AnyList integration on my iPhone works okay (thought as an infuriating two-step process, "Hey Siri, add to shopping list" ... "milk") so hopefully it would be replicable on the pod, too. Seems like the least worst option.
I've been playing with homeassistant voice integration and it's pretty darn good
There are some gpt and llama experiments you can run there, but it's finally getting to the point where a local assistant you host yourself might be viable soon
Getting audio into it and having a little speaker so it can talk back is both the easiest and the hardest part. I need to play around more with some esp32s and microphone modules
On top of what you mentioned in your first sentence, any ideas to improve discoverability are horrible. I hate it when Alexa does not play my podcast right away but explains to me how I can change episodes. I despise Alexa for telling me that I have some notification before starting my timer. And so on - any voice only attempt to explain me something without me asking for it means adding a lot of friction between me and my goal.
Seriously though. The development of every company to just trash faq's or an "assistant" or third party forums is awful. Trying to get help with technology is almost always infuriating now.
I recently had to contact windows help, and they were useless. The windows forum points to a third party software that I am convinced is malware.
And while I'm ranting, why can't the download folders in windows be set to group by "none" and sort by "name" by default? Why are both "most recently edited" by default? AND WHY CAN'T I CHANGE IT MICROSOFT?
Maybe WinSetView [0] and the options [1] it provides might be of use to you? It was able to resolve the issues I was facing so hopefully it can work for you as well.
Spot on! Lot of voice assistants have been following "if we could" line instead of "if we should line". For many straightforward applications, clicking through well defined interface can be the least error prone way to get the job done.
I'm an Android user and have never owned an iPhone, but that sounds to me like you're talking about a push notification setting that is completely separate from an Alexa response setting. I could be wrong, but my guess is that that's why you're getting downvoted.
Thanks for posting that possible misinterpretation :)
Everything in my post was Alexa-specific. Someone who has the stated problem can follow that precise and non-obvious menu tree within the Alexa app, and it will solve their problem. It's a device-specific setting, so can be done on the kitchen Alexa without affecting other units.
Both "notification" [1] and "Do Not Disturb" [2] in my post were Alexa-specific terms that are unrelated to their mobile phone brethren.
I'm not dying for them to record more than absolutely necessary, but I really hope all the voice ui engineers do log curses to know when their app is doing annoying stuff. The number of times these things screw up I definitely get really spicy and hope that feedback makes it back.
Luckily the Google Assistant is basically worthless.
Setting a timer and have it remind you that you could have set an alarm instead is annoying, but there have been multiple examples where we set a timer and the Google home mini seems to forget it.
> okay Google, set a timer for 1 hour
>> Certainly, and did you know that I can also look up Wikipedia entries for you.
>> Timer for 1 hour has been set and is starting now
> okay Google, how much longer left on timer
>> You don't appear to have any timers set at this time.
I'm pretty sure that our robot overlords will either forget, get distracted with generating mis-information, or become artists painting portraits of furries.
I remember (maybe its still like this!) there used to be a page you could go to and see all your alexa voice clips since forever. It's amazing amazon has gone so long not caring about privacy without backlash.
Yes... when it does anything other than what I ask, it makes me feel like it's wasting my time.
Alexa recently started responding with "Good afternoon! <the normal response>" and it irks me more than it probably should. I've looked to see if I can turn it off and can't find the option.
Can you instruct it to "stop the greetings - go straight to the response"? Doesn't Alexa (yet) have some LLM behind it that will create a profile just for you?
As a Brit, when I bark "Alexa, set a timer for 5 minutes" and Alexa prefixes her reply with "Good evening <pause>", TO ME that sounds like a bitter correction-by-example to my abruptness. It's the sarcastic opposite of a pleasantry.
The constant "By the way..." from Alexa drove me nuts.
If you say "Alexa, stop by the way", it'll get the device to stop responding with follow-ups for ~24h. I ended up creating a routine that runs every night at 4am to lower the volume to zero, automatically say "stop by the way" to the device, and then raise the volume a minute later, and Alexa has stopped with the follow ups
I just discovered this today, but if you whisper to your Echo, it will skip all of the "by the way" BS (it will also reply in a whisper, which is kind of creepy, but you win some, you lose some).
In other words, they have just closed down that entire ecosystem. I don't think there's an antitrust angle here: Forcing e.g. Apple to allow third-party apps or app stores seems within reach (at least in the EU); this would be more like forcing Apple to enable apps in a world where they don't even exist (anymore).
"If there is no banner, your Actions project is not a Conversational Action and won’t be affected."
Here, "conversational" means your voice command should prompt the app to ask you a question, driving a state machine. (Set a reminder. When do you want to be reminded?)
I haven't tried to use it, but the docs indicate CRUD-over-voice ("built-in intents") is unaffected.
Quite the opposite. I bike the kids to school every morning. The weather is too important to be summed up by a voice summary, I need the hour by hour details.
I still have a Google Home in the kitchen, but what I really want it to display is data from my weather station, transit info, the time, etc. I can't control that damn thing at all. I've got a TidByt coming today, which I have high hopes for!
I haven't used it myself, but Home Assistant can cast to a Google Home Hub, so afaiu, you can set up a whole dashboard of widgets and controls and use it from a stock Home Hub.
Nice! What I really want, though, is a local API! I can use a starlark script to grab entity states from my local Home Assistant super easy... but then I have to cUrl them up to a Tidbyt server somewhere, only to have it sent right back into my house. Seems kinda silly, and will break anytime my internet goes out.
Are you referring to casting a URL to open a browser on the home hub? I tried that in the past but it was kinda janky. It's definitely possible with something like https://demille.github.io/url-cast-receiver/ though
It's not just voice, but conversational interfaces in general that have this discoverability problem. That means chatGPT. I'm glad people are discovering it, if you excuse the pun. CUIs are not a panacea, not a replacement for conventional UIs.
I think there's a line worth drawing here: Pre-LLM voice interfaces required you to guess the command(s) the designer of the thinking were having in mind for the action you want to perform. With LLMs you can be 10ft into human-level vaguery and metaphorism and your intent might still survive.
So the difference wrt discovery is that you only have to gesture at what you wanna do and, if a matching action exists, there is a chance it will be understood.
I'd wager we'll see a renaissance of voice assistants with LLMs, especially once the good-enough ones can run on device.
When you put it that way I am reminded of my youthful efforts at solving puzzles in Sierra Online text adventures by guessing the right prompt. I guess I got early training for successfully interacting with LLMs :)
it reminds me of all the old text games like Zorg or whatever where they gave you a cursor leaving you to figure out what you could ask/say/do. which is fine for a game. it sux for a "tool"
There are obviously cases where CUIs work well: while driving if you don’t have a physical button to do the thing you want, the CUI is better than a screen UI, and if it’s a complex thing, you would never have a physical button for it anyways. In the home when you want to control devices in the morning “open all the shades” or “open the north shades”, unlock the door and start the car, etc…
Not really conversations though, more like accessible commands. I don’t think we get conversations until the tech improves and the latency goes way down, meaning on device processing of speech at the very least.
I’ve had exceptionally bad experiences with car CUIs - all the problems of trying to figure out exactly how to tell Alexa what to do (and then figure out what Alexa actually _did_) while going 70mph in traffic. Just give me physical buttons.
Funny fact is that this is core use case I use siri to add things to the reminders app which I have a smart list called "shopping list." It's amazing how great this is, and how many times I use this.
This and music control are the uniques cases where Siri Just Works for me. “Add toothpaste to my shopping list” no fluff no nonsense replies, just “I added that to the shopping list” - and it’s on my phone’s Reminders in that list.
I wonder how well they’ve optimised Siri for a just few specific use cases like this, because nothing else seems to reliably work on it.
Today for the first time I asked Siri for the weather forecast for next week and it actually replied in a sensible way.
Until now I have only been saying simple commands like "countdown n minutes" or "call my favorite wife" (I only have one but thankfully she is also my favorite.)
I second this. My two other derived commands I use every day are “remind in 2 hours to do X” or “remind me Friday at 7 to take Y”. This and “timer X minutes”.
I would be very sad if these were to disappear or to stop working as well as it does now (I like that if I say “remind me tomorrow” when it’s right past midnight it asks for confirmation that I actually mean the same day since it’s “already tomorrow”)
My Google Home - Lenovo Smart Clock just says "I'll remind you today at $TIME".
The device is out of support, it has its glitches (e.g. it's still able to play and pause podcasts, but after pausing it would say "Sorry. something's gone wrong", if asking it to snooze an alarm it would say "OK, alright" and then "snoozing for 10 minutes"), looking forward (not!) to Google making a breaking change and it being e-waste soon.
Hah, in the imaginary future where we have cyborg assistants instead of climate destruction, my robot butler will pour half a cup of tea, go back to the kitchen, and then return to pour the second half of the cup, and I'll tell my guest, "Yeah, it's a 5 year old model, the startup that made him went bust so I'm using a firmware from a Ukranian forum... Джевс, можна мені трохи цукру?"
I think this kind of highlights the ios vs android user mentality. afavour is annoyed that google is trying to lock them into only using google's shopping list while you love when apple "just works" within their ecosystem.
As an iOS user and dev, I’ve been reading these comments confusedly.
Apple has exposed Siri to us as developers in several ways, one of which is called “Siri intents.”
The long and short of it is that app developers can hook into the Siri system so users can use Siri commands to control certain parts of third-party apps.
This means that users aren’t locked into using, say, Apple’s own Reminders app, and they can tell Siri to add things to third-party to-do list apps.
Users also have the option to create their own workflow via Shortcuts and give it a command phrase that Siri then responds to.
I assumed something similar was available on Android, but the responses indicate that this might not be the case.
This problem can be solved pretty soon though; given a good enough LLM, and perhaps for power users a configurable set of integrations, you should be able to make any language request, translate it into verbs, and ask for an explanation if you get confusing results. With in-context learning perhaps you can even get to the holy grail of “when I ask for X, please always apply interpretation Y” for personalization.
I think the broader context here is that Google is downsizing the current Assistant team in preparation for an LLM-based replacement, perhaps once Gemini has rolled out.
Yeah, beware “no true Scotsman” here. But I think it’s a reasonable hypothesis that GPT-4 is “good enough” or close to it, and when the current assistant services get wired up to LLMs we’ll see a step function in their utility. Apple and Google are both definitely working on this. OpenAI’s voice mode is closer capability-wise, but doesn’t have the integrations; that would be an obvious product for them to do this year.
If this doesn’t seem obvious in 1yr I’d say the hypothesis is likely wrong.
Sounds to me like a silver bullet idea. "LLMs will make it good".
I don't think voice is a good interface. "It chats like a human" is the lowest possible hanging fruit in terms of product design, and bets everything on the smarts of the tech that's behind it.
We are so used to tooling faster than voice. Keyboards and taps are very, very fast. I want digital assistants as smart AND as fast as that, not something smart but incredibly slow to interact with because it needs to dumb itself down to human speech I/O.
To me, this is also not about modality or making it more generic. I just don't want an anthropomorphized smart-ass assistant. I want smart tools that actually assist me directly, no chat.
Agreed. I find it utterly exhausting to talk to most humans, at least when my goal is purely transactional or functional. Human conversation takes work. Let's save it for what matters.
People hate call centers. I don't want to have a conversation with some human or human-parity AI at my airline, I want to change my flight in 3 clicks. In retail and fast food, self-checkout and online or kiosk ordering is popular for a reason.
I've found myself feeling those same feelings when being forced to have conversations with a chatbot. Chatting with ChatGPT just for fun can be fun, but it can be just as painful as a call center if you need to get something specific done. In order to cancel a hotel reservation, I was having to chat with some bot. It made it into a whole conversation, with brief pauses. It should have been 3 clicks.
I don’t think I’m naively expecting LLMs to magically fix things. The reason voice is currently a bad interface is that the agents are dumb, mapping verbs to hand-coded action trees. The missing pieces are first intelligence and second long-term adaptability/personalization.
I think it's hilarious that you can't reliably ask Assistant "what is this song?" any more but they've provided a dedicated button for what should be an easy query to process.
Vim has an actual manual and things stay relatively stable across releases. It's not the case for the voice assistants, where stuff breaks randomly and features are added/removed without notification.
VIM is well designed and stable, so you can learn the interface and be confident that it will work for you next time you use it. It's an amazing tool.
Today's voice assistants are the opposite. They are unreliable and completely unstable. They don't have a clear list of commands they understand, let alone some sort of menu system - the documented commands on the manufacturer's websites often don't work. They also randomly change what they can do: stuff stops working for no obviously reason.
For example - yesterday, my son's Nest Audio suddenly refused to set a music alarm, claiming "this device doesn't support that feature yet" (it's literally a speaker for music...). It worked the day before.
Yikes. About the discoverability issue. I can add a little story.
I can not for the love of my life get Siri to resume play in my native tongue. It is supported by Siri, I just have no clue on earth on what phrases she accepts. Tried many, started feeling dumb. Turned off Siri.
The kids used to love our Google mini speaker. There were voice activated games, normal stories, choose your own adventure style stories and a fun little “animal of the day” feature.
Every single one of those things have been deprecated and removed for… reasons?
All we can do with the speaker now is ask it to play music, get the weather, or set a timer.
> "Hey Google, add <x> to the shopping list"... was very useful... Then one day Google decided to disable that integration. Now the only shopping list you can add to is one Google provides
If I recall correctly, "add to my list" originally went to shoppinglist.google.com. They rolled it into Keep[1] ("note to self," tags, sharing).
It works well. However...
In 2016, I figured "tell me showtimes for $MOVIE in $CITY" should work. It still doesn't work. It may never work, because "robot butler with ads" is no one's idea of the future. (Maybe Jeff.)
A fire-and-forget voice action like "add to list" should still work(?). For conversations[2], we can pray Gemini is less infuriating.
Did you actually try your cinema prompt recently? I just asked my pixel phone "tell me showtimes for aquaman in Berlin" and it immediately opened an overview of cinemas with showtimes for the Aquaman movie today with options to buy the ticket.
Same for the weather prompt someone else posted above and contrary to their experience it showed me exactly what I expected.
I'm a bit confused if those examples are something that didn't work in the past or if it's something that somehow doesn't work properly in the US right now.
Who in their right mind would bring this kind of intrusive technology into their home, right into their most intimate space? I seriously don't get it. I mean what's wrong with keeping a pen & paper shopping list on your fridge?
I’m not denying that personal conversations happen in the kitchen. But the most intimate space? That’s pure hyperbole.
Not to mention I think the paranoia about these home assistant devices is overblown. Do you use a smartphone? In your intimate kitchen?? It has just as much capability to listen to you.
We have a saying that loosely translates to “If the barn burns down, so does the house”. The meaning is that it’s not really wise to let the house burn down if the barn is burning.
You’re making an argument of false equivalency. Anyone who has used Siri can tell you that its listening capabilities are vastly overstated. There is a reason they make smart speakers and don’t just leverage your phone, despite the fact that almost everyone with a smart speaker has both.
Anything inside my house is the intimate space. I block the “smart” devices on the router firewall level so that they cannot call home - and here in this thread dozens of people use those spying devices that listens to you and to your family members and send this information to who knows where - this is just mind boggling to me. To each their own for sure, but using “smart home” devices made by corporations is absolute insanity in my head.
> I'd have something in my hands I just pulled from the fridge (e.g. milk) and be able to add it to the list without interrupting what I'm doing.
Non user-hostile technology would happily solve this problem: you pull from the fridge what is about to finish or before throwing the empty container into the trash, put it in front of a mini camera mounted on the fridge, image (possibly also barcode) recognition would identify the product, then you say a magic word and it would be added it to your list directly on the phone, then software would calculate the best path to the shops having in stock the products in the list.
Sadly, this would be hijacked by businesses in no time by making it dependent from some cloud services then selling your data to other advertisers or by pestering you with offers of similar competing products.
As of today, I still prefer a pen and a piece of paper over any type of automation.
I had the same issue with the Google Assistant/AnyList integration, and I hacked together a pair of Lambda functions to move Keep list items to an AnyList list.
Both unofficial APIs ;)
A big portion of the limited discovery of available commands is deliberate so as not to limit what you might ask it to do, which can be used as input for future capabilities.
List of items being removed... instead of being nested under the announcement
* Playing and controlling audiobooks on Google Play Books with your voice. You can still cast audiobooks from your mobile device.
* Setting or using media alarms, music alarms, or radio alarms on Google Assistant enabled devices. You can create a custom Routine that has similar behavior or use a standard alarm.
* Accessing or managing your cookbook, transfering recipes from device to device, playing an instructional recipe video, or showing step-by-step recipes. You can use Google Assistant to search for recipes across the web and YouTube.
* Managing a stopwatch on Smart Displays and Speakers. You can still set timers and alarms.
* Using your voice to call a device or broadcast a message to your Google Family Group. You can still broadcast to devices in your home.
* Using your voice to send an email, video or audio message. You can still make calls and send text messages.
* Rescheduling an event in Google Calendar with your voice. You can still schedule a new event.
* Using App Launcher in Google Assistant driving mode on Google Maps to read and send messages, make calls, and control media. You can still use voice control on Google Maps the same way.
* Asking to schedule or hear previously scheduled Family Bell announcements. You can create a custom Routine that has similar behavior.
* Asking to meditate with Calm. You can still ask for meditation options with media providers such as YouTube.
* Voice control for activities will no longer be available on Fitbit Sense and Versa 3 devices. You'll need to use the buttons on your device to start, stop, pause, and resume activities. You can still voice control activities on Pixel Watches.
* Viewing your sleep summaries will only be available on Google Smart Displays. You can still ask for sleep details by voice on third-party smart clocks.
* Calls made from speakers and Smart Displays will not show up with a caller ID unless you’re using Duo.
* Viewing the ambient “Commute to Work” time estimates on Smart Displays. You can still ask for commute times and get directions by voice.
* Checking personal travel itineraries by voice. You can still ask for flight status.
* Asking for information about your contacts. You can still make calls to your contacts.
* Asking to take certain actions by voice, such as send a payment, make a reservation, or post to social media. You can still ask Assistant to open your installed apps.
I read the title of this and thought - yes - at last - Google are going to be integrating LLM capabilities with Google Assistant to make it really really useful instead of occasionally useful with a side helping of frustration at how little it understands.
Instead this seems to be a list of useful features that are being taken away!
I'm disappointed. Google employ some of the best AI/ML engineers in the world and they are making assistant worse rather than making it a showcase for what LLMs can do.
The problem is that the current crop of google assistant devices (excluding current and upcoming gen cell phones) are woefully underpowered for local models, meaning that supporting the existing install base will be expensive.
I expect that a new assistant like product (Google Bard Home or something) will be announced and existing Assistant/Home devices will be deprecated.
So perhaps it's a good day to call for contributors to add more actions to https://github.com/Stypox/dicio-android ? If Google wants to remove features, they can be replaced by something that doesn't have that problem.
300 comments
[ 3.1 ms ] story [ 406 ms ] thread- Using your voice to send an email, video or audio message. You can still make calls and send text messages - Rescheduling an event in Google Calendar with your voice. You can still schedule a new event. - Asking to take certain actions by voice, such as send a payment, make a reservation, or post to social media. You can still ask Assistant to open your installed apps. - Asking to meditate with Calm. You can still ask for meditation options with media providers such as YouTube.
All of these seem to fall under the umbrella of "features that actually make the assistant an assistant"/connecting the assistant to other apps, which I imagine is exactly the opposite of where the Assistant trend is going, especially with LLMs. Just speaking to a device about which action you want to take and not needing to think which app you need to open and navigate feels like the UX of the future, whatever this is seems like the opposite.
Assistant has trained our household into thinking that its pretty limited in what it can do so everyone in our home only uses it for basic things. Since Google's assistant can't accomplish more than most basic tasks people don't use more than the basic tasks. No one wants to learn the appropriate subset of English to speak the Google assistant dialect. You really need the voice assistants to be reliable and basic or extremely capable. There is no real middle ground here for most users.
Hopefully once LLMs get more integrated with voice assistants we will move more towards the extremely capable side of the spectrum.
The LLM, having been pre trained on what to do, calls the API to turn on the lights.
Its a shame, its been a LONG time since Google surprised and delighted me like they did many times during the 00s.
No longer displaying commute time to work, but you can check it on maps? So, they're removing the assistant part into a search box.
Assistant alienated a lot of other departments from 2016-2020 with their rapid rise and rapid growth in headcount (and ability to push integrations through whether they were a good idea or not). Then they failed to make significant money, right into an economic environment where making money was prioritized much more highly than speculative researchey new markets. These changes are them trying to make themselves indispensable to other PA's metrics, so that when budgets are set, they can argue "You can't cut Assistant, look at the drop in searches & YouTube views that would result in." Same reason why they were hit harder in the layoffs than other more profitable products.
who the hell is using Duo
Even Google product teams can't keep track of Google product changes. This one happened a year ago!?
As always: "Bug fixes and performance improvements". /s
My primary use-case is creating reminders. For this I use (of course), the microphone in the search bar. I guess I'll have to find the next best way. Maybe it will end up being better.
I'm down to three gestures with assistant:
- play white noise. 50% success rate. Half the time it plays white stripes or some random death metal, which is great when my kids are trying to sleep.
- "ok google, stop". This works reasonably reliably.
- "I wasn't talking to you". For the 3-6 times per day when it activates for seemingly no reason and where no activation logs are ever created.
If I can find a decent internet-attached photo frame to replace it I'm out.
Make it truly useful or get out of my way.
It's good enough for cooking, which is the only time I care about not touching my phone.
I know there are some cool DIY hacker projects out there, maybe I should really get my hands dirty tbh? In that case, does anyone know any good links to things they tried recently? Especially with Whisper.cpp and so on it may not be TOO hard on a Raspberry Pi... right?
Instructions from first search result for "disable google assistant" might work? I found the option buried about 5 menus deep[1], but I left it on since it never triggers for me anyways, probably because I didn't set it up.
[1] Settings -> Google -> Google applications -> Search and assistant -> Google Assistant -> General -> Disable
My phone UI language is not English, the list above are my translations, actual text will likely be different.
https://www.howtogeek.com/741457/how-to-disable-the-google-a... worked for me
I'd already noticed my new phone (pixel 8, I fucking hate it) had trouble setting a simple timer with a voice command ( last time I tried it gave me a shitty youtube video result of a 10 minute timer!?!), but this list of removed features goes further, removing other basic functionality from voice assistance.
If all a voice assistant can do is google my "command" and read me the results, that's a terrible experience. The whole selling point (to me) is the ability to do something magic with what I'm asking.
How much does this cost to maintain? A stopwatch? They’re axing a STOPWATCH?!
This is embarrassing.
What do you do if you have statistics saying that, say, a feature is used by a small fraction of users, and 40% of the activations of the feature were in fact not what the user wants, and instead were misunderstandings of requests for something else?
Ambiguity is a massive problem.
But overall I don't like it.
I don't like how it handles notifications, it seems to hide most of them, and the ones it does show it doesn't show in a useful way compared to my old phone. What exactly is different I can't say, but it's weird.
It also handles permissions differently. Some apps when I disable certain permissons get stuck in a permission loop because they can't cope with the idea of only having a particular permission denied. I never had this problem with my old phone despite it also having granular permissions. Seems to be related to a change in how notification permissions are handled exactly.
I don't like how I can't quickly change the ringer volume. It used to be a separate slider when I hit the volume on my old phone. Changing now is a gamble and finding how to get it to vibrate mode seems beyond me.
1Password used to allow biometric unlock on my old phone. I can't get that to work on my new phone so have to type the master password (extremely long password) on a mobile device, which makes it useless to me. I'm not going to type my master password on a phone keypad in public, that's asking for it to leak.
The fingerprint sensor is okay, but I preferred the below-screen sensor on my old phone.
It's fiddly to get back to the home screen. On my old phone if I scanned my thumbprint it would go back to home. On the pixel it's a finicky swipe-up-from-the-bottom thing which sometimes goes home and sometimes goes to an app-switcher.
Setting up the phone required giving google rather more permissions than I was comfortable with, but denying them locked out key features of the phone so I felt forced to accept.
The pixel 8 is also slightly smaller than my old phone, though of course I knew that when I bought it. I didn't realise how much 0.1inches was going to feel like a major loss. I didn't want to go over-sized with the pixel 8 pro though.
Overall a downgrade and really horrible experience compared to my old phone, which I only replaced because it was so old and stopped getting regular updates. It was a Huawei P20 pro and in terms of general use still feels just as fast as it did when it was new.
The only feature I like that the pixel 8 has which my old phone doesn't is the wireless charging. That's a game changer when it comes to preventing wires wearing out.
If an app's notification is set to "silent", it'll push it below a certain divider line, and some notifications may be hidden while in DND mode, and then revealed when out of DND, which is a disjointed experience and not the best, but _is_ configurable.
>I don't like how I can't quickly change the ringer volume. It used to be a separate slider when I hit the volume on my old phone. Changing now is a gamble and
Yeah, this used to be easier. Now you have to click the ellipsis at the bottom of the volume slider to open up the other volumes, but it's clearly labeled.
>finding how to get it to vibrate mode seems beyond me.
This is simple: it's the phone icon at the top of the volume interface when you change volume.
>1Password used to allow biometric unlock on my old phone.
This seems to work for me on my P8Pro
>It's fiddly to get back to the home screen. On my old phone if I scanned my thumbprint it would go back to home. On the pixel it's a finicky swipe-up-from-the-bottom thing which sometimes goes home and sometimes goes to an app-switcher.
I absolutely hate the gesture navigation but I solved this by sticking with the old school 3-button navigation, which you can change in settings.
On the OS side of things, when switching between activities, very rarely my last activity is to the right in the carousel rather than to the left. Because I can't predict when it happens, I can't mindlessly switch to my previous activity, which is surprisingly annoying.
A YouTube video has the chance to earn them advertising revenue. A 10-minute timer does not.
However, they are clearly missing an opportunity: "Your 10-minute timer, sponsored by Burger King, has finished. Would you like to order a Whopper to be delivered by Uber Eats?"
Assistants were SO much more usable when they would require strict trigger language, and interpret it literally and formulaically. Yes you would have to learn its language, but once you did, you could actually accomplish what you wanted to accomplish, unlike today.
Google has turned into these little micro clusters of ideologies and functional philosophies, leading to a horrifically fragmented mess of google branded products. All which come loaded now with end-of-life anxiety as google just farts out products that seem to dissipate just as fast.
The fact that most google apps function better on iOS than Pixel phones should be enough to get any sane board to take action. This is without even mentioning the disaster that search has become, or completely dropping the ball on LLMs.
Every large software org eventually becomes Microsoft.
Except when I went to check the Contacts to fix them, they had no birthday at all.
Death by a thousand cuts.
even on apps like google maps. open any place with Chinese chars in the name. toggle the app switcher carousel. try to select the name of the place. only non Chinese text will be copied.
It's crazy to me that it can't just use the accessibility APIs.
This seems to imply that apps which feature 'app actions' would no longer work properly and will need to be opened via assistant separately...
Sounds like a major regression for those scenarios with needing to issue a separate command to open an app.
Presumably Google Assistant is on it's way to being replaced by ChatGPT with plugins, although these would need access to phone APIs to do local stuff.
1. I can see how this is absolutely frustrating for someone who uses one of these commands regularly.
2. At the same time, one of the issues with voice commands relative to say keyboard input is the lack of delineation. If I hit Ctrl + Enter on my keyboard, there's no way for the computer to interpret that any differently. However, that's not the case with voice commands. It needs to keep determining (a) what I said, (b) whether it's a command or just voice, (c) whether it's a command it's supposed to execute and that's before it even figures out waht to execute. But the problem is that as the number of voice commands increases, the number of false "this is a command and not just voice" triggers will increase.
There's probably a genuine benefit for Google's users in the universe of commands being very small as long as the command that's removed is not one they use.
I've noticed several of the options are "you can use a custom routine to do this instead". Maybe Google should have included the custom routine and made it togglable.
I've already decided that I'm done with Google's smart assistant stuff in any case. I have a Google Home with a screen in my kitchen and the most-used feature (aside from just existing as a photo frame) was an integration with a really useful shopping list app called AnyList. It certainly wasn't complex, we'd say "Hey Google, add <x> to the shopping list" and it would do it. But it was very useful: I'd have something in my hands I just pulled from the fridge (e.g. milk) and be able to add it to the list without interrupting what I'm doing. If it had to wait until I was done for me to pull out my phone I'd inevitably forget.
Then one day Google decided to disable that integration. Now the only shopping list you can add to is one Google provides (which naturally has way fewer features than AnyList). They've never provided even the remotest defense for why they've removed it, it's very obviously to lock us into the Google ecosystem. So our Google Home is now a glorified photo frame that plays music from time to time (and even then prioritizes cover versions and YouTube videos over actual songs, presumably because $$$)
Never thought amazon would have the better assistant ecosystem. Google already has my email and calendar and other stuff, Amazon I have to auth into them like a third party. But it's become true
There are some gpt and llama experiments you can run there, but it's finally getting to the point where a local assistant you host yourself might be viable soon
Getting audio into it and having a little speaker so it can talk back is both the easiest and the hardest part. I need to play around more with some esp32s and microphone modules
Boom, done. Synced with my wife too. This is using the Apple Reminders though, as it seems to have less friction than third party apps…
There is no command ontology anymore. Consequently, discovering commands in-app is UX anathema.
"Use the internet, buddy. One of our customers probably documented how-to somewhere on it."
I recently had to contact windows help, and they were useless. The windows forum points to a third party software that I am convinced is malware.
And while I'm ranting, why can't the download folders in windows be set to group by "none" and sort by "name" by default? Why are both "most recently edited" by default? AND WHY CAN'T I CHANGE IT MICROSOFT?
[0]: https://github.com/LesFerch/WinSetView
[1]: https://github.com/LesFerch/WinSetView/blob/main/README-more...
Everything in my post was Alexa-specific. Someone who has the stated problem can follow that precise and non-obvious menu tree within the Alexa app, and it will solve their problem. It's a device-specific setting, so can be done on the kitchen Alexa without affecting other units.
Both "notification" [1] and "Do Not Disturb" [2] in my post were Alexa-specific terms that are unrelated to their mobile phone brethren.
> okay Google set a timer for 15 mins
Certainly, and did you know I can also set an alarm for 6 am in the kitchen?
> Fuck off Google
Setting a timer and have it remind you that you could have set an alarm instead is annoying, but there have been multiple examples where we set a timer and the Google home mini seems to forget it.
> okay Google, set a timer for 1 hour
>> Certainly, and did you know that I can also look up Wikipedia entries for you.
>> Timer for 1 hour has been set and is starting now
> okay Google, how much longer left on timer
>> You don't appear to have any timers set at this time.
I'm pretty sure that our robot overlords will either forget, get distracted with generating mis-information, or become artists painting portraits of furries.
EDIT: Yep its still there! https://www.amazon.com/gp/help/customer/display.html?nodeId=...
Alexa recently started responding with "Good afternoon! <the normal response>" and it irks me more than it probably should. I've looked to see if I can turn it off and can't find the option.
I don't need pleasantries from a machine.
notice how young kids associate ok google with a way to install games and reach their YouTube videos.
all those feature are for that end. you're not the target market. Good night!
If you say "Alexa, stop by the way", it'll get the device to stop responding with follow-ups for ~24h. I ended up creating a routine that runs every night at 4am to lower the volume to zero, automatically say "stop by the way" to the device, and then raise the volume a minute later, and Alexa has stopped with the follow ups
In other words, they have just closed down that entire ecosystem. I don't think there's an antitrust angle here: Forcing e.g. Apple to allow third-party apps or app stores seems within reach (at least in the EU); this would be more like forcing Apple to enable apps in a world where they don't even exist (anymore).
Here, "conversational" means your voice command should prompt the app to ask you a question, driving a state machine. (Set a reminder. When do you want to be reminded?)
I haven't tried to use it, but the docs indicate CRUD-over-voice ("built-in intents") is unaffected.
https://developers.google.com/assistant/ca-sunset#what_will_...
https://developer.android.com/reference/app-actions/built-in...
“What’s the weather @ time” is inadequate. I live in California(albeit not on the coast or in the valley).
The temperature in Nyagen, Russia is current -31 degrees...
I'm an American but I've been to Nijmegen so I think my pronunciation was ok.
Completely opens up these displays to be a virtually unrestricted canvas for doing or displaying anything you want.
That said, we are building a Home Assistant integration at Tidbyt as well.
https://github.com/pkulak/tidbyt
It ended up working great!
So the difference wrt discovery is that you only have to gesture at what you wanna do and, if a matching action exists, there is a chance it will be understood.
I'd wager we'll see a renaissance of voice assistants with LLMs, especially once the good-enough ones can run on device.
Ow, right in the AARP flyer.
Not really conversations though, more like accessible commands. I don’t think we get conversations until the tech improves and the latency goes way down, meaning on device processing of speech at the very least.
I wonder how well they’ve optimised Siri for a just few specific use cases like this, because nothing else seems to reliably work on it.
Until now I have only been saying simple commands like "countdown n minutes" or "call my favorite wife" (I only have one but thankfully she is also my favorite.)
I would be very sad if these were to disappear or to stop working as well as it does now (I like that if I say “remind me tomorrow” when it’s right past midnight it asks for confirmation that I actually mean the same day since it’s “already tomorrow”)
The device is out of support, it has its glitches (e.g. it's still able to play and pause podcasts, but after pausing it would say "Sorry. something's gone wrong", if asking it to snooze an alarm it would say "OK, alright" and then "snoozing for 10 minutes"), looking forward (not!) to Google making a breaking change and it being e-waste soon.
Hah, in the imaginary future where we have cyborg assistants instead of climate destruction, my robot butler will pour half a cup of tea, go back to the kitchen, and then return to pour the second half of the cup, and I'll tell my guest, "Yeah, it's a 5 year old model, the startup that made him went bust so I'm using a firmware from a Ukranian forum... Джевс, можна мені трохи цукру?"
I think for most folks, affordability is more about reality than mentality.
Personally, I'd have no use for a free iphone. Android handsets are the only option for the functionality I use. Been that way since WinMo6.
Apple has exposed Siri to us as developers in several ways, one of which is called “Siri intents.”
The long and short of it is that app developers can hook into the Siri system so users can use Siri commands to control certain parts of third-party apps.
This means that users aren’t locked into using, say, Apple’s own Reminders app, and they can tell Siri to add things to third-party to-do list apps.
Users also have the option to create their own workflow via Shortcuts and give it a command phrase that Siri then responds to.
I assumed something similar was available on Android, but the responses indicate that this might not be the case.
I think the broader context here is that Google is downsizing the current Assistant team in preparation for an LLM-based replacement, perhaps once Gemini has rolled out.
If this doesn’t seem obvious in 1yr I’d say the hypothesis is likely wrong.
I don't think voice is a good interface. "It chats like a human" is the lowest possible hanging fruit in terms of product design, and bets everything on the smarts of the tech that's behind it.
We are so used to tooling faster than voice. Keyboards and taps are very, very fast. I want digital assistants as smart AND as fast as that, not something smart but incredibly slow to interact with because it needs to dumb itself down to human speech I/O.
To me, this is also not about modality or making it more generic. I just don't want an anthropomorphized smart-ass assistant. I want smart tools that actually assist me directly, no chat.
People hate call centers. I don't want to have a conversation with some human or human-parity AI at my airline, I want to change my flight in 3 clicks. In retail and fast food, self-checkout and online or kiosk ordering is popular for a reason.
I've found myself feeling those same feelings when being forced to have conversations with a chatbot. Chatting with ChatGPT just for fun can be fun, but it can be just as painful as a call center if you need to get something specific done. In order to cancel a hotel reservation, I was having to chat with some bot. It made it into a whole conversation, with brief pauses. It should have been 3 clicks.
LLMs can plausibly solve both.
Also, I don't want to engineer a prompt to convince my assistant to do my bidding. That's just hand coding action trees with extra steps.
I have an Alexa list called “Grocery” that does a 2-way sync, and use it to accelerate my online Safeway orders via AnyList.
You can sync to the default Amazon Shopping list too, but I find it works better if you have a secondary one specifically for sync.
Today's voice assistants are the opposite. They are unreliable and completely unstable. They don't have a clear list of commands they understand, let alone some sort of menu system - the documented commands on the manufacturer's websites often don't work. They also randomly change what they can do: stuff stops working for no obviously reason.
For example - yesterday, my son's Nest Audio suddenly refused to set a music alarm, claiming "this device doesn't support that feature yet" (it's literally a speaker for music...). It worked the day before.
Identifying the problem is often the first step in fixing it.
I can not for the love of my life get Siri to resume play in my native tongue. It is supported by Siri, I just have no clue on earth on what phrases she accepts. Tried many, started feeling dumb. Turned off Siri.
Every single one of those things have been deprecated and removed for… reasons?
All we can do with the speaker now is ask it to play music, get the weather, or set a timer.
Surprising to hear that Google assistant is now equivalent to Siri!
If I recall correctly, "add to my list" originally went to shoppinglist.google.com. They rolled it into Keep[1] ("note to self," tags, sharing).
It works well. However...
In 2016, I figured "tell me showtimes for $MOVIE in $CITY" should work. It still doesn't work. It may never work, because "robot butler with ads" is no one's idea of the future. (Maybe Jeff.)
A fire-and-forget voice action like "add to list" should still work(?). For conversations[2], we can pray Gemini is less infuriating.
[1] https://play.google.com/store/apps/details?id=com.google.and... [2] https://developers.google.com/assistant/ca-sunset
Same for the weather prompt someone else posted above and contrary to their experience it showed me exactly what I expected.
I'm a bit confused if those examples are something that didn't work in the past or if it's something that somehow doesn't work properly in the US right now.
There's a Nest mini (2nd gen) two meters away, but the device that answers is the Google Home 2016 in a different room.
First attempt: "Okay, ten minutes. And that's starting... Now."
Second attempt: "Sorry, I don't understand."
Third attempt: bingo.
Further trials seem to work, until they're interrupted by the 10 minute timer.
My partner comes downstairs to ask why I'm yelling STOP.
I remember my exact words when I bought this thing:
I have seen the future, and it sucks.
Also a lot of people rent studios and one bedrooms or otherwise have open floor plans.
Not to mention I think the paranoia about these home assistant devices is overblown. Do you use a smartphone? In your intimate kitchen?? It has just as much capability to listen to you.
We have a saying that loosely translates to “If the barn burns down, so does the house”. The meaning is that it’s not really wise to let the house burn down if the barn is burning.
Non user-hostile technology would happily solve this problem: you pull from the fridge what is about to finish or before throwing the empty container into the trash, put it in front of a mini camera mounted on the fridge, image (possibly also barcode) recognition would identify the product, then you say a magic word and it would be added it to your list directly on the phone, then software would calculate the best path to the shops having in stock the products in the list. Sadly, this would be hijacked by businesses in no time by making it dependent from some cloud services then selling your data to other advertisers or by pestering you with offers of similar competing products. As of today, I still prefer a pen and a piece of paper over any type of automation.
If anybody's curious, repo with most of the code is here: https://github.com/csimpf/keep2anylist. Happy to answer any questions about it!
I want to use Microsoft ToDo for my tasks. Why? I use Outlook everywhere. I don't want have to keep track of tasks somewhere else.
I'm looking forward to the EU forcing companies to allow more integrations.
* Playing and controlling audiobooks on Google Play Books with your voice. You can still cast audiobooks from your mobile device.
* Setting or using media alarms, music alarms, or radio alarms on Google Assistant enabled devices. You can create a custom Routine that has similar behavior or use a standard alarm.
* Accessing or managing your cookbook, transfering recipes from device to device, playing an instructional recipe video, or showing step-by-step recipes. You can use Google Assistant to search for recipes across the web and YouTube.
* Managing a stopwatch on Smart Displays and Speakers. You can still set timers and alarms.
* Using your voice to call a device or broadcast a message to your Google Family Group. You can still broadcast to devices in your home.
* Using your voice to send an email, video or audio message. You can still make calls and send text messages.
* Rescheduling an event in Google Calendar with your voice. You can still schedule a new event.
* Using App Launcher in Google Assistant driving mode on Google Maps to read and send messages, make calls, and control media. You can still use voice control on Google Maps the same way.
* Asking to schedule or hear previously scheduled Family Bell announcements. You can create a custom Routine that has similar behavior.
* Asking to meditate with Calm. You can still ask for meditation options with media providers such as YouTube.
* Voice control for activities will no longer be available on Fitbit Sense and Versa 3 devices. You'll need to use the buttons on your device to start, stop, pause, and resume activities. You can still voice control activities on Pixel Watches.
* Viewing your sleep summaries will only be available on Google Smart Displays. You can still ask for sleep details by voice on third-party smart clocks.
* Calls made from speakers and Smart Displays will not show up with a caller ID unless you’re using Duo.
* Viewing the ambient “Commute to Work” time estimates on Smart Displays. You can still ask for commute times and get directions by voice.
* Checking personal travel itineraries by voice. You can still ask for flight status.
* Asking for information about your contacts. You can still make calls to your contacts.
* Asking to take certain actions by voice, such as send a payment, make a reservation, or post to social media. You can still ask Assistant to open your installed apps.
Instead this seems to be a list of useful features that are being taken away!
I'm disappointed. Google employ some of the best AI/ML engineers in the world and they are making assistant worse rather than making it a showcase for what LLMs can do.
I expect that a new assistant like product (Google Bard Home or something) will be announced and existing Assistant/Home devices will be deprecated.
Was announced in October, but haven't seen anything about it since.
Makes you think.