Magazine

Google Assistant Can Now Control Android Apps – ProWellTech

Posted on the 08 October 2020 by Thiruvenkatam Chinnagounder @tipsclear

Google announced today that it allows you to use the "Hey Google" voice command to not only open but also perform specific tasks within Android apps. The feature will be implemented on all Google Assistant-enabled Android phones, allowing users to launch apps with their voice, as well as search within apps or perform specific tasks, such as ordering food, playing music, posting on social media , greet a ride, and more.

For example, users might say something like "Hey Google, search for comfy blankets on Etsy", "open Selena Gomez on Snapchat", "start my run with Nike Run Club" or "check the news on Twitter".

At launch, Google says this type of voice commands will work with more than 30 of the best apps on Google Play in English globally, with more apps on the way. Some of the apps supported today include Spotify, Snapchat, Twitter, Walmart, Discord, Etsy, MyFitnessPal, Mint, Nike Adapt, Nike Run Club, eBay, Kroger and Postmates, Wayfair, to name a few.

If the specific voice command you'd use to perform a common task is a bit clunky, the feature will also allow you to create a custom shortcut phrase. This means that instead of saying "Hey Google, tighten my shoes with Nike Adapt", you could create a command that simply said "Hey Google, lace it up".

To start with shortcuts, Android users can say "Hey Google, show my shortcuts" to get to the correct Settings screen.

The feature is similar to Apple's support for using Siri with iOS apps, which also includes the ability to open apps, perform tasks, and record your own custom phrase.

In the case of Google, the ability to perform tasks within an app is implemented on the developer's side by mapping users' intentions to specific functionality within their apps. This feature, known as App Actions, allows users to open their favorite apps with a voice command. Also, with the added functionality, it allows users to say "Hey Google" to search within the app or to open specific pages in the app.

Google says it has expanded its catalog to include over 60 intentions across 10 verticals, including Finance, Ridesharing, Food Ordering, Fitness and now also Social, Games, Travel & Local, Productivity, Shopping and Communication.

To help users understand how and when they can use these new app actions, Google says it's creating touchpoints in Android that will help them learn when they use certain voice commands. For example, if a user says "Hey Google, show me Taylor Swift," they might highlight a hint chip that will guide users to open the search result on Twitter.

In connection with this news, Google says it has also released two new English voices that developers can take advantage of when building custom experiences for Assistant on smart displays, along with other developer tools and resources for those who create for displays.

The Google Assistant update for apps was one of several Android improvements that Google highlighted today. The company also says it is adding screen sharing to Google Duo, expanding its anti-spam feature Verified Calls to more devices (Android 9 and above) and updating the Google Play Movies & TV app to become the new app. " Google TV, "announced last week.

On the accessibility front, it is introducing new tools for hearing loss with sound notifications and others for communication using action blocks, aimed at people with cerebral palsy, Down syndrome, autism, aphasia and other language-related disabilities .

Features are now available.


Back to Featured Articles on Logo Paperblog