Last year in the US, we introduced Voice Actions, a series of spoken commands that let you control your Android phone or tablet with your voice. You can call businesses and contacts, send texts, browse the web and complete other common tasks, all just by speaking into your phone.
Today, we’re pleased to announce that users in the UK, France, Italy, Germany and Spain can now use Voice Actions in British English, French, Italian, German and Spanish.
To use Voice Actions, tap the microphone button on the Google search box on your home screen, open the Voice Search app, or press down for a few seconds on the physical search button on your phone to activate the “Speak Now” screen. You can see how it works in this video.
Speak any of these commands to perform a Voice Action on your phone:
send text to [contact] [message]
call [business]
call [contact]
go to [website]
navigate to [location/business name]
directions to [location/business name]
map of [location]
And of course, you can still conduct a Google search using your voice.
Use Voice Actions to get directions, or send a text using just your voice
Voice Actions is available on phones and tablets running Android 2.2 and higher. If you don't have Voice Search on your phone yet, you can download it from Android Market - if you do have Voice Search, you can just start using Voice Actions.
We think Voice Actions helps you get things done on your phone faster and easier. Give it a try, and let us know what you think!
(Read more about the launch of Voice Search in Latin American Spanish on the Google América Latina blog)
Today we are excited to announce the launch of Voice Search in Indonesian, Malaysian, and Latin American Spanish, making Voice Search available in over two dozen languages and accents since our first launch in November 2008. This accomplishment could not have been possible without the help of local users in the region - really, we couldn’t have done it without them. Let me explain:
In 2010 we launched Voice Search in Dutch, the first language where we used the “word of mouth” project, a crowd-sourcing effort to collect the most accurate voice data possible.The traditional method of acquiring voice samples is to license the data from companies who specialize in the distribution of speech and text databases. However, from day one we knew that to build the most accurate Voice Search acoustic models possible, the best data would come from the people who would use Voice Search once it launched - our users.
Since then, in each country, we found small groups of people who were avid fans of Google products and were part of a large social network, either in local communities or on online. We gave them phones and asked them to get voice samples from their friends and family. Everyone was required to sign a consent form and all voice samples were anonymized. When possible, they also helped to test early versions of Voice Search as the product got closer to launch.
Building a speech recognizer is not just limited to localizing the user interface. We require thousands of hours of raw data to capture regional accents and idiomatic speech in all sorts of recording environments to mimic daily life use cases. For instance, when developing Voice Search for Latin American Spanish, we paid particular attention to Mexican and Argentinean Spanish. These two accents are more different from one another than any other pair of widely-used accents in all of South and Central America. Samples collected in these countries were very important bookends for building a version of Voice Search that would work across the whole of Latin America. We also chose key countries such as Peru, Chile, Costa Rica, Panama and Colombia to bridge the divergent accent varieties.
As an International Program Manager at Google, I have been fortunate enough to travel around the world and meet many of our local Google users. They often have great suggestions for the products that they love, and word of mouth was created with the vision that our users could participate in developing the product. These Voice Search launches would not have been possible without the help of our users, and we’re excited to be able to work together on the product development with the people who will ultimately use our products.
Posted by Linne Ha, International Program Manager, Google Voice Search
When we launched Voice Search more than two years ago, we wanted it to “just work” right out of the box, without an initial setup process. And so, we built speech models broad enough to accommodate a wide variety of people, regardless of gender, age, and accents, or variations in pitch, pace, and other factors. But we always knew we could build a more accurate model by listening to your voice, and learning how you -- as a unique individual -- speak. So today we’re launching personalized recognition.
If you opt into personalized recognition, we begin to associate the recordings of the words that you ask us to recognize with your Google account. We then automatically use these words to build a speech model specifically for you. This speech model enables us to deliver greater recognition accuracy. Although subtle, accuracy improvements begin fairly quickly and will build over time.
The first time you use Voice Search, you’ll be presented with a dialog to turn on personalized recognition. Google takes your privacy seriously, so you can enable or disable personalized recognition at any time through the Google voice recognition settings on your phone. If you’d like to disassociate your voice recordings from your Google Account, you can do so through the Google Dashboard in the Speech section.
The personalized recognition functionality is currently available for English in the United States. We plan to support other countries and languages in the near future. To enable it, you must have Android 2.2 or higher, and download the latest version of the Voice Search app from Android Market. The new app also includes some improvements to name recognition and speed, especially over 3G and EDGE connections.
So go ahead and download the latest Voice Search app, and let’s get personal!
Scan this QR code to download:
Posted by Amir Mané, Product Manager and Glen Shires, Member of Technical Staff
Over the past few weeks we have launched Voice Search in four new languages: Russian, Polish, Czech and Turkish. Try speaking queries like “концерты Юлии Савичевой” (tour dates for Yulia Savicheva), “przepis na pierogi” (recipes for pierogi), “obrázky Hradčan” (pictures of the Prague castle), or “istanbul hava durumu” (weather in Istanbul). Note that you can only speak one language into the app at any time and that you’ll need to change your language setting first.
Voice Search is often preloaded on new Android devices. In that case, all you have to do is press and hold the search button and then speak your query. If you have an Android (2.0 or higher) phone but don’t have Voice Search installed, download the “Voice Search” app from Android Market. If you own an iPhone or other smartphone, you can download Google Mobile App with Voice Search from m.google.com
Posted by Amir Mané, Product Manager of Google Speech Technologies
Many of you have searched the web by speaking since the launch of voice search in 2008. In fact, one in every four searches from an Android phone in the US is by voice. In certain situations, voice search just works much better than typing. It’s a lot faster than typing on a small phone screen. You can search things even when you don’t know the correct spelling. It’s more fun as you can share what you’re doing with your friends. And it’s safer when you’re walking around. Once you start using voice search, you start discovering all sorts of new ways to use it.
We’ve thought of a few interesting uses for voice search and made some short videos out of them. Check them out on our new YouTube channel. But we know you can do better. What are some of your most frequent or unusual voice search queries? Leave us a comment below or on our YouTube channel.
Posted by Heaven Kim, Product Marketing, Google Mobile
By now, some of you may have noticed our new Google Mobile YouTube channel, with a fresh look that includes a video box that rotates along multiple axes (we love the Rubik’s Cube here at Google). As you click on and discover more videos, we hope you’ll have fun checking out all the ways the box can turn.
In our channel’s “featured” section, we highlight some of our mobile search capabilities -- like search by voice, sight, and location -- that really help you take advantage of your phone’s unique technology. Since we understand that these represent new modes of searching for many of you, we’re going to launch some new videos that help illustrate the variety of practical and fun ways that you can use these features. To start with, check out our “Shoot This” series of videos for Google Goggles. Goggles can actually recognize much more than just bar codes and book covers, and these videos really let you take Goggles for a test drive. You can navigate through these videos by clicking on the embedded annotations to fast-forward or rewind.
When looking at “all apps,” you can not only check out any of our latest videos at a glance, but also quickly sort them by mobile platform or by app. We’ve also made it easier for you to share videos by email or through popular social networking sites.
We hope you enjoy trying out our new Google Mobile YouTube channel. We’ll be adding many more new videos, so please visit youtube.com/googlemobile and subscribe. Also, if you’ve already subscribed to our old channel, note that you need to subscribe to the new one separately.
Posted by Heaven Kim, Product Marketing, Google Mobile
Our mobile phones have become modern-day Swiss Army knives. An Android phone is a handheld computer, a music player, a notepad, a GPS navigation unit and more, all rolled into one sleek device that fits in your pocket. Today’s phones do so many things for us that sometimes we don’t even think about how we do them.
Even though our phones do all these new things, the most natural way of interacting with a phone remains what it always has been: speaking. And to that end, we’re pleased to introduce Voice Actions for Android. Voice Actions are a series of spoken commands that let you control your phone using your voice. Call businesses and contacts, send texts and email, listen to music, browse the web, and complete common tasks, all just by speaking into your phone.
To use Voice Actions, tap the microphone button on the Google search box on your home screen, or press down for a few seconds on the physical search button on your phone to activate the “Speak Now” screen. Let Mike LeBeau, the lead engineer for Voice Actions, show you in this video.
Speak any of these commands to perform a Voice Action on your phone:
send text to [contact] [message]
listen to [artist/song/album]
call [business]
call [contact]
send email to [contact] [message]
go to [website]
note to self [note]
navigate to [location/business name]
directions to [location/business name]
map of [location]
And of course, you can still conduct a Google search using your voice.
While we’re at it, we’re also releasing an updated version of the Google search widget for Android. When you type a local search query, like [italian restaurants] you’ll see suggested restaurants with addresses and ratings. Also, as you type queries, you can refine them further by tapping the pencil icon that appears to the right of search suggestions.
Both Voice Actions and the new Google search widget require Android 2.2 (Froyo), and will be pre-installed with the new Droid 2 phone from Motorola and Verizon. Voice Actions are currently available for U.S. English speakers.
If you have another phone with Android 2.2 (like the Nexus One, HTC Evo or the original Droid), you’ll need to download several app updates from Android Market to get all the latest goodness:
Voice Search (this app includes Voice Actions)
Google Search widget
music apps (e.g. Pandora, Last.fm, Rdio, mSpot)
To get started fast, scan the QR codes for these apps below.
We think Voice Actions help you get things done on your phone faster and easier. Give it a try, and let us know what you think!
Posted by Hugo Barra, Product Management Director, and Dave Burke, Engineering Manager
Update (1:23 PM PST): we previously had not made the below downloads available outside the US, but they are now available. Voice Actions only work with US English speakers right now.
If you've been to Times Square in New York City over the past couple weeks, on any day from 12:30-2:00pm or 6:30-8:00pm, you may have noticed that Google Search by voice is powering Times Square's largest combined displays -- the Reuters Sign and the NASDAQ sign. Anyone can call 888-376-4336 and say the name of a business or a location that they want to search for, like "museum of modern art" or "pizza". Then, the query and local search results from Google will appear on one of the two electronic billboards. This is all part of Verizon's "Droid Does" campaign and has been developed in partnership with Reuters and R/GA, a digital advertising agency.
On Black Friday, Times Square's gigantic interactive search-by-voice demo will be running for 20 hours straight. So if you're in the area and have a chance to take a break from your shopping, or if you want to see your next shopping destination displayed on a Google map on the huge signs, give the demo a try and let us know what you think. And for those of you that aren't in Manhattan on that day, you can still watch the action via webcam.
I flew out to New York last week to try it myself. R/GA gave me a behind-the-scenes tour of the setup, and I was impressed by how they pulled this off. A caller's voice is sent through the phone system, directly into a small farm of real Droids running voice search that are connected to the big outdoor electronic displays! R/GA developers made use of the Android voice recognition API just like any Android developer can.
It's been quite a ride for the search by voice team -- from launching on the iPhone about a year ago, to our launches on BlackBerry and Android, and on S60 in Mandarin Chinese, to powering billboards in Times Square. We're thankful for the chance to work on technology that excites us and that can help more of you search faster and more easily on your phone. And we hope you've been noticing the ongoing improvements in the accuracy of our voice recognition. We can't wait to show you what we have in store for next year.
Google Search by voice has grown up quickly. Some might say that search by voice has matured from a toddler to a tween. It's certainly been traveling across the English-speaking world and getting better at understanding a range of accents, from the US, UK, India, and Australia. Today it's taking another big step — we're happy to announce that Google search by voice is available for Nokia S60 phones, and now understands Mandarin Chinese.
Nokia S60 phones are popular around the world. If you have an Nseries or Eseries phone such as the N95 or E71, you're using S60. Many of these phones have 12-digit keypads — good for making calls, but not so easy when you need to type a few words. Many of you have asked if we could build our search by voice feature for these phones, and we've been working on this feature for a while.
The new version of Google Mobile App places a shortcut to Google search on your Nokia phone's home screen, allowing you to search using your voice or by typing. You can search for anything — from "movie times", to "fish 'n chips", to "masala dosa." It doesn't matter if you're in London or Bangalore: we'll use your location to give you nearby results. And Google Mobile App shows search results in the application, so you don't have to wait for a web browser to launch to get an answer.
Although it has taken a little while to get this release ready, we have been planning the launch for some time as you can see from this footage from the archives.
Up until now voice search has only been available in English, but the new version of Google Mobile App for Nokia S60 devices works for Mandarin speakers, too. We're really proud of the work we've done with Mandarin speech recognition, both because it's the most spoken language in the world, and because of the engineering challenge. To get Mandarin speech recognition to work, we had to learn a lot about this fascinating language — the differences between traditional and simplified Chinese, its tonal characteristics, automatic segmentation of text into words, pinyin representations of Chinese characters, sandhi rules, the different accents and languages in China, unicode representations of Chinese character sets...the list goes on and on.
Mandarin speakers can now search by voice for complex queries like 清华大学附近的水煮鱼 (which translates to "water-boiled fish near Tsinghua University"). Although this only works on the Nokia S60 at the moment, we're working on adding support for Mandarin speech recognition to our products on other mobile platforms, such as Android and iPhone. And bear in mind that this is a first version of our system in Mandarin, and it might not be as polished as our English version. For example, if you have a strong southern Chinese accent, it might not work as well as for people with a Beijing accent. However, our system will improve over time, so please give it a try!
Google Mobile App in Mandarin Chinese
Note that the application is for version 3 of Nokia S60 - more recent phones running version 5 (touch screen) are not yet supported.
To download the new version of Google Mobile App on your Nokia S60 phone, visit m.google.com from your phone's browser. For questions and support, visit our Help Forum.
One evening in Zurich, after a late night cake run, we decided that our iPhone app, Google Mobile App with Voice Search, could do with a little bling. The result of this is a few extra options hidden below the preferences on the Settings tab. Trust us, they're down there... it just might take some perseverance to get to the bottom of things. Just keep trying!
Does blue not go with your new belt? Use the Theme Color to style the app to work with any outfit or match the holiday season.
Tired of the standard beeps and boops during speech recognition? You can try out some alternate sounds made by our teammates in their sugar-induced stupor.
There are a couple of other options hidden in there, too. We had (a little too much) fun implementing these features and hope you enjoy them!
And don't worry. If you don't find them, just come see us at Macworld and we'll show you.
Posted by Nicholas Jitkoff, User Experience Designer
Whether you're shopping or traveling, entertaining or keeping in touch, let Google mobile make your life a little easier this holiday season with Google Mobile Tips.
From now through January 1, 2009, we'll post one new tip each day on our Google Mobile Tips microsite. You can also view the tips on your phone by simply entering your phone number on the microsite and clicking "Send". You'll receive an SMS text message with a link that leads to a tip on a mobile web page.
Today's tip is on voice search. Many of you may know that we recently launched Google Mobile App for the iPhone with voice search. However, did you know that you can tap the green highlighted text in the search bar to see alternative predictions of what you've spoken? If the voice recognition for a query is close but not perfect, try tapping this text to see if your desired query is in the list. If it is, then just tap the list item to see your search results. Voice search can come in handy when you're looking for that perfect gift -- whatever that may be.
Make life even easier by taking a look at this countdown to 2009 for tips about other Google products like Product Search, Checkout, Maps, and more. There's even a gadget that you can add to your iGoogle page -- read more on the Official Google Blog.
Posted by Lawrence Chang, Product Marketing Manager, Google mobile team
The new Google Mobile App for iPhone makes it possible for you to do a Google web search using only your voice. Just hold the phone to your ear, wait for the beep, and say what you're looking for. That's it. Just talk. Once the App is on, you don't have to push any buttons to search. Check out the video below to watch engineer Mike LeBeau explain how this works.
And if you're doing a local search, there's no need to specify where you are because Google Mobile App now has Search with My Location. Search for "movie showtimes" or "Mediterranean restaurant" and you'll automatically see results based on your current location. For this to work, Location Services must be enabled on your iPhone and you have to opt-in to let Google Mobile App use your location.
To get the latest Google Mobile App for iPhone or iPod touch, go to the App Store and look for "Google Mobile App." Note that the voice search feature is currently available only in U.S. English and for the iPhone. Read more about other features of Google Mobile App.
Watch this video to see what Googlers from Chicago, London, New York, and Mountain View are searching for. Then consider sharing your most interesting voice search query by submitting a video response.
Posted by Dave Burke, Engineering Manager, Google mobile team
