Baidu AI black technology? Experience Xiaodu at home smart speaker AI system

通过admin

Baidu AI black technology? Experience Xiaodu at home smart speaker AI system

Xiao Ai, Tmall Genie, 9420, are you familiar with these summoning names? Smart speakers have become popular in recent years and have begun to enter thousands of households. This kind of speaker that allows users to control with voice commands is sometimes very convenient. Users only need to make a voice call to let them play songs, control smart appliances, have conversations, and ask questions.

There are many ordinary smart speakers, so let’s take a look at a smart speaker with a screen. Let’s take a look at the advantages of a smart speaker with a screen compared to a smart speaker without a screen. This time we want to invite the "Xiaodu Home" smart video speaker jointly produced by Baidu and Xiaoyu Home.

Figure 1 Xiaodu smart speaker at home

Xiaodu has a 10W high fidelity sound unit and a 6-microphone array omnidirectional high fidelity audio capture at home. Compared with other smart speakers, Xiaodu’s biggest feature at home is a 7-inch touch screen and a 500W pixel camera.

Xiaodu’s main operation experience at home, in addition to being able to touch

When you get Xiaodu at home, turn it on for the first time, just like other Internet speakers, you need to perform networking operations first. Xiaodu can directly use the touch screen for Wifi networking operations at home. After networking, it provides the associated QR code for the user’s mobile APP Xiaodu to bind at home. After that, you can also associate the user’s Baidu account.

The summoning word of the Xiaodu speaker is "Xiaodu Xiaodu". Users can switch it to "small fish" in the settings of Xiaodu at home, but they still cannot customize other summoning words. Many operations can be carried out by voice. In addition to using voice to control, the touchscreen is also a convenient way for users to control. The clarity of this touchscreen is still good.

The upper right corner of the screen displays the time and weather forecast and air quality, the upper left corner has three shortcut buttons (skills, content square, dial), and the lower left corner is the shortcut button to summon Xiaodu’s automatic speech recognition at home. After pressing it, the user does not need to say the "Xiaodu Xiaodu" summon word in advance, just say the command. In the default settings, Xiaodu will automatically perform four-screen switching (time weather, shortcut call, skill prompt, content recommendation) when in standby at home.

The drop-down screen can activate the shortcut menu, where you can quickly switch on and off some functions, or adjust the volume to quickly turn off the music.

The screen wallpaper can be customized, and there is a carousel function, which means that users can also use Xiaodu at home as an electronic album. Users can upload photos to Baidu at home albums in the Xiaodu at home APP and let them be automatically displayed on the screen. In addition, it also supports the function of directly opening Baidu network disk to view pictures.

Figure 2 Xiaodu’s standby screen at home (please forgive the lack of low-level photography technology and photography equipment, the same as below) Xiaodu’s screen display effect at home is still good.

Figure 3 Drop-down menu

Xiaodu also has a theme mode at home, and currently users can use the themes of "Fresh Time, Night Reading Time, Leisure Time, Holiday Beach". "Xiaodu Xiaodu, turn on Night Reading Time". After receiving the command, Xiaodu switches to this theme mode at home to display relevant animations and background music.

Picture 4 Night reading time

2 Q & A videos without pressure

100,000 why, Xiaodu can answer a lot of questions at home

Xiaodu has an advantage resource at home, that is, having Baidu’s encyclopedia resources, users can use it to quickly query encyclopedia knowledge. It is very suitable for children to ask 100,000 why.

Xiaodu Xiaodu, a photo of an elephant. Xiaodu operates at home: the screen displays a photo of an elephant.

Xiaodu Xiaodu, how to write the word "Zhang". Xiaodu operates at home: the screen displays the word Zhang, and the stroke order animation is displayed.

Xiaodu Xiaodu, why does the sun shine? Xiaodu operates at home: the screen displays relevant knowledge content and reads aloud.

Xiaodu Xiaodu, who is Jacky Cheung? Xiaodu operates at home: The screen displays the Jacky Cheung introduction video in the second understanding encyclopedia. After the video ends, the relevant information of Jacky Cheung is displayed.

Xiaodu Xiaodu, describe the solar system. Xiaodu operates at home: The screen displays relevant knowledge content and reads aloud.

Figure 5 shows the elephant photo

Figure 6 shows the stroke order animation

Xiaodu can speak and sing at home, and the lyrics are displayed synchronously. It’s really good

As a smart speaker, Xiaodu’s rap function at home is really not bad. After upgrading Xiaodu’s system at home to the latest version, you can link the QQ music account, so that the resources that can listen to songs become massive. As for video resources, Xiaodu calls iQIYI video and Haokan Video at home, among which iQIYI video can log in to the account, and iQIYI VIP users can skip advertisements. And the book review resources use resources from Himalayas, Dragonfly FM, and Koala FM.

In addition to telling Xiaodu what to watch and listen to at home, users can also enter Xiaodu’s content square at home to conduct content on demand. The content square contains content such as film and television, short videos, news, radio, music, children, games, and audio.

Figure 7: Content Square

For music content, after binding QQ Music, you can basically hear all the songs you want to listen to, and Xiaodu has a good function at home, which is to display the lyrics synchronously when playing songs.

Figure 8 can display lyrics synchronously

Xiaodu is very convenient to watch videos at home, and there is also live TV.

Compared to the smart speaker without a screen, Xiaodu can not only get resources to listen to at home, but also get resources to watch. Users can use Xiaodu to watch the resources in the iQIYI video at home, and when they are bored, they can let Xiaodu play funny videos at home. If you can play audio & video, that would be great.

When playing video content, the user can use the player control button to quickly switch the previous and next video, pause the video and collect the video, and voice command to fast forward and rewind for how many minutes. Support the user’s familiar left swipe setting brightness and right swipe setting volume function.

Figure 9 Playing video content

Figure 10: Broadcasting a radio drama

For video content, users can use small degree at home will be projected to the TV, small degree at home currently supports DLNA function, can be projected to iQIYI TV fruit under the same network, but also supports most smart TV DLNA projection function.

In addition to these, Xiaodu also supports live TV at home, allowing users to watch TV. Xiaodu also has online radio at home, making it convenient for users to listen to radio stations.

Figure 11 Live TV function

3 Video conversations for all ages

Convenient for the elderly and children, video dialogue function

There is a prominent dial button in the upper left corner of Xiaodu’s standby screen at home. After clicking, you can enter the dial interface and directly video call the set contact. If the other party Xiaodu’s home APP is online, you can have a video conversation after connecting. This function is a very good function for children or the elderly at home. Two Xiaodu can also video call between homes.

Figure 12 Video conversation

In addition, Xiaodu also supports direct calling at home, but this function is not free and requires users to recharge before using it.

Figure 13 Normal dial

With this camera, users can also view the content in front of the camera with their mobile phone in real time. Users only need to enter the home interaction of the Xiaodu Home APP to view the camera content in real time. When the user views, a reminder will pop up in Xiaodu’s home and play a prompt tone to remind the user that someone is viewing the camera. Users can also manually turn off the camera at Xiaodu’s home.

Figure 14 View the camera content in the Xiaodu Home APP

Figure 15 Small degree reminder at home

Xiaodu’s camera at home can also help users take pictures quickly. Users only need to use the voice command "Xiaodu Xiaodu takes pictures", and Xiaodu will take pictures after counting down 3 seconds at home.

In addition, Xiaodu also has a smart capture function at home, which can help users capture exciting content. Users can choose whether to turn on this function.

Figure 16 Intelligent capture function

Xiaodu can teach early at home, and the educational function is quite rich

For early childhood education, Xiaodu has prepared resources such as Baby Bus, Children’s Songs, Little Banlong School, Baby Know, Little Prince Storybook, and Addition and Multiplication for users at home.

Figure 17 Xiaobanlong School

For learning tools, Xiaodu has prepared functions such as Chinese-English translation, concise Japanese, Lele Academy, search banner dialogue to learn spoken language, search banner to learn words, learn ancient poems, and write stories together at home.

Figure 18 Chinese to English translation

Figure 19 Sentence translation function

Users can also directly let Xiaodu perform calculations. In addition to providing answers at home, Xiaodu also displays a calculator for users to perform quick calculations.

Figure 20 Calculation

Xiaodu at home, child protection function

In order to prevent children from using it for too long and being exposed to bad content, Xiaodu Home has prepared a child protection function for users. Users can enable this function in the Xiaodu Home APP. After opening, Xiaodu Online can display only the content of resources suitable for children, distance protection (to prevent children from being too close to the screen), and set usage time limits and search restrictions.

Figure 21 Child protection content

Xiaodu is at home, with built-in mini-games

Xiaodu has several built-in mini-games at home, such as backgammon, vocabulary paradise, guessing musical instruments, guessing animals, you sing and I guess, animal riddles, etc. However, you cannot install special games and other applications by yourself.

Figure 22 Built-in mini-game

Xiaodu’s resources at home are not all free, and some content needs to be paid for, such as Uncle Kai telling stories, looking at pictures to guess idioms, etc. The paid operation is also very simple, just scan the QR code, and support WeChat, Alipay, Baidu wallet payment.

Figure 23 Paid content

4 Training interaction is valuable

Train to make Xiaodu smarter at home

In the Xiaodu Secret Language of Xiaodu Home APP, users can add automatic speech recognition content for Xiaodu Home, and can also customize voice questions and answers. A special function of Xiaodu Home is that users can customize multiple questions to correspond to the same operation, and the corresponding operations can be broadcast, recording and instructions.

Figure 24 Small degree secret language

  Figure 25 Operation after identification

Remote assistance, you can also control Xiaodu at home from a distance

Xiaodu also has a special skill at home, remote assistance. Users can use the Xiaodu at home APP to remotely control Xiaodu at home. This can help remotely restore when children or the elderly mess up the settings and don’t know how to restore them. Or if you want to see what the child is watching, you can also view it remotely. This is a great function. When entering and exiting the remote assistance, Xiaodu will have a voice prompt at home. It’s just that the image quality of this remote operation interface is a bit low. It is recommended that users can set the image quality according to their own network speed.

Figure 26 Xiaodu remote assistance at home

Family interaction, viewing photos is simple

In the home interactive channel of the Xiaodu Home APP, users can not only view the Xiaodu Home camera function in real time, but also view the smart capture content and the photo album content of Xiaodu at home.

Figure 27 Family interaction

Xiaodu is at home, what can it understand?

The most commonly used way to control AI speakers is to use voice commands, so can Xiaodu understand the user’s commands to perform operations at home? This is a test for Xiaodu at home. The test is affected by the environment and language, and the test results are for reference only and do not represent the final results in the testing environment.

Voice command: "XX share price"

Xiaodu operates at home: the screen displays XX stock price, telling the stock price + rise and fall + total market value.

Voice command: "Express inquiry".

Xiaodu operates at home: Open the courier inquiry, and the user can say the courier number for inquiry.

Voice command: "Good morning"

Xiaodu operates at home: broadcast the date, broadcast a quip, weather forecast, temperature, air quality, and play cheerful music.

Voice command: "What do cats (animals) call"

Xiaodu operates at home: play the dog’s barking + display the corresponding animal photo.

Voice command: "Music"

Xiaodu operates at home: play random music + display lyrics on the screen.

Voice command: "Play Jacky Cheung’s song"

Xiaodu at home operation: play Jacky Cheung’s song + broadcast song title singer + screen display lyrics.

Voice command: "Guzheng Music"

Xiaodu operates at home: play the ancient song

Voice command: "Play Leaving Sorrow"

Xiaodu operates at home: play Leren Sorrow + broadcast song title singer + screen display lyrics.

Voice command: "Change singer"

Xiaodu at home operation: changed a singer to play the sadness.

Voice command: "Do you want to eat?"

Xiaodu operates at home: Compared with eating, these divine songs fascinate me more. Quickly tell me Douyin Divine Comedy.

Voice command: "I’m hungry"

Xiaodu operates at home: Don’t go hungry, go and eat something.

Voice command: "What day is the lunar calendar today?"

Xiaodu operates at home: play the lunar date, and recommend hot spots.

Voice command: "Set the alarm at 18 o’clock"

Xiaodu operates at home: Set an alarm clock.

Voice command: "Set 1 minute countdown"

Xiaodu operates at home: the 1-minute timer starts, and the screen shows the countdown. The last 10 seconds are cool, and the music reminder is completed in time.

Voice command: "Turn off the screen"

Xiaodu at home operation: turn off the screen display.

Xiaodu is at home, some other functions

Xiaodu has Bluetooth function at home. When using Bluetooth to play songs, you can also use voice commands to perform previous and next operations.

After turning on the geek mode, you can start the continuous conversation function without having to start every command in small steps.

Xiaodu supports smart device control at home, and currently supports voice control functions of multiple smart devices.

Xiaodu is at home, some shortcomings and some suggestions from the editor

Let’s talk about the shortcomings of Xiaodu at home.

First: the accuracy rate of automatic speech recognition is far better than that of Tmall Genie. A special case is that after standing by for a long time or performing multiple operations, there will be either recognition errors or no response. These phenomena will be fine after shutdown and restart. The editor estimates that it is caused by insufficient memory. I hope the official will add the automatic memory cleaning function. The editor uses standard Mandarin.

Second: the Bluetooth playback mode of Xiaodu at home, connecting the mobile phone music to Xiaodu at home, I don’t know why it will be one card and one card (I don’t know if it is a separate phenomenon).

Third: Xiaodu doesn’t have a battery at home, so he has to drag a live tail behind him. When using it for children, you need to pay attention to safety.

Fourth: It is recommended that the indicator light turn on when the camera is working, rather than the current disabled camera.

Fifth: You can make a cool desktop with an animated version of the weather forecast, plus a temperature and humidity display.

summary

With a touch screen, Xiaodu’s smart speaker at home is indeed much more convenient, and it is really good to use the display screen to display more content on many content, especially encyclopedic content. Watchers with children at home can buy and play, use it to listen to stories and learn knowledge. It is a good tool.

关于作者

admin administrator