Blog

Voice command testing – “Do you understand me, machine?” Part 2

Modern voice recognition clients should decode as many commands as possible, presenting developers and testers with a very challenging task.
10 February 2015
Quality assurance
The article by Nadya Knysh
Head of US Office

Decoding the voice

It’s important to consider that testing voice recognition clients differs from any other type of testing. Unlike testing a regular mobile application, the tester has an endless scope of data that could be entered. If you want a good client, you do not limit a person to just 10 words the system recognizes. Modern voice recognition clients should decode as many commands as possible, presenting developers and testers with a very challenging task. But still, even the best voice recognition system doesn’t guarantee correct decoding 100% of the time. The job of the developers and testers is to make the correct decoding percentage as high as possible.

If we talk about voice typesetting, the stage where mistakes are most likely to occur is the decoding stage. Let’s look at the architectural level of the process, when sounds captured by the microphone are going through frequency analysis. First, the voice is converted into graphical wave motion; then it is transformed into characters that build the word. The searching tool in Google Chrome mobile version, and predictive typing on mobile phones and tablets are good examples of this process.

However, it gets more complex when you deal with multi-functional applications, where the voice recognition system consists of two stages. First, the client decodes the voice and forms the whole phrase. Second, a complex algorithm switches on and starts analyzing each word separately and the whole phrase together. This is where the biggest amount of mistakes occur. Those voice recognition systems are pretty bulky, so they are installed on servers, while the mobile device has just a small client to record the voice, send it to servers and receive the commands back to perform them. To optimize testing and the fixing of bugs on the server and the client, mistakes should be strictly differentiated.

Testing the client: with female voice and in the pub

The way we speak and the way we pronounce words – these are the types of factors that have an impact on voice recognition systems. The voice pitch and timbre could be recognized by the system differently. Also, every person has his own voice speed. This should be taken into consideration while working on choosing testing scenarios. It is recommended to choose a quality assurance engineer with average pitch, timbre and voice speed. Ideally, the same functions are tested with both male and female voices. In testing a client for a foreign language, it’s good to have a tester able to speak without an accent, so you don’t end up like the guys in this video clip.

The tester should forecast different environments; it’s not enough to make a test just for a quiet room. Noisy streets, crowded pubs and public transport – the voice client should be adjusted to decode the human voice anywhere.
What else can undermine voice client performance? If technical support, such as headsets, Bluetooth and other accessories don’t function correctly, the client can fail in accomplishing the task at hand. The need for an instant and reliable connection challenges developers and testers to diminish the impact of Internet connection quality. It also helps if the tester emulates other user scenarios, such as playing music on his phone, incoming calls and other interruptions.
It’s not so easy to imitate a user while testing voice recognition clients. However, this is the very case when the “do like a user does” approach is the key to success. An experienced tester can think of many users’ testing approaches to ensure high quality of the final product.

Currently at its peak of popularity, voice clients still have a huge niche in which to be developed and adopted. This gives developers a lot of room in improving current software and creating new ones. At the same time, it is a great responsibility to be involved in this process. Every tester should keep in mind the millions of people using the voice recognition software they have tested and improved. Using correct approaches and optimal strategies in testing will allow every user to be satisfied with the communications channel you have enabled for them.

Read the full version here

The article was published in RCRWirelessNews.

More Posts

Zero trust in retail
27 March 2024,
by a1qa
4 min read
Fortifying retail security posture: embracing zero trust to protect customer data
Why adopt zero trust in the retail sector? How can companies ensure increased resilience to cyber incidents? Find out the answers in this article.
General
Quality assurance
Advancing QA and software testing processes with AI
14 March 2024,
by a1qa
4 min read
Advancing QA and software testing processes with AI
Uncovering the benefits companies gain when revolutionizing QA practices with the help of AI and tips to implement it.
General
Quality assurance
Navigating the future: QA trends that will define 2024. Part 2
30 January 2024,
by a1qa
4 min read
Navigating the future: QA trends that will define 2024. Part 2
We continue exploring QA trends, helping businesses remain competitive in 2024.
Cloud-based testing
Cybersecurity testing
QA trends
Quality assurance
Navigating the future: QA trends that will define 2024. Part 1
15 January 2024,
by a1qa
4 min read
Navigating the future: QA trends that will define 2024. Part 1
Discover topical software testing trends that will shape 2024 and empower companies to smoothly implement advanced technologies.
Agile
QA trends
Quality assurance
Test automation
2023-year-end-recap:-a-journey-through-the-a1qa-milestones
20 December 2023,
by a1qa
4 min read
2023 year-end recap: a journey through the a1qa milestones 
As we bid farewell to 2023, join us in recalling noteworthy achievements and unforgettable moments that have defined this year!
General
Quality assurance
The year in valuable conversations: recapping 2023 a1qa’s roundtables for IT executives 
8 December 2023,
by a1qa
3 min read
The year in valuable conversations: recapping 2023 a1qa’s roundtables for IT executives 
From dissecting novel industry trends to navigating effective ways of enhancing software quality — let’s recall all a1qa’s roundtables. Join us!
Big data testing
Cybersecurity testing
Functional testing
General
Interviews
Performance testing
QA trends
Quality assurance
Test automation
Usability testing
Web app testing
a1qa has been included in the Next-Generation Quality Engineering Services PEAK
29 November 2023,
by a1qa
2 min read
a1qa has been included in the Next-Generation Quality Engineering Services PEAK Matrix® Assessment 2023 by Everest Group
Explore how a1qa secured a proud spot in the prestigious PEAK Matrix® by Everest Group.
General
Quality assurance
na-st-awards-23
16 November 2023,
by a1qa
3 min read
a1qa shines as the finalist in three categories of the North American Software Testing Awards
a1qa is a triple finalist at the North American Software Testing Awards.
General
Quality assurance
Test automation
6 top reasons why business should invest in software quality
9 November 2023,
by a1qa
4 min read
6 top reasons why business should invest in software quality
We congratulate you on the World Quality Day with the article by Alina Karachun, Account director at a1qa, having 10+ years of QA expertise. Delve into it to explore the reasons why businesses should prioritize software quality.
Cybersecurity testing
Functional testing
General
Interviews
Performance testing
Quality assurance

Get in touch

Please fill in the required field.
Email address seems invalid.
Please fill in the required field.
We use cookies on our website to improve its functionality and to enhance your user experience. We also use cookies for analytics. If you continue to browse this website, we will assume you agree that we can place cookies on your device. For more details, please read our Privacy and Cookies Policy.