Blog

Localization testing strategy for fostering project success

Let’s take a closer look at where the localization testing stands now, on the current issues and best practices.
18 July 2017
Localization testing
Test automation
The article by a1qa
a1qa

Localization testing is an indispensable part of every software localization project. As most of the software developing companies aim to reach audience from the world over, they can’t neglect testing the product’s localization. Let’s take a closer look at the current status and best practices of localization testing.

This type of testing is performed by software QA engineers (you’ll see later on why we stress this seemingly obvious fact) after the product localization and before its release. The main goals are to ensure the functional and linguistic accuracy of the software under test and make sure that no issues have been introduced during the localization process.

What problems may occur during the l10n testing?

Most of the problems occur just because some localizers do software translation using the tools “outside” of the actual software application. As a rule, localizers receive a table of strings. Of course, they are provided with all reasonable information about the strings’ context, but in practice, this information is far from complete: the strings may appear dynamically in many user situations or in different parts of the interface. These different parts may look differently.

Who should perform localization testing: a QA engineer or a linguist?

There has always been the dilemma over which is more important: the engineering capabilities of a tester and his or her product knowledge, or his or her linguistic and language background.

A decade ago, localization testing was equaled to linguistic testing. It was widely believed that l10n testing should be performed by the target language native speakers or at least by the speakers with an advanced level of language competency. However, today the situation is completely different. It’s not efficient for QA companies to hire native speaking testers to ensure localization quality of a project. Even if found, such specialists may be very expensive to maintain.

And there is no 100% guarantee that a linguist will cope with projects that complicate business logic. Sometimes, it can be helpful to differentiate between functional defects and non-translated strings. The defects are reported to the dev team, and non-translated strings are sent to the localization team.

Ideally, there should be a team of linguists or localization engineers to ensure the 100% project delivery.

But regardless of who performs testing, localization depends on dev and QA teams. It is vital that localization testing shouldn’t start until the core product has reached a certain level of stability.

Otherwise, localizers may come across multiple defects at the same time as the functional testing team finds them. As a result, several bugs will be reported for the same issue and bug fixing efforts will increase.

What are the duties of a localization engineer?

A localization engineer checks all translatable files for in-context accuracy and performs UX testing to make sure all global users can run the app and complete tasks like making a payment or filling out a form. The main personal qualities of a good localization tester are still the same: curiosity, analytical skills, and attentiveness.

Localization testing best practices

1. Pseudo-localization testing

This technique is designed to verify the localizability of strings prior to the localization itself. It is normally executed as part of the internationalization testing phase. During the pseudo-localization the standard display characters are replaced by potentially problematic ones. Such pseudo-localized software may then be tested to verify its general functionality. In average, 70-80% of bugs that would be normally reported later on during localization testing are found at this earlier stage as a result of pseudo-localization.

2. Automation of localization testing

The main goal of localization testing is to ensure the product adaptation to all target regions. To reduce the time required for adding new localization and perform regression testing on long-term projects, localization testing can be automated.

The benefits of test automation are the following: significant reduction of efforts, costs and time compared with resource-demanding manual testing, especially with a larger number of languages.

How a1qa automated localization testing for Kaspersky Lab

Kaspersky Lab addressed a1qa to perform comprehensive testing of the My Kaspersky portal and to automate the localization and internationalization testing.

Kaspersky team worked in collaboration with a1qa testing team to deliver 31 localizations.

a1qa test automation engineers developed 64 automated test scripts for localization screenshotting, which covered more than 90% of the pages a user could see. The scripts where parameterized to be executed on the specified scope of locales (different combinations of country/language), and they produced screenshots and “metadata” for each screenshot.

The so-called metadata was the xml-file with the LocalizedString items, including text, unique key and position of this text on the screenshot. Using the special parsing tool, localization engineers where able to achieve two main goals:

  1. Compare the same pages of different product versions for regression.
  2. Compare the same pages in different localizations.

After the analysis, the collected data was sent to third-party localization agencies. When it was returned and committed to the portal, the corrections were made.

The automated tests created by a1qa were reusable and easy to maintain. They served well not only localization purposes but also enabled proper work of the covered functionality.

  • With the participation of a1qa testing team, the My Kaspersky portal has been localized and adapted to 31 languages.
  • a1qa test automation has created a set of reusable tests that can be further maintained and used by the customer’s team to localize newly added strings and functionality.

Generally, the success of localization testing greatly depends on how companies approach the whole issue of internationalization and localization and how they integrate automation into the entire process.

But there is no doubt that software localization may pose challenges, and testing should be conducted prior to the software release to the global market.

More Posts

debated technologies
30 May 2023,
by a1qa
3 min read
a1qa tech voice: Managing director at a1qa, North America, discusses pros and cons of much-debated technologies
Nadya Knysh, Managing director at a1qa, North America, puts a spotlight on 6 current technologies, discussing their positives and negatives.
General
Interviews
Test automation
why-do-bugs-get-missed
17 April 2023,
by a1qa
4 min read
Why do bugs get missed? Learn the problems and tips to avoid them
Still, finding overlooked bugs after the app goes live? Let’s find out why this happens and how to fix it.
Quality assurance
Test automation
Mobile app testing
15 February 2023,
by a1qa
4 min read
Mobile app testing guide: win the race with five-star software
Which aspects of mobile apps to test first to produce a really high-quality product? Find the answer to this and other questions related to mobile app testing in the article.
Cybersecurity testing
Functional testing
Mobile app testing
Performance testing
Test automation
Usability testing
a1qa-articles
31 January 2023,
by a1qa
5 min read
Best of 2022 by executives: 8 most visited a1qa blog posts
Let’s look back and revisit the most visited a1qa articles of 2022!
Quality assurance
Test automation
qa-trends
12 January 2023,
by a1qa
4 min read
The future of software testing: top 4 impactful trends that will dominate in 2023
Consider the major industry trends for the upcoming year to know how to improve current QA strategies and stay ahead of the curve.
QA trends
Quality assurance
Test automation
test-automation
7 December 2022,
by Dileep Marway
3 min read
Release at pace with test automation: What, why, and how to measure success?
An automation-first approach is key to enhancing testing capabilities and increasing overall operational efficiency. However, I would suggest justifying its implementation, so that it can deliver the promised value.
Quality assurance
Test automation
interview-with-dileep
28 November 2022,
by a1qa
9 min read
Interview with Dileep Marway on a series of articles “Agility and speed: Supercharging your business strategies with QA”
We cooperated with the VP of Engineering and Quality at SHL to present you with a series of his blog posts on: culture of happiness, test automation, and Agile-driven QA. Happy reading!
Agile
Quality assurance
Software lifecycle QA
Test automation
qa-trends-in-telecom
30 September 2022,
by a1qa
5 min read
4 telecom trends for 2023 and how to painlessly implement them with QA
It’s time to explore the telecom trends for the upcoming year. Let’s look at them together and also see the value that QA brings for their smooth deployment.
Cybersecurity testing
Migration testing
QA trends
Quality assurance
Test automation
ai-ml-test-automation-mini
15 September 2022,
by a1qa
4 min read
4 key QA activities to solve test automation challenges via AI and ML
How to address the difficulties caused by implementing test automation? Learn how to do it via applying AI and ML.
Test automation

Get in touch

Please fill in the required field.
Email address seems invalid.
Please fill in the required field.
We use cookies on our website to improve its functionality and to enhance your user experience. We also use cookies for analytics. If you continue to browse this website, we will assume you agree that we can place cookies on your device. For more details, please read our Privacy and Cookies Policy.