Test automation risks
Blog

Test automation risks

Today test automation is seen as a strategic step and gains a lot of focus in software testing world. Applying to automated tests company saves costs, decreases overall time of testing cycle enhances product quality, and enables the staff to focus on testing details.
14 November 2013
Test automation
The article by Dmitry Tishchenko
Head of global business development at a1qa

Today test automation is seen as a strategic step and gains a lot of focus in software testing world. Applying to automated tests company saves costs, decreases overall time of testing cycle enhances product quality, and enables the staff to focus on testing details.

Nevertheless, there are risks associated with test automation; paying attention to each one of them you are able to manage the process successfully. When automated tests are under go, changes made in the interface can cause serious problems, like irrelevant test results.

The occurred problems cause additional costs to provide support and analyze outcomes.  Anyway, to prevent the problem you need some kind of mitigation plan. First of all, the development team should share the interface changes with QA team, and of course, monitor the irrelevant test results related to the changes.

Similar problems may occur because of changes in business logic. Apart from the irrelevant test results, support, costs increase, it can yield to changes in test data structure and can impact other cases. The cautions are pretty much the same: share the changes with QA team and monitor the irrelevant results.

Besides the changes huge number of defects in functionality can also pose threats, such as improper execution of some of the automated tests because of the defects in others (if the tests are interdependent). The consequences are quite unfavorable, first of all, the results are to be analyzed (tests should be covered manually), while the costs get increased and can be compared with manual testing efforts. Along with that test development is more expensive, when functionality is unstable.

Though, the challenge can be eluded, for that very purpose work out necessary rules or instructions and follow them. Firstly, automate critical path functionality (small number of test cases), then monitor irrelevant test results related to defects and, of course, monitor extra test development efforts for such cases.

There`s a risk of the issues related to the environment execution. For example, when background processes are scheduled on test server, it increases test execution time as application works slowly. . In the situation like this the plan of mitigation will consist of monitoring the irrelevant test results related to environment, and tracking the test execution time. The impact of the environment issues is quite small for web projects, though it can be serious for desktop and mobile applications.

Along with that all, parallel test execution may impact on test data, which causes again irrelevant test results. To preclude such problems, it is useful to create independent datasets and implement procedures, which reset datasets.

Mitigation plan is not the only prevention from the arising problems, along with that you are to care about the automation solutions (from technical point of view) that are based on principles that reducing the impact of risks, when they occur. Just keep in mind that is always better to prevent the risk than to remove the consequences.

More Posts

a1qa-articles
31 January 2023,
by a1qa
5 min read
Best of 2022 by executives: 8 most visited a1qa blog posts
Let’s look back and revisit the most visited a1qa articles of 2022!
Quality assurance
Test automation
qa-trends
12 January 2023,
by a1qa
4 min read
The future of software testing: top 4 impactful trends that will dominate in 2023
Consider the major industry trends for the upcoming year to know how to improve current QA strategies and stay ahead of the curve.
QA trends
Quality assurance
Test automation
test-automation
7 December 2022,
by Dileep Marway
3 min read
Release at pace with test automation: What, why, and how to measure success?
An automation-first approach is key to enhancing testing capabilities and increasing overall operational efficiency. However, I would suggest justifying its implementation, so that it can deliver the promised value.
Quality assurance
Test automation
interview-with-dileep
28 November 2022,
by a1qa
9 min read
Interview with Dileep Marway on a series of articles “Agility and speed: Supercharging your business strategies with QA”
We cooperated with the VP of Engineering and Quality at SHL to present you with a series of his blog posts on: culture of happiness, test automation, and Agile-driven QA. Happy reading!
Agile
Quality assurance
Software lifecycle QA
Test automation
qa-trends-in-telecom
30 September 2022,
by a1qa
5 min read
4 telecom trends for 2023 and how to painlessly implement them with QA
It’s time to explore the telecom trends for the upcoming year. Let’s look at them together and also see the value that QA brings for their smooth deployment.
Cybersecurity testing
Migration testing
QA trends
Quality assurance
Test automation
ai-ml-test-automation-mini
15 September 2022,
by a1qa
4 min read
4 key QA activities to solve test automation challenges via AI and ML
How to address the difficulties caused by implementing test automation? Learn how to do it via applying AI and ML.
Test automation
why-do-bugs-get-missed
31 August 2022,
by a1qa
4 min read
Why do bugs get missed? Learn the problems and tips to avoid them
Still, finding overlooked bugs after the app goes live? Let’s find out why this happens and how to fix it.
Quality assurance
Test automation
30 June 2022,
by a1qa
4 min read
App software testing for telecom: What are the common issues telco providers face?
Facing problems with the quality of your telecom software products? Read more in the article and find out the ways to address them.
Cybersecurity testing
Performance testing
Test automation
Mobile app testing
31 May 2022,
by a1qa
4 min read
Mobile app testing guide: win the race with five-star software
Which aspects of mobile apps to test first to produce a really high-quality product? Find the answer to this and other questions related to mobile app testing in the article.
Cybersecurity testing
Functional testing
Mobile app testing
Performance testing
Test automation
Usability testing

Get in touch

Please fill in the required field.
Email address seems invalid.
Please fill in the required field.
We use cookies on our website to improve its functionality and to enhance your user experience. We also use cookies for analytics. If you continue to browse this website, we will assume you agree that we can place cookies on your device. For more details, please read our Privacy and Cookies Policy.