Blog

Keyword-driven testing: reasons to use or skip. Part 2

The first comparison had respect to test execution time. Keyword driven assumes that some additional logic of parsing keywords works at the background. The impact on test execution duration was mainly under our focus.
18 September 2014
Test automation
The article by Dmitry Tishchenko
Head of global business development at a1qa

In the previous post we had a look over keyword testing that has a somewhat dubious reputation with QA consultants and covered some steps of the comparison we made. This I`d like to provide you with the test results we`ve got.

Several charts below illustrate our findings regarding last week of experiment. One should also note tests were executed daily.

The first comparison had respect to test execution time. Keyword driven assumes that some additional logic of parsing keywords works at the background. The impact on test execution duration was mainly under our focus.

The results indicate test execution time is comparable and we may apply Keyword driven in future without additional efforts/hardware for optimizing test duration.

Efforts required for analyzing test results became another comparison point here. In fact it shows the similar picture. Despite keyword driven required a little bit more efforts to support tests, we got the same trend there. The reason may lie in the sphere of business logic. This part of measurements should be developed further.

Another point is test support time. We may see that both solutions are comparable by this indicator as well.

As for the test development efforts – manual QA Engineer was able to develop test case description using existent keyword. Taking this into consideration we may consider spending to be effective comparing to current solution.

Let’s sum up the outputs

The first conclusion we are able to mention is that Keyword driven has no contraindications for use and POC stage showed positive results. On the other hand based on our measurements we see no extraordinary results or substantial breakthrough.

We started the measurements after test development efforts of the new cases became comparable and we’ve got pretty the same characteristics for critical automation process on both solutions.

So, based on this research one can suggest using keyword driven when you are going to cover hundreds of test cases in long term projects with a business logic which assumes high level of keyword re-usage.

Having this as a consequence we decided to apply Keyword driven practice to several upcoming projects.

More Posts

qa-trends-in-telecom
30 September 2022,
by a1qa
5 min read
4 telecom trends for 2023 and how to painlessly implement them with QA
It’s time to explore the telecom trends for the upcoming year. Let’s look at them together and also see the value that QA brings for their smooth deployment.
Cybersecurity testing
Migration testing
QA trends
Quality assurance
Test automation
ai-ml-test-automation-mini
15 September 2022,
by a1qa
4 min read
4 key QA activities to solve test automation challenges via AI and ML
How to address the difficulties caused by implementing test automation? Learn how to do it via applying AI and ML.
Test automation
why-do-bugs-get-missed
31 August 2022,
by a1qa
4 min read
Why do bugs get missed? Learn the problems and tips to avoid them
Still, finding overlooked bugs after the app goes live? Let’s find out why this happens and how to fix it.
Quality assurance
Test automation
30 June 2022,
by a1qa
4 min read
App software testing for telecom: What are the common issues telco providers face?
Facing problems with the quality of your telecom software products? Read more in the article and find out the ways to address them.
Cybersecurity testing
Performance testing
Test automation
Mobile app testing
31 May 2022,
by a1qa
4 min read
Mobile app testing guide: win the race with five-star software
Which aspects of mobile apps to test first to produce a really high-quality product? Find the answer to this and other questions related to mobile app testing in the article.
Cybersecurity testing
Functional testing
Mobile app testing
Performance testing
Test automation
Usability testing
Test automation in Agile
20 May 2022,
by a1qa
5 min read
Test automation in Agile and DevOps: Maximizing flexibility and speed
Global market tendencies and user behavior are changing rapidly, if not talking about the software itself. Familiar situation? Find out how to get ahead of the curve with test automation in Agile and DevOps.
Agile
Test automation
19 April 2022,
by a1qa
5 min read
What prevents companies from boosting eCommerce customer experience: 4 common mistakes
Dreaming of a flawless online shopping journey for your users? Explore 4 widespread situations that hamper achieving this goal.
Cybersecurity testing
Performance testing
Test automation
Usability testing
2 February 2022,
by a1qa
5 min read
Interview with Mike Urbanovich: How to build a robust test automation strategy?
The Head of testing department at a1qa answers the questions on how to smartly build a winning test automation strategy and talks about the advantages you may obtain with it.
Test automation
31 January 2022,
by a1qa
4 min read
Scriptless test automation: revealing the truth via 3 misconceptions
Planning to go scriptless but in doubt? Explore 3 delusions of codeless test automation and its benefits when introduced smartly.
Test automation

Get in touch

Please fill in the required field.
Email address seems invalid.
Please fill in the required field.
We use cookies on our website to improve its functionality and to enhance your user experience. We also use cookies for analytics. If you continue to browse this website, we will assume you agree that we can place cookies on your device. For more details, please read our Privacy and Cookies Policy.