Blog

Keyword-driven testing: reasons to use or skip. Part 2

The first comparison had respect to test execution time. Keyword driven assumes that some additional logic of parsing keywords works at the background. The impact on test execution duration was mainly under our focus.
18 September 2014
Test automation
The article by Dmitry Tishchenko
Head of global business development at a1qa

In the previous post we had a look over keyword testing that has a somewhat dubious reputation with QA consultants and covered some steps of the comparison we made. This I`d like to provide you with the test results we`ve got.

Several charts below illustrate our findings regarding last week of experiment. One should also note tests were executed daily.

The first comparison had respect to test execution time. Keyword driven assumes that some additional logic of parsing keywords works at the background. The impact on test execution duration was mainly under our focus.

The results indicate test execution time is comparable and we may apply Keyword driven in future without additional efforts/hardware for optimizing test duration.

Efforts required for analyzing test results became another comparison point here. In fact it shows the similar picture. Despite keyword driven required a little bit more efforts to support tests, we got the same trend there. The reason may lie in the sphere of business logic. This part of measurements should be developed further.

Another point is test support time. We may see that both solutions are comparable by this indicator as well.

As for the test development efforts – manual QA Engineer was able to develop test case description using existent keyword. Taking this into consideration we may consider spending to be effective comparing to current solution.

Let’s sum up the outputs

The first conclusion we are able to mention is that Keyword driven has no contraindications for use and POC stage showed positive results. On the other hand based on our measurements we see no extraordinary results or substantial breakthrough.

We started the measurements after test development efforts of the new cases became comparable and we’ve got pretty the same characteristics for critical automation process on both solutions.

So, based on this research one can suggest using keyword driven when you are going to cover hundreds of test cases in long term projects with a business logic which assumes high level of keyword re-usage.

Having this as a consequence we decided to apply Keyword driven practice to several upcoming projects.

More Posts

Enhancing Agile and DevOps processes
28 February 2024,
by a1qa
4 min read
4 actionable tips to enhance Agile and DevOps processes 
Streamlining Agile and DevOps workflows? Learn practical recommendations on how to achieve this.
Agile
General
Test automation
Navigating the future: QA trends that will define 2024. Part 1
15 January 2024,
by a1qa
4 min read
Navigating the future: QA trends that will define 2024. Part 1
Discover topical software testing trends that will shape 2024 and empower companies to smoothly implement advanced technologies.
Agile
QA trends
Quality assurance
Test automation
The year in valuable conversations: recapping 2023 a1qa’s roundtables for IT executives 
8 December 2023,
by a1qa
3 min read
The year in valuable conversations: recapping 2023 a1qa’s roundtables for IT executives 
From dissecting novel industry trends to navigating effective ways of enhancing software quality — let’s recall all a1qa’s roundtables. Join us!
Big data testing
Cybersecurity testing
Functional testing
General
Interviews
Performance testing
QA trends
Quality assurance
Test automation
Usability testing
Web app testing
na-st-awards-23
16 November 2023,
by a1qa
3 min read
a1qa shines as the finalist in three categories of the North American Software Testing Awards
a1qa is a triple finalist at the North American Software Testing Awards.
General
Quality assurance
Test automation
3 November 2023,
by a1qa
4 min read
From idea to buying: 7 testing types to make your mobile eCommerce solutions flawless
Read the article to discover 7 QA activities helping boost mobile eCommerce solutions quality and provide end users with exceptional buying experiences.
Functional testing
General
Quality assurance
Test automation
Usability testing
On the way to Web 3.0: key software testing aspects for seamless digital experiences. Part 2
12 October 2023,
by a1qa
4 min read
On the way to Web 3.0: key software testing aspects for seamless digital experiences. Part 2
Let’s analyze essential software testing checks to improve the quality of the business-critical Web 3.0 functionality.
Cybersecurity testing
Functional testing
Performance testing
Quality assurance
Test automation
Usability testing
On the way to Web 3.0: key software testing aspects for seamless digital experiences. Part 1
11 October 2023,
by a1qa
4 min read
On the way to Web 3.0: key software testing aspects for seamless digital experiences. Part 1 
In part 1 of this article, learn about the transformation to a new Internet era, Web 3.0, and its benefits for increasing operational efficiency.
General
QA trends
Quality assurance
Software lifecycle QA
Test automation
goodfirms-lists
26 September 2023,
by a1qa
2 min read
a1qa’s recognition by GoodFirms: A testament to our expertise
Delve into a1qa's recent acknowledgment by GoodFirms and explore the significance of this accolade in the sphere of software testing.
General
Performance testing
Test automation
ai-ml-test-automation-mini
21 September 2023,
by a1qa
5 min read
6 activities to supercharge test automation with AI and ML
How to maximize the benefits of test automation? Learn how to do it via applying AI and ML.
Test automation

Get in touch

Please fill in the required field.
Email address seems invalid.
Please fill in the required field.
We use cookies on our website to improve its functionality and to enhance your user experience. We also use cookies for analytics. If you continue to browse this website, we will assume you agree that we can place cookies on your device. For more details, please read our Privacy and Cookies Policy.