Testing model tools
Blog

Testing model tools: Microsoft Test Manager, JIRA Zephyr and HP Quality Center

Microsoft Test Manager (MTM) simplifies testing of a developed application. It saves testing plans results on its Team Foundation Server (TFS). If you don`t need all Microsoft Test Manager functions, use Team Web Access to plan and launch tests.
19 August 2014
Quality assurance
The article by Julia Ilyushenkova
Head of Telco and Web applications testing department

As a continuation to my former post, Testing Models: How Did You Ever Live Without Them, this post will detail the most effective testing model tools: Microsoft Test Manager, JIRA Zephyr and HP Quality Center.

The table below provides an at-a-glance comparison of these test tracking systems that can be used when delivering both manual and automation testing services.

Parameter/SystemMicrosoft Test Manager (MTM)JIRA ZephyrHP Quality Center
Possibility of requirements controlNo specifed modules or functionality for this taskThe requirements can be controlled due to interconnection of test cases with requirements on WIKI or/and JIRA User Stories.Includes specified module of requirements control
Integration with defect tracking systemFull integration with TFS (Team Foundation Server) MTMFull integration with JIRAIncludes implemented bug tracking system
Price$2,169 (with Visual Studio Test Professional 2013 included in package)Year license for 100 users costs 300 USDHP doesn’t announce prices for Quality Center. Prices of the main version, as provided by sales representatives are the following:

 

  • $37,000 for first five users
  • $5,400 for every additional user
Customization possibilities (addition of custom fields)IncludedIncludedIncluded
Usability
  • System can hang up
  • Screen shifts in the process of testing
  • Not handy for frequent operations
One of the easiest to use test tracking systemsUser interface is not intuitive

Below is a more detailed description of each of the above test tracking systems.

Microsoft Test Manager

Microsoft Test Manager (MTM) simplifies testing of a developed application. It saves testing plans results on its Team Foundation Server (TFS). If you don`t need all Microsoft Test Manager functions, use Team Web Access to plan and launch tests.

  • Exploratory testing – Allows writing down actions during test execution without pre-planned steps.
  • Performing manual tests – This function allows displaying of the test case on the screen side during test performance. You can automatically record actions, make screenshots and perform other diagnostics to include in results and errors reports.
  • Test configuration: Specification of testing platforms – You can develop several website versions for different hardware or software configurations.
  • Collection of extra data for diagnostics in manual tests – This function allows you to record the event logs, data IntelliTrace, videos and other diagnostic data during the test.
  • Windows Store applications testing – Applying Microsoft Test Manager installed on a separate device can help to collect diagnostic data and screenshots during test performance.
  • Plan application tests in Microsoft Excel or Microsoft Word – This function allows you to use Microsoft Excel for editing of testing plans and synchronizing with them.
  • Testing in lab environment – This function allows collecting diagnostic data from servers during test performance. Testers can manage functioning of server/computers and can quickly set up new test configurations including usage of virtual machines.
  • System tests automation – MTM allows interconnecting testing methods in code to imitate manual tests and regularly repeat them. You can also automate whole process “build-deploying-testing”.

JIRA Zephyr

If your company currently uses Atlassian JIRA, JIRA Zephyr would be the obvious choice. JIRA is a commercial product licensed for operating on a local server or accessible as a remote application.

  • Full integration with JIRA – You can create test cases, test plans and testing reports applying only the JIRA system. All team members can be involved in the testing process. Developers get easy access to test cases. In the event changes are made to the test model, they get immediate notification. The system provides quick access to testing reports for managers, clients and the development team.
  • Similar configuration with development projects – As soon as a project is created in JIRA, the testing team can launch the process of test cases and test plans development. Unlike other systems, you don`t have to create new users, components, or iterations for testing tasks, which saves time.
  • Simplified search of tests and entities – You can create test plans with saved filters, or set up a search of a certain group of test cases. Testers can create infographics using standard JIRA means and make them available for the entire team.

HP Quality Center

HP Quality Center includes five interrelated modules providing process continuity:

  • Management – used for registration of OS releases planned for testing. Release entity can have child entity “Cycle” indicating testing cycle.
  • Requirements management – module of requirements creation. Each requirement typically corresponds to one “requirement” entity. One entity can have several sub-entities, and there also can be several types of entities.
  • Test plan – module of testing plans development. You can generate a testing hierarchy compatible with a requirements hierarchy. A detailed description along with the expected system state can be included in test cases.
  • Test lab – module used for combining tests in sequences and setting conditions for test launch. Depending upon the success of previous tests, you can schedule tests to launch or do it manually.
  • Defects management – applying the module, you can track the system of defects, and it is integrated with other modules; thus, you can register the defect in requirements, in test plan or in test lab modules.

Considering the above, we can make the following conclusions:

JIRA Zephyr is the preferred option for those who already use JIRA, as these systems are fully integrated. The advantage of this system is a convenient means of visualizing and collecting metrics and a relatively low price compared to similar products.

MTM is a very powerful tool, especially combined with Team Foundation Server. It has a number of unique features, allowing users to automate system tests, and conduct exploratory testing with simultaneous search of defects and the creation of test cases.

HP Quality Center is a professional product for control of test documentation. Its main advantage is a separate unit for monitoring requirements. It allows users to visualize and make transparent the coverage of requirements test cases; and easily manage the requirements for large and complex systems; however, the cost of the product is high.

More Posts

why-do-bugs-get-missed
17 April 2023,
by a1qa
4 min read
Why do bugs get missed? Learn the problems and tips to avoid them
Still, finding overlooked bugs after the app goes live? Let’s find out why this happens and how to fix it.
Quality assurance
Test automation
a1qa-articles
31 January 2023,
by a1qa
5 min read
Best of 2022 by executives: 8 most visited a1qa blog posts
Let’s look back and revisit the most visited a1qa articles of 2022!
Quality assurance
Test automation
qa-trends
12 January 2023,
by a1qa
4 min read
The future of software testing: top 4 impactful trends that will dominate in 2023
Consider the major industry trends for the upcoming year to know how to improve current QA strategies and stay ahead of the curve.
QA trends
Quality assurance
Test automation
test-automation
7 December 2022,
by Dileep Marway
3 min read
Release at pace with test automation: What, why, and how to measure success?
An automation-first approach is key to enhancing testing capabilities and increasing overall operational efficiency. However, I would suggest justifying its implementation, so that it can deliver the promised value.
Quality assurance
Test automation
what-is-a-culture-of-happiness
2 December 2022,
by Dileep Marway
3 min read
What is a сulture of happiness for a QA company?
Great culture drives employee engagement and satisfaction, contributes to an impressive work output, and improves organisational performance. But how do we build a culture of happiness? In this blog, I will share more on the answer to this.
Quality assurance
agile-qa
30 November 2022,
by Dileep Marway
3 min read
Agile QA – what is needed for greater flexibility and speed?
What should your QA team focus on to become truly agile, enable quality at speed, and contribute to lasting performance improvement? In addition to introducing test automation, I suggest considering shared responsibility for software soundness.
Agile
Quality assurance
interview-with-dileep
28 November 2022,
by a1qa
9 min read
Interview with Dileep Marway on a series of articles “Agility and speed: Supercharging your business strategies with QA”
We cooperated with the VP of Engineering and Quality at SHL to present you with a series of his blog posts on: culture of happiness, test automation, and Agile-driven QA. Happy reading!
Agile
Quality assurance
Software lifecycle QA
Test automation
optimizing-budget-with-qa
31 October 2022,
by a1qa
4 min read
Optimizing telecom budgets with QA outsourcing: everything you need to know. Part 2 
Welcome to Part 2 of our blog on QA outsourcing and optimizing telecom budget with it. Let’s delve deeper into the topic!
QA trends
Quality assurance
optimizing-budget-with-qa
27 October 2022,
by a1qa
4 min read
Optimizing telecom budgets with QA outsourcing: everything you need to know. Part 1
Learn how to optimize telecom’s quality assurance expenses by relying on a trusted QA partner.
QA trends
Quality assurance

Get in touch

Please fill in the required field.
Email address seems invalid.
Please fill in the required field.
We use cookies on our website to improve its functionality and to enhance your user experience. We also use cookies for analytics. If you continue to browse this website, we will assume you agree that we can place cookies on your device. For more details, please read our Privacy and Cookies Policy.