The portal is designed to engage employees of various companies in healthy lifestyle behavior. The registered employees get total health assessment based on their lifestyle and clinical measures (height, weight, age, blood pressure, etc.).
Once the assessment is performed, the system provides a user with his/her health age as compared to the chronological age and generates a comprehensive plan to improve the person's well-being. The plan is a complex guideline with a number of goals to achieve by the specified date. Once goals achievement is proved, an employee gets some points and is rewarded by his/her employer. In such a manner, employers motivate their staff to adhere to the healthy lifestyle.
Four dedicated teams were assembled at A1QA to complete the tasks: three of them ensured quality of web services and one ran tests on mobile devices.
The customer's main business objective was to have the product live within the shortest time possible.
The development of the portal is a continuous process. At the very start there was a single web service with a limited number of features. As time passed and user base increased, the product was scaled to the set of different components.
As a result, it grew into several interrelated products: a user's questionnaire, training courses and webinars promoting healthy lifestyle, an online health store, a health theme game, a mobile application. Each of the components had to be thoroughly examined and tested.
The portal is aimed at users from the world over so its content and UI objects are translated into multiple languages. A1QA performs localization testing to check the localized versions for all culture and locale settings.
Further on, the portal acquired responsive design to provide top-notch user experience. In this context, QA team had to run UI testing.
Active application of the CMS like system to manage the contents of the website attracted lots of white label partners. This enhanced the customer's stature due to the extensive advertising campaign by one of the WL partners and led to the increase of testing required.
When assuring quality of a healthcare domain software, it's integral that the team understands all specific regulations set force by the Health Insurance Portability and Accountability Act (HIPAA), which defines standards for safeguarding sensitive and confidential data.
All A1QA engineers on the project were HIPAA-certified specialists. To ensure full compliance with HIPAA, they took the regulations into account when creating testing plan and strategy.
The product's complexity determined the necessity to perform testing in 27 environments and against various mobile platforms and operating systems.
While testing, A1QA engineers used custom-developed tools to prepare test data, emulate real-life scenarios, and save time.
MOBILE AND WEARABLE APPS TESTING
Later on, the customer asked A1QA engineers to address mobile app testing as well.
Our team started with ensuring quality of two mobile applications (1 for iOS and 1 for Android). Nowadays the number of applications tested and released monthly has increased to 8 apps.
Every application is designed for different clients, which became possible due to white labeling (the same code base is used for different applications and specific features can be turned on/off for different clients).
All testing is performed using real mobile and fitness devices to prevent emulation programs issues.
To pick right set of mobile devices for testing, A1QA team collects statistics of the device usage worldwide (using Google Analytics) and assembles the device matrix. The selected approach is very flexible: once additional coverage is needed, additional devices can be added.
A1QA has implemented flexible test automation solution that covers 95% of checks without any tool limitations and easily maintains the scripts in case of product changes. It helps to save up to 40% of manual testers' efforts during regression testing, as well as providing results faster for critical features. The solution implementation has reduced costs of testing.
Mobile apps are integrated with Google/Apple Maps, Foursquare, HealthKit, Google Fit, Apple Watch, such applications as Calm and Headspace.
The portal itself is integrated not only with a native mobile application but also with different third party services:
- Google Analytics
- Map My Fitness
Integration quality is verified by A1QA team on a regular basis.
To optimize the testing processes, QA consultants from A1QA have been addressed. They've investigated the testing process, analyzed all QA artifacts, and have developed comprehensive recommendations. Once implemented, the recommendations have significantly contributed to the testing process optimization.
A1QA consulting specialists have delivered the following works:
- Formulated testing strategy, test model management strategy, and incidents response strategy.
- Developed key testing efficiency indicators.
- Defined responsibilities, roles, and duties of different team members.
- Established release cycle and built completion process.
- Suggested corrective and preventive measures.
- Assembled probable risks register and developed measures to address them.
- Functional Testing
- Mobile Application Testing
- Compatibility Testing
- Localization Testing
- Test Automation
- QA Consulting
- Integration Testing
TECHNOLOGIES & TOOLS
- Atlassian JIRA
- Atlassian Confluence
- Oracle Database
- VMware Workstation
- MS Internet Explorer
- Mozilla Firefox
- Google Chrome
- Apple Safari
- Apple iOS
- Microsoft Windows
CHALLENGES AND SOLUTIONS
The product has been developing for 5 years by distributed teams from different countries and continents. The process was poorly organized and QA importance was hugely undervalued. Before the A1QA team got on board, the compliance with tight deadline was given a higher priority than the quality of the delivered works.
Therefore, A1QA specialists encountered the number of bottlenecks, but managed to provide successful solutions.
Development team didn't allow enough time for QA, which led to missing deadlines:
- Spent time tracking
- Planning with all parties involved (QA, UAT, 3rd party services)
- Requirements testing & story enter criteria introduction
- PDCA cycle implementation for estimation process
- Risk management implementation.
Low quality of the product:
- Story exit criteria introduction
- Expected level of quality defined
- Transparent deployment process
- Quantitative management implementation.
Production environment specific issues:
- Up and running of Staging environment with the same configuration as Production to catch environment specific issues before Production deployment.
Fast growth of the team:
- Squadification as a team structure adjustment
- Regular cross-training
- Knowledge base creation
- Standard knowledge transfer plan for newcomers.
Need to develop quality management principles:
- Statistics collection
- Quality metrics development.
Huge amount of test cases to manage:
- Using TestRail instead of separate Google Docs for test cases.
Lack of mobile testing devices:
- Purchasing of specific devices to run test only on real devices and not emulators.
25QA engineers on the project (the team has increased more than six fold)
3mln of unique end users
17000test cases in the product size
400man-months in efforts