Case Studies

Compatibility Testing Projects

Independent Testing of Online Movie Website and Mobile Apps

The customer, powerful player on the online movie market, addressed A1QA to perform independent and impartial testing of the website, Android and iOS apps, detect bottlenecks, and assess the customer's QA workflow efficiency.
Read more

PROJECT OVERVIEW

A1QA allocated six specialists to assure the overall quality of the products: test manager, four QA engineers and one security testing specialist.

All in all, they completed three rounds of testing setting up 80+ test environments and selecting 30 mobile devices for testing. After every round, the detailed report was submitted to the customer.

The main focus was on payment transactions and free/paid videos access level testing.

Compatibility testing against various platforms and browsers also was given special attention, as the customer wanted to make sure the video content could be accessed regardless of the users' devices.

The project was completed entirely on time and within budget. Based on the results of testing and QA workflow assessment, the customer decided on reorganization of the in-house QA processes.

SERVICES OFFERED

Functional testing
UI testing
Mobile application testing
Security testing
Compatibility testing

CHALLENGES

SOLUTIONS

Access to some video content was allowed only from certain countries or geographic regions. Prices and payment options also differed depending on the user's geo location
  • To bypass video region restrictions and unblock geo restricted methods of payment, QA team used special tools to spoof their geo location. By doing this, they managed to verify all payment methods and check accessibility of the video content depending on the user's geo location settings.
It was vital to verify checkout flows and test payments for security and usability
  • Three different bank cards were provided by the customer to perform testing of various payment scenarios.

TECHNOLOGIES USED

RESULTS

Complex Testing of Wellness Portal and Mobile Apps

A1QA was approached to perform complex testing of the online wellness portal and mobile applications. The product was designed to engage employees of various companies in healthy behaviour.
Read more

PROJECT OVERVIEW

The portal was a continuously developed project and contained the following functionalities: user's questionnaire, training courses and webinars, online health store, health-theme game, and mobile application. Each of the components had to be thoroughly tested.

To perform all the tasks, A1QA assigned 4 distributed teams: 3 teams assured quality of web products, while the 4th one was involved in mobile testing.

All QA engineers on the teams were certified HIPAA specialists.

A1QA implemented flexible test automation solution that covered 95% of checks without any tool limitations and easily maintained the scripts in case of product changes. It saved up to 40% of manual testers' efforts during regression testing, as well as helped to deliver results faster for critical features.

As the product's content and GUI was translated into multiple languages, A1QA performed localization testing.

The portal was integrated with multiple third party services: Google Analytics, Map My Fitness, Salesforce, Amazon, Hyatt, Gyft, Vindicia, etc. It was also A1QA's duty to assure quality of all integrations.

SERVICES OFFERED

Functional testing
Mobile testing
Compatibility testing
QA Consulting
Test automation
Localization testing
Integration testing

CHALLENGES

SOLUTIONS

Huge amount of test cases to manage
  • Using TestRail instead of separate Google Docs for test cases
Low quality of the product
  • Story exit criteria introduction
    Expected level of quality defined
    Transparent deployment process
    Quantitative management implementation
Fast growth of the team
  • Squadification as a team structure adjustment
    Regular cross-traning
    Standart knowledge transfer plan for newcomers
    Knowledge base creation
Lack of mobile testing devices
  • Purchasing of specific devices to run test only on real devices and not emulators

TECHNOLOGIES USED

RESULTS

Quality Assurance for Virtualization Technology Company

The virtualization technology company delivering automation solutions for hosting providers addressed A1QA to join the in-house testing team in assuring quality of the key business products.
Read more

PROJECT OVERVIEW

The customer had three automation platforms that allowed small hosters and large telecommunication enterprises to go to market with speed and at a competitive cost. A1QA specialists were responsible for testing all of the company's key solutions.

At A1QA we assembled the dedicated team that fully committed to the project needs. Initially there were two software testing engineers from A1QA side.

The project lasted for more than 2 years and as A1QA specialists proved their professionalism and deserved the customer's confidence, the team was scaled to 8 specialists.

All testing deliverables (reports, bugs, etc.) were documented in details. A1QA regularly reported on the status of the performed works.

A1QA responsibilities included the following:

- Processing the end users' trouble tickets (reproducing defects in test environment, defining whether the problems were on the end user's or customer's side, submitting defects and checking their fixing);

- Hotfixes testing (checking that all hotfix defects were eliminated; validating that the hotfix could be correctly installed without crashing the app);

- Assuring quality of 4 major releases and over 10 minor releases.

SERVICES OFFERED

Functional testing
GUI testing
Cross browser testing
Integration testing
Web services testing
Hotfix testing

CHALLENGES

SOLUTIONS

From time to time the customer asked to scale the team and assign new specialists with the right set of skills within tight timeline. Each candidate for the project was expected to prepare a CV and have an interview with the customer.
  • We gathered all customer's requirements and started to train specialists for the project's needs in advance. By doing this, we ensured a number of extra specialists who could join the project in no time upon request.
It was challenging to obtain the data we needed for QA due to the obstructed communication with the customer's distributed team.
  • To get the information we needed to complete testing activities, we identified contact persons on the customer's side and addressed them when it was needed.
The customer's workflow differed from the generally accepted.
  • Our specialists displayed flexibility and harmoniously fit into the customer's workflow.

TECHNOLOGIES USED

RESULTS

Complex Testing and QA of Social Gaming Products

The customer, developer of world-class mobile games, approached A1QA to assure quality of his hybrid back-office application which consisted of four main parts.
Read more

PROJECT OVERVIEW

The primary task was to improve laborious and time-consuming regression tests that were performed in different environments. Another key objective was to constantly maintain high quality of the app and monitor the consistency of all testing environments.

Within the project framework, A1QA experts tested new features of the application, performed automation of the regression testing, run ad hoc and destructive testing.

To accomplish the set goals, A1QA provided the customer with mobile testing dedicated team that adapted to the customer's agile process and operated as a fully functioning internal team.

The customer was completely satisfied with the ongoing results and prolonged cooperation with A1QA that continues until now.

SERVICES OFFERED

Mobile testing
Web application testing
Functional testing
Test automation
Compatibility testing

CHALLENGES

SOLUTIONS

Permanent need to augment testing team
  • We made a dedicated team equipped with the relevant skills and tools. The team was scaled upon every customer's request
Time difference
  • We worked out convenient schedule adapted to the customer's working hours
Strict customer's requirements to mobile testing specialists
  • We developed a training course for would-be mobile testers to meet all customer's needs

TECHNOLOGIES USED

RESULTS

Complex Testing of a Mobile Network Operator’s Website

The customer approached A1QA for independent testing and evaluation of the product before deployment to the production platform. The project involved development of a self-service environment on the Internet to provide qualified online support for individual and corporate clients.
Read more

PROJECT OVERVIEW

The customer is an Estonia-based mobile network operator offering a wide range of services that can be activated via the Internet. The customer approached A1QA for independent testing and evaluation of the product before deployment to the production platform.

The project involved development of a self-service environment on the Internet to provide qualified online support for individual and corporate clients.

The main task of the QA team was to test and analyze the quality of the product by various criteria and carry out an expert evaluation to determine if the product is ready for public use.

SERVICES OFFERED

Perform functional testing
Test GUI
Test product localization
Perform security testing
Run сompatibility testing
Conduct аccessibility testing

CHALLENGES

SOLUTIONS

Client demanded detailed reports
  • Сompose customer-tailored reports after each testing phase
Insufficient technical documentation
  • Study system and develop user manuals and supporting documentation
Poorly established testing approach
  • Set up and implement test and bug-tracking system

TECHNOLOGIES USED

RESULTS

Complex Testing of a Community Portal

Before launching the portal the customer approached A1QA to evaluate the quality of service.
Read more

PROJECT OVERVIEW

The client developed an online Community Portal for customers and stakeholders aimed at helping businesses succeed by bringing together innovations and ideas. Before launching the portal the customer approached A1QA to evaluate the quality of service. The major business objectives were to provide positive user experience, accelerate time to market and deliver multifunctional portal for business development and increase client data-base.

SERVICES OFFERED

Perform functional testing
Test GUI
Run cross-browser testing
Perform security testing
Conduct load testing
Run stress tests

CHALLENGES

SOLUTIONS

Modules incompliant with customer requirements
  • Perform load and stress tests
Environment unstable under specific loads
  • Perform load and stress tests
Gradually implemented functionality
  • Test newly added features, test automation

TECHNOLOGIES USED

RESULTS

Acronis Backup and Recovery Products Testing

The major challenge was in shortage of development documentation on pilot projects. Another challenge was in testing UI with rare Asian languages and comparing functionality according to localization settings. Acronis also required testing builds on all available operating systems, vast number of server types and virtual machines.
Read more

PROJECT OVERVIEW

Acronis is a multi-million dollar private software company holding the leading spot in the data protection and disaster recovery solution market. Acronis serves over 175,000 corporate clients in 14 languages and 90 countries.

In order to minimize their production costs and speed up new products development they required additional technical resources that would facilitate the process, namely the Quality Assurance function.

The major challenge was in shortage of development documentation on pilot projects. The invited QA team had to investigate the functionality and identify the difference between defects and proper behavior on their own. Another challenge was in testing UI with rare Asian languages and comparing functionality according to localization settings.

Acronis also required testing builds on all available operating systems, vast number of server types and virtual machines. A1QA demonstrated outstanding performance and found by 30% more defects than Acronis’ internal QA team and the previous QA outsourcing partner did.

SERVICES OFFERED

Perform full-cycle testing of all Acronis products in line

CHALLENGES

SOLUTIONS

Shortage of development documentation
  • Investigate of product functionality
  • Identify product behavior defects
14 different languages applied in UI
  • Perform localization testing for validation country-specific parameters
  • Perform usability testing
Client required product testing on all available OSs, a number of servers & virtual machines
  • Conduct compatibility testing across all Windows-based systems, Linux versions

TECHNOLOGIES USED

RESULTS

TESTIMONIAL

“Our dedicated team at A1QA is very competent and responsive. Not once did they provide help and worked longer hours when we had emergency at our end. Their feedback on our test models is always detailed and valuable. And we are more than happy with the testing quality.”

Serge Storozhenko,

QA Lead, Acronis

Functional Testing of Social Network Application

The customer turned to A1QA to verify the quality of the newly developed application.
Read more

PROJECT OVERVIEW

The customer developed a social networking app and site with geolocation features. Users can find people in the defined range with the help of search filters.

The customer turned to A1QA to verify the quality of the newly developed application. The main business objectives were to launch new application to the market and increase client loyalty.

SERVICES OFFERED

Perform functional testing
Run acceptance tests
Execute compatibility tests

CHALLENGES

SOLUTIONS

Poorly defined testing plan
  • Develop testing roadmap
Constant changes in the developed app
  • Adjust testing strategy
Lacking information about planned graphic interface
  • Research requirements

TECHNOLOGIES USED

RESULTS

Functional Testing of OSS Solution for VOIP Provider

A1QA was engaged to test the quality of five main modules of the OSS system.
Read more

PROJECT OVERVIEW

The customer - a leading provider of IP communications services - engaged A1QA to test the quality of 5 main modules of its OSS system.

The main purposes were to improve business process planning and support internal customer services.

SERVICES OFFERED

Perform manual functional testing of 5 main OSS modules
Run regression tests
Analyze business logic of the project

CHALLENGES

SOLUTIONS

Complex business logic on the project
  • Conduct detailed system research
  • Communicate with the developer's team
  • Conduct detailed analysis of new business logic
Large number of regression defects
  • Perform multiple equal tests
Constantly changing project goals and objectives
  • Align testing roadmap with the introduced changes

TECHNOLOGIES USED

RESULTS

Complex Testing of a Corporate Web Portal

A1QA was engaged to do performance testing in order to improve the software quality.
Read more

PROJECT OVERVIEW

The customer developed a corporate web portal aimed at monitoring healthcare activities. The web portal is integrated with a mobile application and fitness gadgets.

A1QA was engaged to do performance testing in order to improve the software quality. Crucial points were to increase the number of QA engineers, improve in-house team knowledge, set up QA processes and grow client loyalty.

SERVICES OFFERED

Run functional tests
Validate cross-browser compliance
Execute cross-platform testing
Test automation
Run load tests

TECHNOLOGIES USED

RESULTS