Case Studies

Performance Testing Projects

Independent Audit of the Billing System Performance Testing

A large telecommunication company addressed A1QA to perform audit of the unified billing system performance testing.
Read more

PROJECT OVERVIEW

The customer’s business goal was to integrate the distributed telecom infrastructure into the unified billing solution. A new system should have withstood the load that was previously distributed among 25 subsystems.

To perform the task, A1QA assigned its leading performance testing engineer who had to review the testing process, detect the bottlenecks, check testing results for compliance with the customer’s KPIs and suggest recommendations for improvement. 

During the audit four major components that were vital for successful testing were reviewed: programing code, test methodology, test monitoring system and test results.

After four months of audit and review, the A1QA specialist detected over 100 of bottlenecks and offered recommendations for their elimination.

The efficiency of the proposed recommendations was also evaluated by the A1QA engineer after they were carried out.

Upon the project completion the audit results were presented to the company’s Board of Directors.

The Customer hugely appreciated the A1QA comprehensive and responsible approach and continued cooperation in other QA directions.

SERVICES OFFERED

Software testing audit
QA consulting

CHALLENGES

SOLUTIONS

Restricted access to servers and information related to the testing process and billing system
  • Prompt data access was ensured by the effective communication with 50+ employees on the customer’s side.
  • Timely addresses to the employees in charge via the most convenient means of communication, detailed discussion of all issues and quick feedback guaranteed getting of the informative audit results within the established time limits.

TECHNOLOGIES USED

RESULTS

Functional and Performance Testing of Integrated Data Tracking System

A1QA was asked to perform functional and performance testing of an internal tracking system.
Read more

PROJECT OVERVIEW

The system under test was aimed at tracking the activity of the e-commerce solution members on both the website and client's mobile applications. The solution contained offers of the most desired brands in women's and men's fashion, home, travel, kids, etc.

In terms of testing, it was represented by a set of databases with data collected and processed by special jobs. The data was stored in nonrelational database and was constantly exported to DWH (relational database) in the aggregated state.

A1QA was focused on testing the validity of the data that had been collected, processed and stored in the system. We checked that no information was lost, oversupplied or stored incorrectly.

In addition, A1QA tested the libraries that were integrated into the customer's website and collected information. The tracking system didn't have its proper UI. 

SERVICES OFFERED

Functional testing
Performance testing

CHALLENGES

SOLUTIONS

Not enough understanding of the data processing correctness
  • Functional testing and analyzing the process of the data collecting and storing
An absence of optimal testing approach to such a speciöc product
  • Creating an appropriate methodology and effective testing solution

TECHNOLOGIES USED

RESULTS

Complex Testing of E-commerce Website

One of the biggest online sellers of clothes, shoes, and home goods in the UK requested A1QA's assistance in website testing.
Read more

PROJECT OVERVIEW

The website under test presented over 500 famous brands in fashion, beauty, and home goods. It launched new big sales every day including discounts up to 70%. The website was managed by the Magento e-commerce platform.

The customer's main objective was to implement business requests from Marketing and Customer Support departments employees. At the moment the website is being expanded. Sales are increasing due to new functionality (new payment methods, expanding delivery options, etc.).

A1QA team worked with the following project specifics: CMS Magento, PayPal, Braintree, MySql, Google Analytics, Mixxit Media, SEKO Warehouse, Multiple Login, Qubit, integration with other online sellers, distributed team, and remote server management.

Throughout the project, scrum development methodology was introduced and significantly improved communication between team members.

SERVICES OFFERED

Functional testing
Performance testing
Test automation
GUI testing
Cross-browser testing
Mobile testing

CHALLENGES

SOLUTIONS

New website functionality (payment methods, delivery options, etc.) was not tested
  • Functional testing was performed
Lack of information about the website performance in different environments
  • The website was tested on 13 mobile devices and various operating systems

TECHNOLOGIES USED

RESULTS

Functional and Load Testing of a Knowledge Management System

The customer is a large system integrator specializing in business solutions.
Read more

PROJECT OVERVIEW

A1QA performed functional and performance testing before the customer presented the product to the end client. During the first part of the project (~13 months), A1QA team mainly focused on functional testing. During the remaining part of the project A1QA engineers shifted their focus to load testing.

The product under test was an electronic document management system for a credit department of a large commercial bank. The system consisted of several individual components running on separate servers.

It supported integration with other corporate systems of the bank and such business processes as conversion of documents to PDF, storing electronic versions of documents, work with confidential documents using a digital signature, etc.

SERVICES OFFERED

Perform functional testing
Run load testing
Test documentation creation

CHALLENGES

SOLUTIONS

No QA process in place
  • A1QA established a QA process that included: determining the reasons for defects that were difficult to reproduce, defining requirements that were not documented, creating high-quality test documentation and establishing effective communication with the customer
Negative feedback from the bank about the product quality
  • A1QA performed complex internal functional testing of the system before the builds were released
Lack of scripts for system optimization and load testing
  • A1QA prepared scripts to define system bottlenecks and find out methods of system optimization

TECHNOLOGIES USED

RESULTS

Multi-Platform Testing of a Web Conferencing System

A1QA was engaged to evaluate the system's quality before its release. The tested solution is a web-based conferencing system.
Read more

PROJECT OVERVIEW

The customer, a major producer of communications software, developed a web-based conferencing system. A1QA was engaged to evaluate the system's quality before its release. The tested solution is a web-based conferencing system.

SERVICES OFFERED

Perform functional testing
Test usability and GUI
Run performance tests
Conduct automation tests

CHALLENGES

SOLUTIONS

Poor resistance of audio components of the system
  • Run performance tests
System not supporting several OSs or Java machines
  • Perform GUI, usability and functional automated tests

TECHNOLOGIES USED

RESULTS

TESTIMONIAL

“Impressed with your ingenuity in testing and the ability to promptly react to changes in the environment. Flexibility, professionalism, persistence — that’s all about you.”

Alan Cooper,

R&D Manager

Performance Testing of a Bank’s Personal Loan Origination System

A1QA was asked to investigate problems and deliver an expert assessment of investments into the LOS architecture that would guarantee the required level of performance.
Read more

PROJECT OVERVIEW

A subsidiary of an international banking holding company and an EBRD partner with 290 offices and more than 400,000 clients urgently needed to update its personal Loan Origination System (LOS).

A1QA was asked to investigate problems and deliver an expert assessment of investments into the LOS architecture that would guarantee the required level of performance. Major points were to improve financial services and increase client loyalty.

SERVICES OFFERED

Perform stress testing
Test system resistance
Evaluate system recovery speed

TECHNOLOGIES USED

RESULTS

Functional Testing of a Payment System

The customer developed the online payment system and was on a hunt for an independent QA vendor with knowledge in BFSI domain to assess its quality. The client approached A1QA to face the challenge.
Read more

PROJECT OVERVIEW

The Payment Service Provider project was a part of a large business project for Internet credit card payments. From technical point of view, the system represented a web-based Java application.

The project was delivered with participation of German investors, acquiring bank, software development company, and A1QA performing independent QA services.

SERVICES OFFERED

Functional testing
GUI testing
Performance testing
Stress testing

CHALLENGES

SOLUTIONS

Poorly set up QA process
  • We’ve set up QA process, defined QA roles & responsibilities and introduce templates, reports & checklists.
Lack of proper technical documentation
  • We’ve thoroughly studied current documentation kit and created extensive documentation to be able to measure test effectiveness/coverage.
Miscommunication issues with remote teams
  • Our team has developed a communication map and built effective communication through various channels

TECHNOLOGIES USED

RESULTS

TESTIMONIAL

“This project was of great importance to us because we work with a very demanding group of customers that value their time and put the main emphasis on convenience and simplicity of online payments. We trusted A1QA with that job because they were very fast to provide us with a convenient working schedule and test scenarios for our ongoing project. Their testing procedures were very thorough time-efficient; so we managed to complete and launch the Payment Service Provider online project on time. We appreciate their efforts and would recommend A1QA to any respectable company.”

Dieter Disl,

Technical Director

Complex Testing of a Community Portal

Before launching the portal the customer approached A1QA to evaluate the quality of service.
Read more

PROJECT OVERVIEW

The client developed an online Community Portal for customers and stakeholders aimed at helping businesses succeed by bringing together innovations and ideas. Before launching the portal the customer approached A1QA to evaluate the quality of service. The major business objectives were to provide positive user experience, accelerate time to market and deliver multifunctional portal for business development and increase client data-base.

SERVICES OFFERED

Perform functional testing
Test GUI
Run cross-browser testing
Perform security testing
Conduct load testing
Run stress tests

CHALLENGES

SOLUTIONS

Modules incompliant with customer requirements
  • Perform load and stress tests
Environment unstable under specific loads
  • Perform load and stress tests
Gradually implemented functionality
  • Test newly added features, test automation

TECHNOLOGIES USED

RESULTS

Optimization of BSS OSS Solution

The client turned to A1QA to perform QA procedures for newly developed and optimized B/OSS solution modules.
Read more

PROJECT OVERVIEW

Customer is a Russian Telecom operator providing mobile services. The client turned to A1QA to perform QA procedures for newly developed and optimized B/OSS solution modules.

Crucial points were to launch new package of services, increase client loyalty and improve business processes.

SERVICES OFFERED

Perform testing of main system modules

CHALLENGES

SOLUTIONS

Cooperation within distributed team
  • Develop communication scheme
Large scope of testing procedures
  • Perform module, integration, system, automated, load, acceptance testing and mobile application check
Complex solution business logic
  • Develop end-to-end scripts to check business processes
Constantly changing requirements
  • Update testing strategy
Tight timeline
  • Quick and frequent releases

TECHNOLOGIES USED

RESULTS

Complex Testing of a Corporate Web Portal

A1QA was engaged to do performance testing in order to improve the software quality.
Read more

PROJECT OVERVIEW

The customer developed a corporate web portal aimed at monitoring healthcare activities. The web portal is integrated with a mobile application and fitness gadgets.

A1QA was engaged to do performance testing in order to improve the software quality. Crucial points were to increase the number of QA engineers, improve in-house team knowledge, set up QA processes and grow client loyalty.

SERVICES OFFERED

Run functional tests
Validate cross-browser compliance
Execute cross-platform testing
Test automation
Run load tests

TECHNOLOGIES USED

RESULTS