End-to-end test automation in just 11 hours with 95% plus test coverage

Client Overview

US based leading manufacturer that produces residential and commercial water heaters and boilers, as well as heating, ventilating and air conditioning equipment delivering a new level of efficiency, convenience and comfort to users.

Business Challenge

The client was facing delays in design release to production due to manual testing process. For the same, they wanted a solution that could automate and streamline the testing process with maximum test coverage and expedite their releases
Also, manual testing seemed challenging and reduced testing efficiency with the large volume of devices (100K+) being produced

VOLANSYS Contribution

Developed test automation tool for client by leveraging Robot framework (python based) to automate testing for mobile to end device and vice versa
- Mobile Application (Android & iOS)
  - Functional testing
  - UI testing
- End devices
  - Functional testing
AWS Device Farm integration with automation suite that allows execution of the suite on wide range of devices covering various OS versions
and screen resolution for robust testing
Executed 1100+ test cases (95% plus coverage) for various water heater devices
- Test case management using TestRail
- Maintain release in BitRise
- Scheduled Build trigger in Jenkins
- AWS S3 bucket integration for reports
Support to add multiple devices for testing within the automation framework that reduces test cycles and execution time
Cloud API automation using Postman to validate cloud response on every deployment cycle on respective environments based on Jenkins Auto
build trigger configuration
Performance testing using Python and Locust by writing test scenarios in Python code on around 120k devices on AWS EC2 instances
Generated test reports in HTML, XML format for mobile, end devices using Robot framework and for cloud using Newman reporter

Technologies | Engineering Expertise

Solution Architecture

Mobile -End device testing

Mobile <–> End device testing

Cloud API automation

Cloud API automation

Benefits Delivered

Enhanced productivity – achieved 95% plus test automation coverage across devices, mobile application, and cloud
Faster time to market – Test Automation enabled to design custom test environment and complete the entire QA cycle in 11 hours which was previously 4 days

Reduced QA cycle from 4 days to just 11 hours with coverage of 95% plus test cases using Test Automation

Reduced QA cycle from 4 days to just 11 hours with
coverage of 95% plus test cases using Test Automation