Reduced QA cycle from 4 days to just 11 hours with
coverage of 95% plus test cases using Test Automation

Client Overview

US based leading manufacturer that produces residential and commercial water heaters and boilers, as well as heating, ventilating and air conditioning equipment delivering a new level of efficiency, convenience and comfort to users.

Business Challenge
  • The client was facing delays in design release to production due to manual testing process. For the same, they wanted a solution that could automate and streamline the testing process with maximum test coverage and expedite their releases
  • Also, manual testing seemed challenging and reduced testing efficiency with the large volume of devices (100K+) being produced
VOLANSYS Contribution
  • Developed test automation tool for client by leveraging Robot framework (python based) to automate testing for mobile to end device and vice versa
    • Mobile Application (Android & iOS)
      • Functional testing
      • UI testing
    • End devices
      • Functional testing
  • AWS Device Farm integration with automation suite that allows execution of the suite on wide range of devices covering various OS versions
    and screen resolution for robust testing
  • Executed 1100+ test cases (95% plus coverage) for various water heater devices
    • Test case management using TestRail
    • Maintain release in BitRise
    • Scheduled Build trigger in Jenkins
    • AWS S3 bucket integration for reports
  • Support to add multiple devices for testing within the automation framework that reduces test cycles and execution time
  • Cloud API automation using Postman to validate cloud response on every deployment cycle on respective environments based on Jenkins Auto
    build trigger configuration
  • Performance testing using Python and Locust by writing test scenarios in Python code on around 120k devices on AWS EC2 instances
  • Generated test reports in HTML, XML format for mobile, end devices using Robot framework and for cloud using Newman reporter
Technologies | Engineering Expertise

Robot Framework | AWS Device Farm | AWS S3 | AWS EC2 | Jenkins | TestRail | BitRise | Python | QA Automation

Solution Architecture

Mobile -End device testing

Mobile <–> End device testing

Cloud API automation

Cloud API automation

Benefits Delivered
  • Enhanced productivity – achieved 95% plus test automation coverage across devices, mobile application, and cloud
  • Faster time to market – Test Automation enabled to design custom test environment and complete the entire QA cycle in 11 hours which was previously 4 days
Similar Success Stories