SUCCESS STORY

Automated over 2000 test cases to significantly reduce regression test time using TestArchitect. Achieved end-to-end integration using Microsoft’s Team Manager

Industry

Oil & Gas

Country

United States

Company size

45.000 employees

Website

https://www.halliburton.com

About Halliburton

Halliburton Company is an American multinational corporation and the world’s second largest oil service company and responsible for most of the world’s largest fracking operations. The company helps customers maximize value throughout the lifecycle of the reservoir – from locating hydrocarbons and managing geological data, to drilling and formation evaluation, well construction and completion, and optimizing production throughout the life of the asset.

Industry

Gas & Oil

Country

Us

Company size

45.000 employees

Website

About Halliburton

Halliburton Company is an American multinational corporation and the world’s second largest oil service company and responsible for most of the world’s largest fracking operations. The company helps customers maximize value throughout the lifecycle of the reservoir – from locating hydrocarbons and managing geological data, to drilling and formation evaluation, well construction and completion, and optimizing production throughout the life of the asset.

The Challenges

Halliburton’s product enhancement (PE) software technology organization develops critical internal enterprise software. The business unit’s two major software products are developed on a Windows platform using the .NET framework. This software is extremely complex with a rich user interface, vast source code, and N-Tier architecture.

The PE software technology organization has employed Agile practices for several years and recently implemented Continuous Integration and Deployment. Major updates demanded running the full regression suite, which took approximately 8-10 weeks to complete.

Multiple process management platforms between functional roles were hampering collaboration among Agile teams. The development team was using Microsoft’s Visual Studio 2012 for source control. Scrum Masters and product managers used TFS for user stories and bug management. In contrast, the test team used Hewlett Packard’s Quality Center (QC) for test management, execution, and status reporting. The separate platforms made it difficult for teams to keep track of the latest changes which often resulted in duplicate tests that had been run in unit testing, or failing to run needed tests. The lack of a single product traceability matrix for requirements, code tests, and bugs also impacted the teams’ effectiveness. However, the most crucial issue was that automation coverage decreased with each new build after initial success due to the amount of maintenance work required to keep the automation scripts up-to-date.

The vision for Halliburton was to implement a completely integrated development and test environment, including:

  • Implementing Test Automation without impacting Project Schedules
  • Training the test team globally on Action Based Testing (ABT) method, Microsoft Test Manager (MTM) and TestArchitect
  • Migrating manual tests from QC to MTM by recreating them using ABT
  • Creating detailed status reports that include images and log files on failure
  • Automating and certifying manual tests before moving into production
  • Clearly defining a workflow between the manual and automation teams
  • Running tests unattended by auto-deploying the execution as a part of the build definition

The Solutions

The initial task was to identify tests that would be the most beneficial to automate. All 3,000 test cases were audited and 600 were selected for the initial automation effort. The automation work, which included designing and creating tests implementing the ABT method, was outsourced to LogiGear.

LogiGear started the automation effort by creating custom actions in the TestArchitect action library that were unique to PE software. At the same time, the PE team worked to customize MTM and TestArchitect so that there would be a seamless workflow between the two tools.

From business-level actions, automation engineers created and stored tests in TestArchitect’s repository. Testers could then select individual tests for manual testing or create a full automation suite to run using the association feature – a TestArchitect plug-in that installs in MTM to connect the test repositories.

The final stage of the integration project involved the migration of all remaining manual tests from QC to MTM. Ultimately, they were re-designed employing the ABT method, and test migration was outsourced to LogiGear, after considering the cost and resource requirements.

The Results

Halliburton’s PE team set out to improve on Continuous Integration while achieving maximum test coverage with highly compressed release cycles that consisted of two-week sprints and multiple feature branches. After automating over 2,000 tests, the regression suite that formerly required 8 weeks could currently be completed in 5 hours utilizing a combination of 17 virtual and physical machines.

Additionally, by changing to the ABT method, the average time to develop and execute a single verification test was reduced from 3 hours to less than 10 minutes. The project was successful in achieving the objective of reducing the test team’s cycle to match the velocity of testing with development.

Related Success Stories

Country:

United Kingdom

Sped up ongoing feature development, ensuring the client stays at the forefront of innovation

Country:

Vietnam

A team of IT experts supported Techcombank in developing mobile applications and back-office applications

Country:

United Kingdom

Telecom Giant and LogiGear Increase QA Efficiency by 50% for Mobile App