SUCCESS STORY

Increased coverage through automation testing using TestArchitect. Reduced 84% defects found in Beta and 97% issues found at product shipment

Industry

Gas & Oil

Country

Us

Company size

45.000 employees

Website

https://www.halliburton.com

About Halliburton

Halliburton Company is an American multinational corporation and the world’s second largest oil service company and responsible for most of the world’s largest fracking operations. The company helps customers maximize value throughout the lifecycle of the reservoir – from locating hydrocarbons and managing geological data, to drilling and formation evaluation, well construction and completion, and optimizing production throughout the life of the asset.

Industry

Gas & Oil

Country

Us

Company size

45.000 employees

Website

https://www.halliburton.com

About Halliburton

Halliburton Company is an American multinational corporation and the world’s second largest oil service company and responsible for most of the world’s largest fracking operations. The company helps customers maximize value throughout the lifecycle of the reservoir – from locating hydrocarbons and managing geological data, to drilling and formation evaluation, well construction and completion, and optimizing production throughout the life of the asset.

The Challenges

Landmark Graphics’ Decision Space Nexus, a cutting-edge reservoir simulation software suite, saw a shift in development practices as the Nexus team fully embraced Agile methodologies in a more structured Scrum environment. A crucial lesson learned was the necessity of an automated regression test suite for GUI functionality.

Before finalizing commitments, the team executed the development regression suite and relied on additional testing methods, including a customer regression suite, a manual smoke test, and exploratory testing. The developer regression suite proved effective, fostering confidence in check-ins. However, it failed to uncover issues in complex customer models, complicating matters as the customer regression suite demanded nearly a week for computation on a high-end cluster to determine test outcomes.

Moreover, subtle changes in data, algorithmic code, or processing environments led to inconsistent output results. Beyond the time-intensive nature of these tests, debugging issues in complex customer data posed significant challenges for the Nexus development team.

The Solutions

  • Engineered and built custom TestArchitect technology to support for these custom controls.
  • Ported over 1000+ WinRunner test scripts from previous automation implementations on OpenWells Core.suite.
  • Focused on provided both reusability, low levels of maintenance and high degrees of test case design transparency.
  • Once the basic set of technology was implemented into TestArchitect, LogiGear began the process of reviewing, porting and implementing tests inside TestArchitect.

The Results

  • Estimated and compared execution time to finish automated testing in WinRunner and in TestArchitect. Hence, automation testing using TestArchitect resulted in a 50% reduction in testing time.
  • Provided the tool that helped the Halliburton conduct strict and complete separation of automation test scripts and allowed them to change the underlying technology without affecting the test suites.
  • Assited Halliburton achieved savings in allowing testers to be freed up to do more deeper manual based test scenarios against real Halliburton data–or client provided real-time data.
  • Halliburton achieved savings by incrementally increasing the total number of tests inside their build acceptance regression process, where the more tests that are run against OpenWells nightly, the more issues can be found and decisions can be made on testability of the build.
  • Helped Halliburton release OpenWells faster to its end customer, allowed them to use OpenWells with their own set of data, thus improved adoption and integration with clients.
Image
Image

The Numbers

For the Classic OpenWells application, LogiGear was able to automate 1,095 test cases and find 241 bugs through the use of that automation. Both in build acceptance testing and subsequent test runs outside of the BAT. For the Rocket Project, LogiGear was able to automate 904 test cases, which resulted in 81 bugs that would have not been found otherwise through manual testing.

Halliburton was tasked with providing more releases to its OpenWells customers. They had been using WinRunner test automation for many years, and found it increasingly hard to scale especially when coupled with its lack of technology support for new OpenWells technology implementations. LogiGear was asked to provide a toolset and test design method using LogiGear’s product TestArchitect

You and the team are putting in a lot of extra effort running these two full OpenWells Classic regressions tests along with keeping up on new Rocket Test Case development ... and Halliburton has taken notice and appreciates this. I especially appreciate the way you have stepped in and taken over leadership of your team and the extra hours and effort you are putting in. Keep up the good work.

Dana Svendsen

Quality Manager at Open Wells