TestArchitect Corner: Platform Variations

To adapt with the fast software delivery pace in today’s world, the same automation test suites should be able to run on a range of various platforms: different Operation System versions, different Application under test versions, different localization versions, etc. All while keeping the test development and maintenance effort at the minimum.

However, in the testing field, we cannot simply evolve the tests to adapt to changing AUTs and environments, then leave the past behind. That is to say, every time we adapt a test to a change in a system or platform, we do not necessarily have the luxury of discarding the previous test. Multiple systems and platforms tend to remain valid as testing configurations. And taken together, these factors can combine to form a complex matrix resulting in a very large number of valid testing scenarios.

Take for instance, a commercial application that has gone through several upgrades (each of which remains on the market), has been localized for four different language environments, and has been designed to operate with the last four generations of the Windows operating system. A graphical representation of all the resultant possible testing scenarios might look like the following, in which each intersection of lines represents a different configuration.

Ta corner cube

TestArchitect, however, uses two types of variations which address the problem of requiring multiple test configurations. TestArchitect allows different versions of any given actions, interfaces, or data sets to coexist with each other and they are needed by your test for the particular combination of application version, operation system, environment, localization, and more, that your project may be called on to test.

The implementation of variations in TestArchitect takes two forms: linked variations and keyword variations.

Linked variations are the preferred method for addressing what might be termed progressive variability. This is the kind of variability that comes from continuous development or improvement of some aspect of the system/platform mix, such as progressive versions of the AUT itself, or progressive versions of an operating system in which the AUT runs. Linked variations are appropriate when the various versions of a system or platform can be depicted graphically in either a linear form or tree structure. For example, imagine a Car Rental application that has gone through several cycles of development, so that the version history takes this tree form, as is typical in software development:

System and Platform tree

ta corner tree

ta corner tree2

Linked variation of action ‘back to home’

Keyword variations, by contrast, are perhaps most appropriate when we can define certain categories of distinctions between different system/platform mixes, where the differences are not due to any progressive development or refinement of any aspect of the mix. Different “flavors” of an application, such as different language versions, are a good candidate for keyword variations, as are other localization-based differences, such as differences in date formats, currencies, physical units, etc. Another possible keyword group might involve different market editions of the application, such as a student edition, personal edition, small business edition, or enterprise edition.

ta corner tree3

Variation of action ‘login’ to work on edition ‘enterprise’ and language ‘spanish’

Thanks to variations, beside the default environment, the same test suites can now run on Application under test version 1.1 and 1.2, and/or enterprise edition, and/or Spanish language. The test modules just contain keyword test steps and leave the environment factors for the settings at execution time.

Ta module

ta corner test run

LogiGear Corporation

LogiGear Corporation provides global solutions for software testing, and offers public and corporate software-testing training programs worldwide through LogiGear University. LogiGear is a leader in the integration of test automation, offshore resources and US project management for fast and cost-effective results. Since 1994, LogiGear has worked with hundreds of companies from the Fortune 500 to early-stage startups, creating unique solutions to exactly meet their needs. With facilities in the US and Vietnam, LogiGear helps companies double their test coverage and improve software quality while reducing testing time and cutting costs.

For more information, contact Joe Hughes + 01 650.572.1400

LogiGear Corporation
LogiGear Corporation provides global solutions for software testing, and offers public and corporate software testing training programs worldwide through LogiGear University. LogiGear is a leader in the integration of test automation, offshore resources and US project management for fast, cost-effective results. Since 1994, LogiGear has worked with Fortune 500 companies to early-stage start-ups in, creating unique solutions to meet their clients’ needs. With facilities in the US and Viet Nam, LogiGear helps companies double their test coverage and improve software quality while reducing testing time and cutting costs.

The Related Post

December Issue 2019: Tester Profile – Real World Stories
Much has been written over the past few years about SMAC—Social, Mobile, Analytics and the Cloud—as the new platform with exponential growth. In this article we will answer the question: what is this and what does it mean to software testing? What is SMAC?
Budget-friendly planning and management tools—plus a few others. I have been researching sources of test tools and other resources that are inexpensive or free. In some cases, you get what you pay for. However, it is possible to automate some or a lot of your testing using these tools. The good news is that the ...
Check out the top 12 Automation tools with pros and cons–like Cross-Operating Systems, Cross-Automation Platforms, Programming Language Support, and more – for desktop Automation Testing. Although the demand for desktop app testing is not growing as fast as mobile and web app testing, it’s still a crucial day-to-day duty for many testers, especially those who ...
In today’s retail marketplace, digital channels hold a prominent and often central position. Modern software practices emphasize the need for rapid development and deployment. The retail world is no exception to this need for speed. Continuous Testing is a great strategy for getting increasing velocity.
What is Automated Test and Retest (ATRT)? IDT’s ATRT Test Manager addresses the complex testing challenges of mission critical systems by providing an innovative technical solution that solves the unique testing problems associated with this domain.It provides an integrated solution that can be applied across the entire testing lifecycle.
With the new release of Selenium late last fall, it was viewed as a saving grace to many test teams. The launch of the upgrade came with the bonuses and testing tools most had been waiting for, but unfortunately there was still a kink in Selenium’s armor: the Firefox browser.
 A clear practice with the support of tools will help teams be more successful in delivering done products. It is always challenging to create a piece of a software system that fulfills a customer need, ready for use. Especially when it should be realized in an iteration of just three weeks, from an idea to ...
D. Richard Kuhn – Computer Scientist, National Institute of Standards & Technology LogiGear: How did you become interested in developing applications for combinatorial research? What led you to it personally, and what did you find fascinating about it? Mr. Kuhn: About 12 years ago Dolores Wallace and I were investigating causes of software failures in ...
The pervasive use of Agile methodologies has changed the way that development teams work. With this change, new tools and vendors have entered the traditional application life-cycle arena. A recent evaluation of this trend was published by Forrester Research, the “Agile Development Managements Tools Forrester Wave” report. Key observations of the report: Tools have changed ...
A tool empowering you to reach your automation successIn case you haven’t heard, earlier this month we launched TestArchitect Team, the new, free, test automation tool that empowers testers to achieve automation success.

Leave a Reply

Your email address will not be published. Required fields are marked *

Stay in the loop with the lastest
software testing news

Subscribe