TestArchitect Corner: How to Use Jenkins in TestArchitect

Jenkins is a Continuous Integration (CI) tool that controls repeatable tasks in software development. Check out this guide to see how TestArchitect seamlessly integrates with Jenkins to establish a CI environment for Automated Testing.

With the rising popularity of Continuous Integration/Continuous Delivery (CI/CD), Continuous Testing (CT) is becoming a hot topic for discussion. Knowing that comprehensive tests are running smoothly is highly beneficial for the CI/CD pipeline; but, running tests can be both times- and resource-consuming—not to mention that tests can become boring and rigid! Using the repetitive characteristics of CI/CD and applying them to testing can be a way to address this.

A key component of Continuous Integration (CI) is the frequent running of automated tests to catch potential bugs as soon as they are introduced in the development process. The CI software life cycle involves a process of coding, building, testing, and bug-fixing, often at a rate of several iterations per day.

Most CI systems allow for much of this cyclic process to be automated: Code commits can be set to trigger software builds, build completion can trigger Automated Testing, and test results can be rapidly compiled, processed, and reported to allow bugs to be addressed in the coding process.

TestArchitect supports integration with all CI/CD tools––as long as the tools support command-line interfaces (CLI).

How to Integrate TestArchitect with Jenkins

Jenkins is a Java-based, open-source Continuous Integration (CI) tool that controls and monitors the execution of repeatable tasks in software development. TestArchitect incorporates features that allow it to be readily integrated into a Jenkins-based CI environment.

A typical Jenkins-based CI environment with integrated TestArchitect involves the following components:

  • Software development workstations with a common source control server such as SVN or CVS.
  • A Jenkins master server to manage the CI process.
  • One or more test execution machines. Each machine must be set up as both a TestArchitect controller and Jenkins slave.
  • At least one machine with TestArchitect installed to:
    • Allow for the development of tests in TestArchitect Client,
    • Provide a repository for test-related project items such as test modules and results, and
    • Generate execution batch files for the test controllers.

Note that TestArchitect may be installed on a Jenkins slave, but not on the Jenkins master.

Creating a Batch File

To establish a connection between TestArchitect and a Jenkins server, a batch file that includes executed test modules is required.

1. Select a test module or test folder for execution, then click Execute on the toolbar.

2. In the Execute Test dialog box, click the Advanced Settings tab.

3. Select the Export result(s) to xUnit checkbox.

4. Click to specify the path where the XML file is to be saved.

5. In the Open dialog box, specify the path to the Jenkins slave workspace.

  • Note:
  • The Jenkins master machine is responsible for controlling and monitoring executed jobs on slave machines.
  • Jenkins slave machines are responsible for executing jobs.

6. Click Open.

  • The specified installation path now appears in the Select a destination folder text box.

7. Click Generate Batch File.

  • The Creation of a batch file complete message appears, letting you know that the batch file creation was successful.

Importing the Batch File

1. On the Jenkins dashboard, select New Job.asd

2. Enter a Job name and select a project category.

3. Click OK.

  • The Config page appears.

4. In the Build section, click the Add build step.

5. In the drop-down list, select Execute Windows batch command.

6. Enter the path to the batch file in the Command text box.

  • Note: The batch file must be stored on the Jenkins master machine. You must copy the generated batch files on the Jenkins slave machines and paste them into the Jenkins master machine.

7. In the Post-Build Actions section, click Add post-build action.

8. In the drop-down list, select Publish JUnit test result report.

9. Enter *.xml into the Test report XMLs text box to specify that all XML files related to executing test modules are to be selected.

10. Click Save.

TestArchitect Support Team
We are the TestArchitect Support team who will help you achieve Automation success. Creating a few dozen automated test cases is easy. Maintaining them overtime while scaling your test suite to thousands of tests is not. It needs the right mix of tools, methods, and expertise.

The Related Post

This article was developed from concepts in the book Global Software Test Automation: Discussion of Software Testing for Executives. Introduction There are many potential pitfalls to Manual Software Testing, including: Manual Testing is slow and costly. Manual tests do not scale well. Manual Testing is not consistent or repeatable. Lack of training. Testing is difficult ...
The growing complexity of the Human-Machine Interface (HMI) in cars offers traditional testers an opportunity to capitalize on their strengths. The human-machine interface (HMI) is nothing new. Any user interface including a graphical user interface (GUI) falls under the category of human-machine interface. HMI is more commonly being used to mean a view into the ...
“Happy About Global Software Test Automation: A Discussion of Software Testing for Executives” Author: Hung Q. Nguyen, Michael Hackett, and Brent K. Whitlock Publisher: Happy About (August 1, 2006) Finally, a testing book for executives!, November 17, 2006 By Scott Barber “Chief Technologist, PerfTestPlus” Happy About Global Software Test Automation: A Discussion of Software Testing ...
I got some comments on my post “Test Everything all the Time” — most notably people commenting that it’s impossible to test “everything”. I can’t agree more. The intention of the post was to make the point that we need to be able to test “everything we can” all the time. That is, you should ...
As I wrote in various articles, organization is one of the 3 key requisites for successful automated testing, the other two being test design and automation architecture.
For those that are new to test automation, it can look like a daunting task to undertake For those who are new to Automation, it can look like a daunting task to undertake, but it only seems that way. If we unpack it and pinpoint the fundamentals, we can have the formula for the desired ...
5 roadblocks in vehicular autonomy that complicate Software Testing Experts in the field have previously referred to air travel as somewhat of a gold standard for autonomous vehicle safety, but after Boeing’s two tragedies, that analogy can no longer be used when talking about self-driving cars. This was after Boeing’s 737 MAX Jets have found ...
Having the right Test Automation plan helps bridge gaps and fragmentations in the complex mobile environment. Figuring out the best Test Automation plan is one of the biggest frustrations for today’s digital teams. Organizations struggle to develop cross-platform Test Automation that can fit with their Continuous Integration cadence, their regression cycles and other elements of ...
Regardless of your current state of tools, building an effective Continuous Integration suite of significant automated regression tests is the key to moving to a higher level of confidence in today’s development world. In the evolution timeline of software development tools, new tools have recently proliferated. We have all been sold on collaboration, transparency and ...
In order to make the right choices among tools, you must be able to classify them. Otherwise, any choice would be at best haphazard. Without functioning classification, you would not be able to understand new tools fast, nor come up with ideas of using, or creating new tools.
All too often, software development organizations look at automating software testing as a means of executing existing test cases faster. Very frequently there is no strategic or methodological underpinning to such an effort. The approach is one of running test cases faster is better, which will help to deliver software faster. Even in organizations that ...
From cross-device testing, to regression testing, to load testing, to data-driven testing, check out the types of testing that are suitable for Test Automation. Scene: Interior QA Department. Engineering is preparing for a final product launch with a deadline that is 12 weeks away. In 6 weeks, there will be a 1 week quality gate, ...

Leave a Reply

Your email address will not be published. Required fields are marked *

Stay in the loop with the lastest
software testing news

Subscribe