Letter from the Editor – February 2014

“Why do we need to understand a bunch of test methods? I write test cases from user stories or requirements, automate what I can and execute the rest manually, and its fine.” If this is your situation: good for you.

If you are time crunched, if your automated tests have lost relevance, are hard to maintain or regularly miss bugs, if you do not have useful and meaningful ways to confidently measure and report coverage and risk, if you are doing what you have always done, if you document too much, or document too little, if testing is “a mess”, if the dev teams do not trust your testing, if you wish there was a better way……then arming yourself with new test methods or examining the methods you currently use will, without a doubt, be beneficial!

In our continuing effort to be the best source of information for keeping testers and test teams current, we have dedicated this issue to exploring test methods. Learning test methods is core to a test engineer. These are the skills and methods we use in the daily execution of our work. Without having enough tools in our arsenal, our job is compromised. Worse, it can be inefficient, insufficient, misleading and worst- miss bugs!

From useful and complex Linear Code Sequence and Jump (LCSAJ), to old faithful, Model-based testing, there are a very large number of important test methods. Lately I have seen a renewed use and importance of Scenario-based testing using personae for higher customer satisfaction, Real-world testing and user story validation.

Why does learning more test methods help? Test methods provide a structure for thinking. They give a framework for well understood measures of coverage and risk. For example, Model-based testing can give easy measurements of path coverage, Requirements-based testing is a common method when requirements coverage is measured or there is a need for regulatory compliance.

Different methods and techniques have different uses and goals. Different goals might be, for example, finding bugs, customer satisfaction, regulatory compliance, getting the product out as fast as you can, having confidence in the already functioning parts of the product with new added functions- all need different methods to provide the greatest confidence for these different goals.

Using particular test methods in your test strategy takes away the seemingly random nature of some test teams. I know a few teams who “hope” they find the worst bugs. Remember, hope is not a strategy! Test methods help create your strategy!

The objective of this edition is to present some new views on test methods. The goal is to give you as many tools as possible to attack your test effort and do the most effective, efficient job and communicate it effectively to the team so you can make the best most informed decisions on bug fixing, risk and release!

In this issue Brian Heys warns that without exploratory tests, the number of defects will always be higher; I’ll explain how Action-Basted Testing is a much saner way to evolve a testing project; Salesforce’s Keith Stobie reviews, “The Domain Testing Workbook” by Cem Kaner, Sowmya Padmanabhan and Douglass Hoffman; Robin Roy writes that boundary guidelines can provide a higher rate of error detection and LogiGear CTO, Hans Buwalda explains that a good test design can improve quality and the efficiency of the tests.

And, at this time of year, for those of you who celebrate Lunar New Year- Happy Year of the Horse! For those of you who do not celebrate Lunar New Year- give it a try! Its as good a reason as any to have a fun celebration.

Michael Hackett

Senior Vice President, LogiGear Corporation

Editor in Chief



LogiGear Corporation

LogiGear Corporation provides global solutions for software testing, and offers public and corporate software-testing training programs worldwide through LogiGear University. LogiGear is a leader in the integration of test automation, offshore resources and US project management for fast and cost-effective results. Since 1994, LogiGear has worked with hundreds of companies from the Fortune 500 to early-stage startups, creating unique solutions to exactly meet their needs. With facilities in the US and Vietnam, LogiGear helps companies double their test coverage and improve software quality while reducing testing time and cutting costs.

For more information, contact Joe Hughes + 01 650.572.1400

LogiGear Corporation
LogiGear Corporation provides global solutions for software testing, and offers public and corporate software testing training programs worldwide through LogiGear University. LogiGear is a leader in the integration of test automation, offshore resources and US project management for fast, cost-effective results. Since 1994, LogiGear has worked with Fortune 500 companies to early-stage start-ups in, creating unique solutions to meet their clients’ needs. With facilities in the US and Viet Nam, LogiGear helps companies double their test coverage and improve software quality while reducing testing time and cutting costs.

The Related Post

Automation is a mantra in testing. Anyone associated with software development wants more test automation, but it’s often misunderstood. People who do test automation know how difficult it can be. But some people do not understand that automation is code, and that it needs to have architecture and design just like production code. They do ...
Test automation is a big topic. There are so many different areas to talk about: tool choice, jumpstart, cross platform, services, cloud… Each of these areas have changed so much in the recent past that they could each be worth their own magazine issue.
If you are reading this issue, you are probably aware of the impact on the business world of cloud computing. Most people do not have a good grasp on what the cloud is or how people and products can use it. BTW, you are already a cloud user. If your email is stored somewhere “on ...
I have been excited about this issue since I included it in the 2011 editorial calendar. This issue of LogiGear Magazine dives into an exploration of agile automation—from the most efficient methods for test automation, to skill sets and better preparation for test teams, and even to understanding the variety of tools in question. We ...
This is our first Trends issue in our 10- year history. Trends are important to help foresee what is on the horizon and coming next.
Our plan for the December LogiGear Magazine was to have a forward-looking Trends and Challenges issue. However, whilst assembling our September issue on SMAC, we realized the momentum SMAC was gaining in the industry. We had a large amount of content on our hands from a range of excellent contributors. Thus, we decided to split ...
API testing– an old school technology gets way cool again. APIs and testing them is nothing new; the technology has been around for decades. The most basic definition of an API is an exposed function— a producer (person or company) writes a function and exposes it so that others, consumers, can use it. We copy ...
Testing tools – very important, very often overlooked, and very often where mistakes are made. First, the most common mistake people make about tools is thinking tools are only about test automation! False. Automation tools are merely one type testing tool. We will try to balance this issue between test automation tools and other test ...
DevOps can be a big scary thing. Culture change, constant collaboration— whatever that means— a big new set of tools… it’s a lot. What most teams want is to have a smooth running software development pipeline. I have stopped using the phrase “DevOps,” and now I say “Continuous Delivery.” There are many reasons for this.
In the November 2011 issue: Mobile Application Testing, I began my column with the statement, “Everything is mobile.” One year later the statement is even more true. More devices, more platforms, more diversity, more apps. It boggles the mind how fast the landscape changes. Blackberry has been kicked to the curb by cooler and slicker ...
As we settle into autumn, we’re taking the time to start some new traditions. This is LogiGear magazine’s first issue on SMAC. SMAC—social, mobile, analytics and cloud. We will be doing more issues in the next few years on these topics since so much of the product world is moving to this development stack.
Happy New Year from LogiGear to those of us who celebrated New Years on January 1! And for our lunar calendar followers, an almost Happy New Year come February 3rd. We look forward to an exciting and full 2011 as its predecessor was a tough year for many in the software business. At LogiGear Magazine, ...

Leave a Reply

Your email address will not be published. Required fields are marked *

Stay in the loop with the lastest
software testing news