Letter from the Editor – February 2014

“Why do we need to understand a bunch of test methods? I write test cases from user stories or requirements, automate what I can and execute the rest manually, and its fine.” If this is your situation: good for you.

If you are time crunched, if your automated tests have lost relevance, are hard to maintain or regularly miss bugs, if you do not have useful and meaningful ways to confidently measure and report coverage and risk, if you are doing what you have always done, if you document too much, or document too little, if testing is “a mess”, if the dev teams do not trust your testing, if you wish there was a better way……then arming yourself with new test methods or examining the methods you currently use will, without a doubt, be beneficial!

In our continuing effort to be the best source of information for keeping testers and test teams current, we have dedicated this issue to exploring test methods. Learning test methods is core to a test engineer. These are the skills and methods we use in the daily execution of our work. Without having enough tools in our arsenal, our job is compromised. Worse, it can be inefficient, insufficient, misleading and worst- miss bugs!

From useful and complex Linear Code Sequence and Jump (LCSAJ), to old faithful, Model-based testing, there are a very large number of important test methods. Lately I have seen a renewed use and importance of Scenario-based testing using personae for higher customer satisfaction, Real-world testing and user story validation.

Why does learning more test methods help? Test methods provide a structure for thinking. They give a framework for well understood measures of coverage and risk. For example, Model-based testing can give easy measurements of path coverage, Requirements-based testing is a common method when requirements coverage is measured or there is a need for regulatory compliance.

Different methods and techniques have different uses and goals. Different goals might be, for example, finding bugs, customer satisfaction, regulatory compliance, getting the product out as fast as you can, having confidence in the already functioning parts of the product with new added functions- all need different methods to provide the greatest confidence for these different goals.

Using particular test methods in your test strategy takes away the seemingly random nature of some test teams. I know a few teams who “hope” they find the worst bugs. Remember, hope is not a strategy! Test methods help create your strategy!

The objective of this edition is to present some new views on test methods. The goal is to give you as many tools as possible to attack your test effort and do the most effective, efficient job and communicate it effectively to the team so you can make the best most informed decisions on bug fixing, risk and release!

In this issue Brian Heys warns that without exploratory tests, the number of defects will always be higher; I’ll explain how Action-Basted Testing is a much saner way to evolve a testing project; Salesforce’s Keith Stobie reviews, “The Domain Testing Workbook” by Cem Kaner, Sowmya Padmanabhan and Douglass Hoffman; Robin Roy writes that boundary guidelines can provide a higher rate of error detection and LogiGear CTO, Hans Buwalda explains that a good test design can improve quality and the efficiency of the tests.

And, at this time of year, for those of you who celebrate Lunar New Year- Happy Year of the Horse! For those of you who do not celebrate Lunar New Year- give it a try! Its as good a reason as any to have a fun celebration.

Michael Hackett

Senior Vice President, LogiGear Corporation

Editor in Chief

 

 

LogiGear Corporation

LogiGear Corporation provides global solutions for software testing, and offers public and corporate software-testing training programs worldwide through LogiGear University. LogiGear is a leader in the integration of test automation, offshore resources and US project management for fast and cost-effective results. Since 1994, LogiGear has worked with hundreds of companies from the Fortune 500 to early-stage startups, creating unique solutions to exactly meet their needs. With facilities in the US and Vietnam, LogiGear helps companies double their test coverage and improve software quality while reducing testing time and cutting costs.

For more information, contact Joe Hughes + 01 650.572.1400

LogiGear Corporation
LogiGear Corporation provides global solutions for software testing, and offers public and corporate software testing training programs worldwide through LogiGear University. LogiGear is a leader in the integration of test automation, offshore resources and US project management for fast, cost-effective results. Since 1994, LogiGear has worked with Fortune 500 companies to early-stage start-ups in, creating unique solutions to meet their clients’ needs. With facilities in the US and Viet Nam, LogiGear helps companies double their test coverage and improve software quality while reducing testing time and cutting costs.

The Related Post

In the November 2011 issue: Mobile Application Testing, I began my column with the statement, “Everything is mobile.” One year later the statement is even more true. More devices, more platforms, more diversity, more apps. It boggles the mind how fast the landscape changes. Blackberry has been kicked to the curb by cooler and slicker ...
Testers need to learn their craft and hone in on their skill set. That means building skills, sharpening their tools, and becoming creative detectives. There is no cookie-cutter tester and no best practice. The best circumstance is a fully-skilled, aggressive tester mixed with curiosity, nimbleness, and agility.
There is a growing software development dynamic of teams without Testers. When I first went into Software Quality, I learned one thing right away: My role was user advocate. My main job was to find bugs. This is the Lean principle called Amplified Learning. We learn about behavior by testing. Even then, validation was not ...
This is a very special issue of LogiGear Magazine. When we were putting together the Editorial Calendar for this year, we decided that instead of a technology issue, we would focus on the human side of quality and test engineering. We want to focus on individual Test Engineers and their jobs. We talked to a ...
API testing– an old school technology gets way cool again. APIs and testing them is nothing new; the technology has been around for decades. The most basic definition of an API is an exposed function— a producer (person or company) writes a function and exposes it so that others, consumers, can use it. We copy ...
Happy New Year from LogiGear to those of us who celebrated New Years on January 1! And for our lunar calendar followers, an almost Happy New Year come February 3rd. We look forward to an exciting and full 2011 as its predecessor was a tough year for many in the software business. At LogiGear Magazine, ...
Our plan for the December LogiGear Magazine was to have a forward-looking Trends and Challenges issue. However, whilst assembling our September issue on SMAC, we realized the momentum SMAC was gaining in the industry. We had a large amount of content on our hands from a range of excellent contributors. Thus, we decided to split ...
Every organization goes through times when the internal, or home team, cannot execute the testing project easily or quickly enough. The reasons are many, from the lack of an effective test strategy to low automation engineering skill, to staff positions going unfilled due to a great job market. With everyone working and very few people ...
Hello everyone – I’m hoping each one of us is having a great October. This time of the year is always my favorite, with the changing of the seasons, Fall was always my favorite time of year; it signified change and renewal – but I don’t want to digress to much from what’s going on ...
Hi everyone and welcome to our fourth edition of LogiGear Magazine. This month we finish Michael Hackett’s piece on “Agile in Testing” with part five, Tools.
I led the Editor’s Note in our very first mobile issue with “Everything is mobile”, but it is now way beyond what we thought. Mobile has come to mean only the smart phone, mobility is the word that describes everything a smart phone enables you to do. Mobility is more than a device! Mobility is ...
Testing the Software Car. As usual with the LogiGear Magazine, we are tackling a big subject. With our goal of having single-topic issues, we have the ability to grab and disseminate as much information as we can related to a current topic that is interesting and also on the frontier of Software Testing.   Some ...

Leave a Reply

Your email address will not be published. Required fields are marked *

Stay in the loop with the lastest
software testing news

Subscribe