Letter from the Editor – April 2013

Automation is a mantra in testing. Anyone associated with software development wants more test automation, but it’s often misunderstood. People who do test automation know how difficult it can be. But some people do not understand that automation is code, and that it needs to have architecture and design just like production code. They do not understand that it needs code review, and especially ongoing maintenance, which can be more expensive than maintenance of the production code. These misunderstandings about automation in addition to misunderstandings about testing in general, make test automation a political problem as much as it is a software problem.

In this issue, just as with last year’s September issue, test automation is the focus. As we know, test tools have always lagged development tools. At the same time, as software development lifecycles speed up and faster testing is needed, there is an ever greater need for test automation. As the business has grown more aware of these facts, the test automation tool market has rapidly grown. Today, most ALM tools (which we’ve written about here) include test automation tools or an ability to easily integrate test automation tools as normal practice. But remember the old saying “a fool with a tool is still a fool.” Tools will not solve your test automation problems. Great test design, architecture, great data design, and knowledgeable testers along with a great tool will get you started.

One of the most profound findings from the automation section of our 2010 Global Testing Survey is that 1/3 of respondents did 100% manual regression testing. What kind of confidence will you have from that? It is difficult for product teams to fully realize what a risk this is. If they did realize, I think many more companies would make the investment in staff, training, methodology and tools to make automation as important as their production code. The risk is that high.

Test automation is more complicated today. Most test teams today have to support far more platforms than ever in addition to traditional platform combinations, additional browser combinations, matrices of client/server combinations, and now multiple mobile platforms . Supporting a large suite of automated tests is hard enough. Supporting multiple tools due to inabilities for many tools to work across platforms, browsers and especially mobile devices makes an exponential nightmare. At this point, mobile automation can be so problematic for traditional teams we devoted an issue entirely to automating tests for mobile devices in December 2012.

In this issue, Karthik KK gives recommendations for organizing your automation code; LogiGear CTO Hans Buwalda addresses misconceptions about test automation; Randall Rice shows us why automation is not automatic; Amol Kher, Wello CTO, discusses the challenges his Netflix testing team faced when implementing their mobile application; LogiGear, Halliburton and Simco collaborate on a case study to show how to leverage test automation to increase the efficiency of distributed teams; Jonathan Khol urges testing teams to use games to make testing more engaging, productive and fun; and finally, Tad Anderson reviews the book Experiences of Test Automation by Dorothy Graham and Mark Fewster.

As always, we at LogiGear Magazine hope you find useful information to help in your test efforts. Automate more!

Michael Hackett
Michael is a co-founder of LogiGear Corporation, and has over two decades of experience in software engineering in banking, securities, healthcare and consumer electronics. Michael is a Certified Scrum Master and has co-authored two books on software testing. Testing Applications on the Web: Test Planning for Mobile and Internet-Based Systems (Wiley, 2nd ed. 2003), and Global Software Test Automation (Happy About Publishing, 2006). He is a founding member of the Board of Advisors at the University of California Berkeley Extension and has taught for the Certificate in Software Quality Engineering and Management at the University of California Santa Cruz Extension. As a member of IEEE, his training courses have brought Silicon Valley testing expertise to over 16 countries. Michael holds a Bachelor of Science in Engineering from Carnegie Mellon University.

The Related Post

The Greek philosopher Heraclitus of Ephesus (c. 500 BCE) is credited with saying, “The only constant is change.”   This is a statement that, more than 2,000 years later, still holds true. Today, we are in a time of great change. Everything is in flux. The fact is, we are always in a state of change even if ...
I was just recently at a company that had a beautiful test architecture, framework, and Cucumber with tons of well-automated tests. But there was no good test management on top of the Cucumber tests, and they did not do a good job tagging the tests. Although almost everybody on the team could write and maintain ...
Digital Transformation and IT Modernization projects have shifted into high gear during the COVID-19 pandemic. Tough on some teams is having to do more with less and speed up projects on reduced budgets due to the resulting COVID-19 business climate. On the other hand, other companies are adding funding and pressing the schedule under the ...
This is our third issue concerning topics of Continuous Delivery (CD) and DevOps with the inclusion of Continuous Testing. DevOps has been around for a while and I hope the period of buzz is over and companies moving towards building a development pipeline have begun their process, including changing their test strategies.
I have been training testers for about 15 years in universities, corporations, online, and individually – in both a training, managing and coaching capacity. So far, I have executed these various training efforts in 16 countries, under good and rough conditions – from simultaneous translation, to video broadcast to multiple sites, to group games with ...
As we settle into autumn, we’re taking the time to start some new traditions. This is LogiGear magazine’s first issue on SMAC. SMAC—social, mobile, analytics and cloud. We will be doing more issues in the next few years on these topics since so much of the product world is moving to this development stack.
How do you test software? How do you validate it? How do you find bugs? These are all good questions anyone on your project team or anyone responsible for customers may ask you. Can you articulate your test strategy─not your test process, but explain your approach to testing? I find that this can be a ...
Continuous Testing… what is it? When we first decided to do a magazine issue dedicated to the DevOps practice of Continuous Testing, I joked with someone: “It’s about testing continuously.” And their reply was: “Yeah. What else would it be?” I was joking, but clearly the joke didn’t land. Continuous Testing is about testing continuously, ...
Big and complex testing. What do these terms conjure up in your mind? When we added this topic to the editorial calendar, I had the notion that we might illustrate some large or complex systems and explore some of the test and quality challenges they present. We might have an article on: building and testing ...
I led the Editor’s Note in our very first mobile issue with “Everything is mobile”, but it is now way beyond what we thought. Mobile has come to mean only the smart phone, mobility is the word that describes everything a smart phone enables you to do. Mobility is more than a device! Mobility is ...
“Why do we need to understand a bunch of test methods? I write test cases from user stories or requirements, automate what I can and execute the rest manually, and its fine.” If this is your situation: good for you. If you are time crunched, if your automated tests have lost relevance, are hard to ...
Testing tools – very important, very often overlooked, and very often where mistakes are made. First, the most common mistake people make about tools is thinking tools are only about test automation! False. Automation tools are merely one type testing tool. We will try to balance this issue between test automation tools and other test ...

Leave a Reply

Your email address will not be published. Required fields are marked *

Stay in the loop with the lastest
software testing news

Subscribe