Testing Mistakes

The benefits of automated software testing are often recognized but not realized. Common mistakes we see regarding automated software testing include:

• Implementing the use of automated testing efforts without a testing process in place resulting in an ad-hoc, non-repeatable, non-measurable Automated Software Testing program.
• Implementing an Automated Software Testing design without following any design standards, resulting in the creation of automated test scripts that are not repeatable and therefore not reusable for incremental software builds.
• Efforts attempting to automate 100% of test requirements, when tools or in-house developed automated test harnesses, schedules, or budgets being applied do not support automation of all tests required.
• Using the wrong tool or framework or developing a too elaborate in house test harness.
• Test tool implementation initiated too late in the application development life cycle, not allowing sufficient time for tool setup and test tool introduction process (i.e. learning curve).
• Test engineer involvement initiated too late in the application development life cycle resulting in poor understanding of the application and system design, which results in incomplete testing.