General

	Purpose: There are quite a lot of methodologies, books, articles, tools, etc. related to Testing. Goal of this section is not to repeat all of them nor provide an overview. But there are areas usually not enough highlighted from my point of view. Tests itself should be tested as well. In the section above there is a technique which allows estimate quality of the test during the testing (not quality of the product being tested).
	Scope: There are "test-for-the-test" diagrams in the section.
	Status: Draft release.

Warning: If you think that you have discovered any copyright violation on page, please notify me immediately by e-mail: This e-mail address is being protected from spam bots, you need JavaScript enabled to view it . Thank you.

Glossary and Abbreviations

Testing

Testing:: Factors affecting test-case effectiveness

The Factors affecting test-case effectiveness are shown on Figure 1.

Fig.1: Testing:: Effectiveness Factors

There are 6 factors (in 3 groups) affecting test-case effectiveness:

This will allow to analyze not only the quality of the product being tested but test and assumption quality during the test preparation.

By using algorithm shown on the Fig.2 all test escapes can be grouped into 6 groups corresponding to 6 factors above.

Testing:: Test Escape Analysis

Figure 3 gives an example of the test-case escape analysis. This is not a real example.

Fig.2: Testing:: Test-Case Escape Analysis

As we can see from the diagram, Test Escapes does not always indicate product fails, but caused by either incomplete functional specification, or by incorrect functional specification.

Test Escapes in the example shows importance of the Requirements Analysis at the beginning of the project.

By analysis of the Diagram shown on Figure 3 it is possible to significantly improve the Test Quality.

Reference

The above material is compiled from IT Professional Magazine published by IEEE .

Downloads

	Diagrams from the above Diagram Set could be downloaded in Zip format here:
	testing_dia.zip
	Diagrams are created in Dia format. For Unix/Linux users it is a standard diagram drawing software. Windows users can obtain legal GPL-ed copy of Dia from http://dia-installer.de/index_en.html

Your Comments

It could be really great if you find time to submit your comments, corrections, and other feedback to This e-mail address is being protected from spam bots, you need JavaScript enabled to view it

Regards,
 
Sergei