Rule-based Assessment of Test Quality

By: Stefan Reichhart, Tudor Gîrba, Stéphane Ducasse

Abstract

With the success of agile methodologies more and more projects develop large test suites to ensure that the system is behaving as expected. Not only do tests ensure correctness, but they also offer a live documentation for the code. However, as the system evolves, the tests need to evolve as well to keep up with the system, and as the test suite grows larger, the effort invested into maintaining tests is a significant activity. In this context, the quality of tests becomes an important issue, as developers need to assess and understand the tests they have to maintain. In this paper we present TestLint, an approach together with an experimental tool for qualifying tests. We define a set of criteria to determine test quality, and we evaluate our approach on a large sample of unit tests found in open-source projects.

Cite as:

Stefan Reichhart, Tudor Gîrba, Stéphane Ducasse, “Rule-based Assessment of Test Quality”, Journal of Object Technology, Volume 6, no. 9 (October 2007), pp. 231-251, doi:10.5381/jot.2007.6.9.a12.

PDF | HTML | DOI | BiBTeX | Tweet this | Post to CiteULike | Share on LinkedIn

The JOT Journal   |   ISSN 1660-1769   |   DOI 10.5381/jot   |   AITO   |   Open Access   |    Contact