Publication Details
Coverage Metrics for Saturation-based and Search-based Testing of Concurrent Software
KŘENA Bohuslav, LETKO Zdeněk and VOJNAR Tomáš. Coverage Metrics for Saturation-based and Search-based Testing of Concurrent Software. Lecture Notes in Computer Science, vol. 2012, no. 7186, pp. 177-192. ISSN 0302-9743. Available from: http://www.springerlink.com/content/084w5489p9556775/
English title
Coverage Metrics for Saturation-based and Search-based Testing of Concurrent Software
Type
journal article
Language
czech
Authors
Křena Bohuslav, Ing., Ph.D. (DITS FIT BUT)
Letko Zdeněk, Ing., Ph.D. (DITS FIT BUT)
Vojnar Tomáš, prof. Ing., Ph.D. (DITS FIT BUT)
Letko Zdeněk, Ing., Ph.D. (DITS FIT BUT)
Vojnar Tomáš, prof. Ing., Ph.D. (DITS FIT BUT)
URL
Keywords
Java, concurrency, testing, coverage, search-based testing, saturation-based testing
Abstract
Coverage metrics play a crucial role in testing.
They allow one to estimate how well a~program has been tested and/or to control
the testing process. Several concurrency-related coverage metrics have been
proposed, but most of them do not reflect concurrent behaviour accurately enough.
In this paper, we propose several new metrics that are suitable primarily for
saturation-based or search-based testing of concurrent software. Their
distinguishing feature is that they are derived from various dynamic analyses
designed for detecting synchronisation errors in concurrent software. In fact,
the way these metrics are obtained is generic, and further metrics can be
obtained in a similar way from other analyses. The underlying motivation is
that, within such analyses, behavioural aspects crucial for occurrence of
various bugs are identified, and hence it makes sense to track how well the
occurrence of such phenomena is covered by testing. Next, coverage tasks of the
proposed as well as some existing metrics are combined with an abstract
identification of the threads participating in generation of the phenomena
captured in the concerned tasks. This way, further, more precise metrics are
obtained. Finally, an empirical evaluation of the proposed metrics, which
confirms that several of them are indeed more suitable for saturation-based and
search-based testing than the previously known metrics, is
presented.
Published
2012
Pages
177-192
Journal
Lecture Notes in Computer Science, vol. 2012, no. 7186, ISSN 0302-9743
Publisher
Springer Verlag
BibTeX
@ARTICLE{FITPUB9552, author = "Bohuslav K\v{r}ena and Zden\v{e}k Letko and Tom\'{a}\v{s} Vojnar", title = "Coverage Metrics for Saturation-based and Search-based Testing of Concurrent Software", pages = "177--192", journal = "Lecture Notes in Computer Science", volume = 2012, number = 7186, year = 2012, ISSN = "0302-9743", language = "czech", url = "https://www.fit.vut.cz/research/publication/9552" }
Files