Publication Details

Advances in Noise-based Testing of Concurrent Programs

FIEDOR Jan, DUDKA Vendula, KŘENA Bohuslav, LETKO Zdeněk, UR Shmuel and VOJNAR Tomáš. Advances in Noise-based Testing of Concurrent Programs. Software Testing, Verification and Reliability, vol. 25, no. 3, 2015, pp. 272-309. ISSN 1099-1689. Available from: http://onlinelibrary.wiley.com/doi/10.1002/stvr.1546/abstract
Czech title
Pokroky v testování vícevláknového software za pomocí generátoru šumu
Type
journal article
Language
english
Authors
Fiedor Jan, Ing., Ph.D. (DITS FIT BUT)
Dudka Vendula, Ing. (DITS FIT BUT)
Křena Bohuslav, Ing., Ph.D. (DITS FIT BUT)
Letko Zdeněk, Ing., Ph.D. (DITS FIT BUT)
Ur Shmuel (IBM)
Vojnar Tomáš, prof. Ing., Ph.D. (DITS FIT BUT)
URL
Keywords


testing; dynamic analysis; noise injection; multi-threaded software; coverage metrics; genetic algorithm; meta-heuristic algorithms

Abstract

Testing of concurrent software written in programming languages like Java and C/C++ is ahighly challenging task owing to the many possible interactions among threads. Asimple, cheap, and effective approach that addresses this challenge is testing with noise injection, which influences the scheduling so that different interleavings of concurrent actions are witnessed. In this paper, multiple results achieved recently in the area of noise-injection-based testing by the authors are presented in a unified and extended way. In particular, various concurrency coverage metrics are presented first. Then, multiple heuristics for solving the noise placement problem (i.e. where and when to generate noise) as well as the noise seeding problem (i.e. how to generate the noise) are introduced and experimentally evaluated. In addition, several new heuristics are proposed and included into the evaluation too. Recommendations on how to set up noise-based testing for particular scenarios are then given. Finally, anovel use of the genetic algorithm for finding suitable combinations of the many parameters of tests and noise techniques is presented. 

Published
2015
Pages
272-309
Journal
Software Testing, Verification and Reliability, vol. 25, no. 3, ISSN 1099-1689
Publisher
WILEY
DOI
10.1002/stvr.1546
UT WoS
000353031800005
EID Scopus
2-s2.0-84927693779
BibTeX 
@ARTICLE{FITPUB10275,
   author = "Jan Fiedor and Vendula Dudka and Bohuslav K\v{r}ena and Zden\v{e}k Letko and Shmuel Ur and Tom\'{a}\v{s} Vojnar",
   title = "Advances in Noise-based Testing of Concurrent Programs",
   pages = "272--309",
   journal = "Software Testing, Verification and Reliability",
   volume = 25,
   number = 3,
   year = 2015,
   ISSN = "1099-1689",
   doi = "10.1002/stvr.1546",
   language = "english",
   url = "https://www.fit.vut.cz/research/publication/10275"
}
Back to top