Reducing the Cost of Grammar-Based Testing Using Pattern Coverage

Abstract : In grammar-based testing, context-free grammars may be used to generate relevant test inputs for language processors, or meta programs, such as programming language compilers, refactoring tools, and implementations of software quality metrics. This technique can be used to test these meta programs, but the amount of sentences, and syntax trees thereof, which needs to be generated to obtain reasonable coverage of the input language is exponential.Pattern matching is a programming language feature used often when writing meta programs. Pattern matching helps because it automates the frequently occurring task of detecting shapes in, and extracting information from syntax trees. However, meta programs which contain many patterns are difficult to test using only randomly generated sentences from grammar rules. The reason is that statistically it is uncommon to directly generate sentences which accidentally match the patterns in the code.To solve this problem, in this paper we extract information from the patterns in the code of meta programs to guide the sentence generation process. We introduce a new coverage criterion, called Pattern Coverage, which focuses on providing a test strategy to reduce the amount of test necessary cases, while covering the relevant parts of the meta program. An initial experimental evaluation is presented and the result is compared with traditional grammar-based testing.
Complete list of metadatas

Cited literature [30 references]  Display  Hide  Download

https://hal.inria.fr/hal-01470158
Contributor : Hal Ifip <>
Submitted on : Friday, February 17, 2017 - 10:25:57 AM
Last modification on : Wednesday, October 3, 2018 - 1:08:29 AM
Long-term archiving on : Thursday, May 18, 2017 - 1:50:17 PM

File

385214_1_En_5_Chapter.pdf
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Cleverton Hentz, Jurgen Vinju, Anamaria Moreira. Reducing the Cost of Grammar-Based Testing Using Pattern Coverage. 27th IFIP International Conference on Testing Software and Systems (ICTSS), Nov 2015, Sharjah and Dubai, United Arab Emirates. pp.71-85, ⟨10.1007/978-3-319-25945-1_5⟩. ⟨hal-01470158⟩

Share

Metrics

Record views

223

Files downloads

119