A Semi-empirical Model of Test Quality in Symmetric Testing: Application to Testing Java Card APIs

Arnaud Gotlieb 1 Patrick Bernard 2
1 Lande - Logiciel : ANalyse et DEveloppement
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : In the smart card quality assurance field, Software Testing is the privileged way of increasing the confidence level in the implementation correctness. Software testing involves a set of activities that includes at least test data selection, test execution and output correctness checking. When testing Java Card application programming interfaces (APIs), the tester has to deal with the classical so-called oracle problem, i.e. to find a way to evaluate the correctness of the computed output. In this paper, we report on an experience in testing methods of the Oberthur Card Systems Cosmo 32 RSA V3.4 Java Card APIs by using the Symmetric Testing paradigm. This paradigm aims at using user-defined symmetry properties of methods as test oracles. We propose an experimental environment that combines random testing and symmetry checking for on-card testing of several symmetric methods of Java Card APIs. Based on this environment, we develop a semi-empirical model (a model feeded by experimental data) to help deciding when to stop testing and to assess test quality. First experimental results are reported and the extension of the approach to non-symmetric Java Card API methods is discussed.
Document type :
Reports
Complete list of metadatas

https://hal.inria.fr/inria-00070338
Contributor : Rapport de Recherche Inria <>
Submitted on : Friday, May 19, 2006 - 8:10:15 PM
Last modification on : Friday, November 16, 2018 - 1:22:05 AM
Long-term archiving on : Sunday, April 4, 2010 - 8:59:23 PM

Identifiers

  • HAL Id : inria-00070338, version 1

Citation

Arnaud Gotlieb, Patrick Bernard. A Semi-empirical Model of Test Quality in Symmetric Testing: Application to Testing Java Card APIs. [Research Report] RR-5675, INRIA. 2005, pp.21. ⟨inria-00070338⟩

Share

Metrics

Record views

164

Files downloads

187