STIPI: Using Search to Prioritize Test Cases Based on Multi-objectives Derived from Industrial Practice - Archive ouverte HAL Access content directly
Conference Papers Year : 2016

STIPI: Using Search to Prioritize Test Cases Based on Multi-objectives Derived from Industrial Practice

(1) , (1) , (1) , (1, 2) , (3)
1
2
3
Dipesh Pradhan
  • Function : Author
  • PersonId : 1023383
Shuai Wang
  • Function : Author
  • PersonId : 1023384
Shaukat Ali
  • Function : Author
  • PersonId : 994791
Marius Liaaen
  • Function : Author
  • PersonId : 1023385

Abstract

The importance of cost-effectively prioritizing test cases is undeniable in automated testing practice in industry. This paper focuses on prioritizing test cases developed to test product lines of Video Conferencing Systems (VCSs) at Cisco Systems, Norway. Each test case requires setting up configurations of a set of VCSs, invoking a set of test APIs with specific inputs, and checking statuses of the VCSs under test. Based on these characteristics and available information related with test case execution (e.g., number of faults detected), we identified that the test case prioritization problem in our particular context should focus on achieving high coverage of configurations, test APIs, statuses, and high fault detection capability as quickly as possible. To solve this problem, we propose a search-based test case prioritization approach (named STIPI) by defining a fitness function with four objectives and integrating it with a widely applied multi-objective optimization algorithm (named Non-dominated Sorting Genetic Algorithm II). We compared STIPI with random search (RS), Greedy algorithm, and three approaches adapted from literature, using three real sets of test cases from Cisco with four time budgets (25 %, 50 %, 75 % and 100 %). Results show that STIPI significantly outperformed the selected approaches and managed to achieve better performance than RS for on average 39.9 %, 18.6 %, 32.7 % and 43.9 % for the coverage of configurations, test APIs, statuses and fault detection capability, respectively.
Fichier principal
Vignette du fichier
419911_1_En_11_Chapter.pdf (1.14 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01643725 , version 1 (21-11-2017)

Licence

Attribution - CC BY 4.0

Identifiers

Cite

Dipesh Pradhan, Shuai Wang, Shaukat Ali, Tao Yue, Marius Liaaen. STIPI: Using Search to Prioritize Test Cases Based on Multi-objectives Derived from Industrial Practice. 28th IFIP International Conference on Testing Software and Systems (ICTSS), Oct 2016, Graz, Austria. pp.172-190, ⟨10.1007/978-3-319-47443-4_11⟩. ⟨hal-01643725⟩
60 View
91 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More