Skip to Main content Skip to Navigation
Journal articles

Empirical Assessment of Generating Adversarial Configurations for Software Product Lines

Abstract : Software product line (SPL) engineering allows the derivation of products tailored to stakeholders' needs through the setting of a large number of configuration options. Unfortunately, options and their interactions create a huge configuration space which is either intractable or too costly to explore exhaustively. Instead of covering all products, machine learning (ML) approximates the set of acceptable products (e.g., successful builds, passing tests) out of a training set (a sample of configurations). However, ML techniques can make prediction errors yielding non-acceptable products wasting time, energy and other resources. We apply adversarial machine learning techniques to the world of SPLs and craft new configurations faking to be acceptable configurations but that are not and vice-versa. It allows to diagnose prediction errors and take appropriate actions. We develop two adversarial configuration generators on top of state-of-the-art attack algorithms and capable of synthesizing configurations that are both adversarial and conform to logical constraints. We empirically assess our generators within two case studies: an industrial video synthesizer (MOTIV) and an industry-strength, open-source Web-app configurator (JHipster). For the two cases, our attacks yield (up to) a 100% misclassification rate without sacrificing the logical validity of adversarial configurations. This work lays the foundations of a quality assurance framework for ML-based SPLs.
Document type :
Journal articles
Complete list of metadatas
Contributor : Mathieu Acher <>
Submitted on : Tuesday, December 8, 2020 - 10:45:18 AM
Last modification on : Friday, January 8, 2021 - 3:41:17 AM


Files produced by the author(s)


  • HAL Id : hal-03045797, version 1


Paul Temple, Gilles Perrouin, Mathieu Acher, Battista Biggio, Jean-Marc Jézéquel, et al.. Empirical Assessment of Generating Adversarial Configurations for Software Product Lines. Empirical Software Engineering, Springer Verlag, 2020, pp.1-57. ⟨hal-03045797⟩



Record views


Files downloads