What is it about?

Highly-configurable systems (such as software product lines) allow to adapt their behavior to the user via the triggering of options (or features). Though a blessing for the user, this customization is a curse regarding quality assurance, since the number of possible behaviors grows exponentially with the number of features. Exploration of all possibilities is generally intractable for realistic software, pushing the research community to define sampling criteria based on feature models. Contrasting with existing sampling approaches, this paper offers to mine logs to extract information on which behaviors are actually used and uses it to select interesting behaviors to test.

Featured Image

Why is it important?

This work is important because it brides the idea of statistical testing with highly-configurable systems testing. The technique (and tool) for Markovian model inference based on n-grams had several follow-up applications. It contributed to the field of behavioral reverse engineering of variability-intensive systems, a challenging task due to the widespread and continuous evolution of these systems. That same technique also proved useful to improve crash reproduction using evolutionary algorithms.

Perspectives

This paper led to a larger collaboration with several research groups at the University of Rennes, leading to the follow-up publication: Devroey, X., Perrouin, G., Cordy, M., Samih, H., Legay, A., Schobbens, P. Y., & Heymans, P. (2017). Statistical prioritization for software product line testing: an experience report. Software & Systems Modeling, 16, 153-171. It also paved the way for further behavior-based sampling techniques, among others.

FNRS Research Associate Gilles Perrouin
Universite de Namur

Read the Original

This page is a summary of: Towards statistical prioritization for software product lines testing, January 2014, ACM (Association for Computing Machinery),
DOI: 10.1145/2556624.2556635.
You can read the full text:

Read

Contributors

The following have contributed to this page