Capítulo de Libro
Evaluating Testing Techniques in Highly-Configurable Systems: The Drupal Dataset
Autor/es | Sánchez Jerez, Ana Belén
Segura Rueda, Sergio Ruiz Cortés, Antonio |
Coordinador/Director | Gupta, Varun
Gupta, Chetna |
Departamento | Universidad de Sevilla. Departamento de Lenguajes y Sistemas Informáticos |
Fecha de publicación | 2021 |
Fecha de depósito | 2021-12-21 |
Publicado en |
|
ISBN/ISSN | 9781003168393 |
Resumen | Context: Software applications exposing a high ability to be extended, changed or configured are usually referred to as Highly-Configurable Systems (HCSs). Testing techniques for HCSs aim at finding effective but manageable ... Context: Software applications exposing a high ability to be extended, changed or configured are usually referred to as Highly-Configurable Systems (HCSs). Testing techniques for HCSs aim at finding effective but manageable test suites that lead to the early detection of faults. Evaluating the effectiveness of these techniques in realistic environments is a must, but also a challenge due to the lack of HCSs with available code, configuration models and fault reports. Aim: In this chapter, we present the Drupal dataset, a collection of real-world data collected from the popular open-source Drupal framework. This dataset allows the assessment of variability testing techniques with real data of an HCS. Method: We collected extensive non-functional data from the Drupal Git repository and the Drupal website, including code changes in different versions of Drupal modules (e.g., 557 commits in Drupal v7.22) and number of tests and assertions in the modules (e.g., 352 and 24,152, respectively). The faults found in different versions of Drupal modules were also gathered from the Drupal bug tracking system (e.g., 3,392 faults in Drupal v7.23). Additionally, we provided the Drupal feature model as a representation of the framework configurability, with more than 2,000 millions of different Drupal configurations; one of the largest attributed feature models published so far. With 150 citations since its publication, the Drupal dataset has become a helpful tool to researchers and practitioners to conduct more realistic experiments and evaluations of HCSs. |
Agencias financiadoras | Ministerio de Ciencia, Innovación y Universidades (MICINN). España Junta de Andalucía |
Identificador del proyecto | HORATIO (RTI2018-101204-B-C21)
APOLO (US-1264651) EKIPMENT-PLUS (P18-FR-2895) |
Cita | Sánchez Jerez, A.B., Segura Rueda, S., y Ruiz Cortés, A. (2021). Evaluating Testing Techniques in Highly-Configurable Systems: The Drupal Dataset. En V. Gupta, C. Gupta (Ed.), Research and Evidence in Software Engineering : From Empirical Studies to Open Source Artifacts .Boca Raton, FL, USA: Auerbach Publications. |
Ficheros | Tamaño | Formato | Ver | Descripción |
---|---|---|---|---|
sanchez20-drupal.pdf | 134.5Kb | [PDF] | Ver/ | |