Ponencia
Black-Box and White-Box Test Case Generation for RESTful APIs: Enemies or Allies?
Autor/es | Martín López, Alberto
Arcuri, Andrea Segura Rueda, Sergio Ruiz Cortés, Antonio |
Departamento | Universidad de Sevilla. Departamento de Lenguajes y Sistemas Informáticos |
Fecha de publicación | 2021 |
Fecha de depósito | 2022-05-25 |
Publicado en |
|
ISBN/ISSN | 978-1-6654-2587-2 2332-6549 |
Resumen | Automated test case generation for RESTful APIs
is a thriving research topic due to their critical role in software
integration. Testing approaches can be divided into black-box and
white-box. Black-box approaches exploit ... Automated test case generation for RESTful APIs is a thriving research topic due to their critical role in software integration. Testing approaches can be divided into black-box and white-box. Black-box approaches exploit the API specification for the generation of test cases, while white-box approaches can also leverage the source code. Both strategies have shown great promise, but they have not been fully compared yet, hindering the selection of the right tool for the job. In this paper, we report on our experience comparing black-box and white-box test case generation for RESTful APIs using the stateof- the-art tools RESTest (black-box) and EvoMaster (white-box). Also, we propose integrating both approaches by using blackbox test cases as the seed for white-box search-based test case generation. Evaluation results on four RESTful APIs involving over 40 million API calls show that there is no one-size-fits-all strategy. More importantly, the combination of black-box and white-box yielded the best results in most case studies in terms of code coverage and fault finding, paving the way for better tools integrating the best of both perspectives. As a result of our work, we provide lessons learned and open challenges for guiding the use and further development of current tool support. |
Agencias financiadoras | Ministerio de Ciencia e Innovación (MICIN). España Junta de Andalucía Ministerio de Educación, Cultura y Deporte (MECD). España |
Identificador del proyecto | RTI2018101204-B-C21 (HORATIO)
APOLO (US-1264651) EKIPMENT-PLUS (P18-FR-2895) FPU17/04077 |
Cita | Martín López, A., Arcuri, A., Segura Rueda, S. y Ruiz Cortés, A. (2021). Black-Box and White-Box Test Case Generation for RESTful APIs: Enemies or Allies?. En ISSRE 2021: IEEE 32nd International Symposium on Software Reliability Engineering (231-241), Wuhan, China: IEEE Computer Society. |
Ficheros | Tamaño | Formato | Ver | Descripción |
---|---|---|---|---|
Black-Box and White-Box Test ... | 770.9Kb | [PDF] | Ver/ | |