Presentation
Test coverage criteria for RESTful web APIs
Author/s | Martín López, Alberto
Segura Rueda, Sergio ![]() ![]() ![]() ![]() ![]() ![]() ![]() Ruiz Cortés, Antonio ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Department | Universidad de Sevilla. Departamento de Lenguajes y Sistemas Informáticos |
Publication Date | 2019 |
Deposit Date | 2022-05-25 |
Published in |
|
ISBN/ISSN | 978-1-4503-6850-6 |
Abstract | Web APIs following the REST architectural style (so-called RESTful
web APIs) have become the de-facto standard for software inte gration. As RESTful APIs gain momentum, so does the testing of
them. However, there is a ... Web APIs following the REST architectural style (so-called RESTful web APIs) have become the de-facto standard for software inte gration. As RESTful APIs gain momentum, so does the testing of them. However, there is a lack of mechanisms to assess the ade quacy of testing approaches in this context, which makes it difficult to automatically measure and compare their effectiveness. In this paper, we first present a set of ten coverage criteria that allow to determine the degree to which a test suite exercises the different inputs (i.e. requests) and outputs (i.e. responses) of a RESTful API. We then arrange the proposed criteria into eight Test Coverage Levels (TCLs), where TCL0 represents the weakest coverage level and TCL7 represents the strongest one. This enables the automated assessment and comparison of testing techniques according to the overall coverage and TCL achieved by their generated test suites. Our evaluation results on two open-source APIs with real bugs show that the proposed coverage levels nicely correlate with code coverage and fault detection measurements. |
Funding agencies | Ministerio de Economía y Competitividad (MINECO). España Ministerio de Ciencia, Innovación y Universidades (MICINN). España Ministerio de Educación, Cultura y Deporte (MECD). España |
Project ID. | BELI (TIN2015-70560-R)
![]() RTI2018-101204-B-C21 (HORATIO) ![]() FPU17/04077 ![]() |
Citation | Martín López, A., Segura Rueda, S. y Ruiz Cortés, A. (2019). Test coverage criteria for RESTful web APIs. En A-TEST 2019: 10th ACM SIGSOFT International Workshop on Automating TEST Case Design, Selection, and Evaluation (15-21), Tallinn, Estonia: Association for Computing Machinery (ACM). |
Files | Size | Format | View | Description |
---|---|---|---|---|
Test coverage criteria for RESTful ... | 1.018Mb | ![]() | View/ | |