dc.creator | Juristo, Natalia | es |
dc.creator | Vegas, Sira | es |
dc.creator | Solari, Martín | es |
dc.creator | Abrahao, Silvia | es |
dc.creator | Ramos Román, Isabel | es |
dc.date.accessioned | 2017-04-28T09:36:24Z | |
dc.date.available | 2017-04-28T09:36:24Z | |
dc.date.issued | 2013 | |
dc.identifier.citation | Juristo, N., Vegas, S., Solari, M., Abrahao, S. y Ramos Román, I. (2013). A process for managing interaction between experimenters to get useful similar replications. Information and Software Technology, 55 (2), 215-225. | |
dc.identifier.issn | 0950-5849 | es |
dc.identifier.uri | http://hdl.handle.net/11441/58913 | |
dc.description.abstract | Context: A replication is the repetition of an experiment. Several efforts have been made to adopt replication
as a common practice in software engineering. There are different types of replications, depending
on their purpose. Similar replications keep the experimental conditions as alike as possible to the original
ones. External similar replications, where the replicating experimenters are not the same people as the
original experimenters, have been a stumbling block. Several attempts at combining the results of replications
have resulted in failure. Software engineering does not appear to be well suited to such replications,
because it works with complex experimentally immature contexts. Software engineering settings
have a large number of variables, and the role that many of them play is unknown. A successful (or useful)
similar replication helps to better understand the phenomenon under study by verifying results and/or
identifying contextual variables that could influence (or not) the results, through the combination of
experimental results.
Objective: To be able to get successful similar replications, there needs to be interaction between original
and replicating experimenters. In this paper, we propose an interaction process for achieving successful
similar replications.
Method: This process consists of: an adaptation meeting, where experimenters tailor the experiment to
the new setting; querying, to settle occasional inquiries while the experiment is being run; and a combination
meeting, where experimenters meet to discuss the combination of replication outcomes with previous
results. To check its effectiveness, the process has been tested on three different replications of the
same experiment.
Results: The proposed interaction process has helped to identify new contextual variables that could
potentially influence (or not) the experimental results in the three replications run. Additionally, the
interaction process has helped to uncover certain problems and deviations that occurred during some
of the replications that we would have not been aware of otherwise.
Conclusions: There are signs that suggest that it is possible to get successful similar replications in software
engineering experimentation, when there is appropriate interaction among experimenters. | es |
dc.description.sponsorship | Ministerio de Ciencia e Innovación TIN2011- 23216 | es |
dc.format | application/pdf | es |
dc.language.iso | eng | es |
dc.publisher | Elsevier | es |
dc.relation.ispartof | Information and Software Technology, 55 (2), 215-225. | |
dc.rights | Attribution-NonCommercial-NoDerivatives 4.0 Internacional | * |
dc.rights.uri | http://creativecommons.org/licenses/by-nc-nd/4.0/ | * |
dc.subject | Empirical studies Experimentation | es |
dc.subject | Replication | es |
dc.subject | Combination of experiment results | es |
dc.title | A process for managing interaction between experimenters to get useful similar replications | es |
dc.type | info:eu-repo/semantics/article | es |
dcterms.identifier | https://ror.org/03yxnpp24 | |
dc.type.version | info:eu-repo/semantics/submittedVersion | es |
dc.rights.accessRights | info:eu-repo/semantics/openAccess | es |
dc.contributor.affiliation | Universidad de Sevilla. Departamento de Lenguajes y Sistemas Informáticos | es |
dc.relation.projectID | TIN2011- 23216 | es |
dc.relation.publisherversion | http://www.sciencedirect.com/science/article/pii/S0950584912001425 | es |
dc.identifier.doi | 10.1016/j.infsof.2012.07.016 | es |
idus.format.extent | 11 | es |
dc.journaltitle | Information and Software Technology | es |
dc.publication.volumen | 55 | es |
dc.publication.issue | 2 | es |
dc.publication.initialPage | 215 | es |
dc.publication.endPage | 225 | es |
dc.contributor.funder | Ministerio de Ciencia e Innovación (MICIN). España | |