Artículo
jMetalSP: A framework for dynamic multi-objective big data optimization
Autor/es | Barba González, Cristóbal
García Nieto, José Manuel Nebro, Antonio J. Cordero, José A. Durillo, Juan J. Navas Delgado, Ismael Aldana Montes, José F. |
Departamento | Universidad de Sevilla. Departamento de Ciencias de la Computación e Inteligencia Artificial |
Fecha de publicación | 2018 |
Fecha de depósito | 2021-05-10 |
Publicado en |
|
Resumen | Multi-objective metaheuristics have become popular techniques for dealing with complex optimization problems composed of a number of conflicting functions. Nowadays, we are in the Big Data era, so metaheuristics must be ... Multi-objective metaheuristics have become popular techniques for dealing with complex optimization problems composed of a number of conflicting functions. Nowadays, we are in the Big Data era, so metaheuristics must be able to solve dynamic problems that may vary over time due to the processing and analysis of several streaming data sources. As this is a new field, there is a need for software platforms to solve dynamic multi-objective Big Data optimization problems. In this paper, we present jMetalSP, which combines the multi-objective optimization features of the jMetal framework with the streaming facilities of the Apache Spark cluster computing system. Thus, existing state-of-the-art multi-objective metaheuristics can be easily adapted to deal with dynamic optimization problems that are fed by multiple streaming data sources. Moreover, these algorithms can take advantage of the parallel computing features of Spark. We describe the architecture of jMetalSP and show how it can be used to solve a dynamic bi-objective instance of the Traveling Salesman Problem (TSP) based on New York City's real-time traffic data. We have also carried out an experimental study to assess the performance of the resultant jMetalSP application in a Hadoop cluster composed of 100 nodes. |
Agencias financiadoras | Ministerio de Educación y Ciencia (MEC). España Junta de Andalucía |
Identificador del proyecto | TIN2014-58304-R
P11-TIC-7529 P12-TIC-1519 |
Cita | Barba González, C., García Nieto, J.M., Nebro, A.J., Cordero, J.A., Durillo, J.J., Navas Delgado, I. y Aldana Montes, J.F. (2018). jMetalSP: A framework for dynamic multi-objective big data optimization. Applied Soft Computing, 69 (August 2018), 737-748. |
Ficheros | Tamaño | Formato | Ver | Descripción |
---|---|---|---|---|
jMetalSP.pdf | 4.681Mb | [PDF] | Ver/ | |