TOMATE: A heuristic-based approach to extract data from HTML tables
|Author/s||Roldán Salvador, Juan Carlos
Jiménez Aguirre, Patricia
Corchuelo Gil, Rafael
|Department||Universidad de Sevilla. Departamento de Lenguajes y Sistemas Informáticos|
|Abstract||Extracting data from user-friendly HTML tables is difficult because of their different lay outs, formats, and encoding problems. In this article, we present a new proposal that first
applies several pre-processing heuristics ...
Extracting data from user-friendly HTML tables is difficult because of their different lay outs, formats, and encoding problems. In this article, we present a new proposal that first applies several pre-processing heuristics to clean the tables, then performs functional anal ysis, and finally applies some post-processing heuristics to produce the output. Our most important contribution is regarding functional analysis, which we address by projecting the cells onto a high-dimensional feature space in which a standard clustering technique is used to make the meta-data cells apart from the data cells. We experimented with two large repositories of real-world HTML tables and our results confirm that our proposal can extract data from them with an F1 score of 89:50% in just 0:09 CPU seconds per table. We confronted our proposal with several competitors and the statistical analysis confirmed its superiority in terms of effectiveness, while it keeps very competitive in terms of efficiency.
|Funding agencies||Ministerio de Economía y Competitividad (MINECO). España
Junta de Andalucía
Ministerio de Ciencia e Innovación (MICIN). España
|Citation||Roldán Salvador, J.C., Jiménez Aguirre, P., Szekely, P. y Corchuelo Gil, R. (2021). TOMATE: A heuristic-based approach to extract data from HTML tables. Information Sciences, 577 (October 2021), 49-68.|
|TOMATE A heuristic-based approach ...||3.090Mb||[PDF]||View/|