Repositorio de producción científica de la Universidad de Sevilla

An Architecture for Efficient Web Crawling

 

Advanced Search
 
Opened Access An Architecture for Efficient Web Crawling
Cites

Show item statistics
Icon
Export to
Author: Hernández Salmerón, Inmaculada Concepción
Rivero, Carlos R.
Ruiz Cortés, David
Corchuelo Gil, Rafael
Department: Universidad de Sevilla. Departamento de Lenguajes y Sistemas Informáticos
Date: 2012
Published in: CAiSE 2012: International Conference on Advanced Information Systems Engineering (2012), p 228-234
ISBN/ISSN: 978-3-642-31068-3
1865-1348
Document type: Presentation
Abstract: Virtual Integration systems require a crawling tool able to navigate and reach relevant pages in the Deep Web in an efficient way. Existing proposals in the crawling area fulfill some of these requirements, but most of them need to download pages in order to classify them as relevant or not. We propose a crawler supported by a web page classifier that uses solely a page URL to determine page relevance. Such a crawler is able to choose in each step only the URLs that lead to relevant pages, and therefore reduces the number of unnecessary pages downloaded, minimising bandwidth and making it efficient and suitable for virtual integration systems.
Cite: Hernández Salmerón, I.C., Rivero, C.R., Ruiz Cortés, D. y Corchuelo Gil, R. (2012). An Architecture for Efficient Web Crawling. En CAiSE 2012: International Conference on Advanced Information Systems Engineering (228-234), Gdańsk, Poland: Springer.
Size: 166.5Kb
Format: PDF

URI: http://hdl.handle.net/11441/66162

DOI: 10.1007/978-3-642-31069-0_20

See editor´s version

This work is under a Creative Commons License: 
Attribution-NonCommercial-NoDerivatives 4.0 Internacional

This item appears in the following Collection(s)