Architecture of a grid-enabled Web search engine

Search Engine for South-East Europe (SE4SEE) is a socio-cultural search engine running on the grid infrastructure. It offers a personalized, on-demand, country-specific, category-based Web search facility. The main goal of SE4SEE is to attack the page freshness problem by performing the search on th...

Full description

Saved in:
Bibliographic Details
Published in:Information processing & management 2007-05, Vol.43 (3), p.609-623
Main Authors: Cambazoglu, B. Barla, Karaca, Evren, Kucukyilmaz, Tayfun, Turk, Ata, Aykanat, Cevdet
Format: Article
Language:English
Subjects:
Computer architecture
Distributed processing
Grid computing
Search engine
Search engines
Searching
Studies
Text categorization
Text classification
Web crawling
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Search Engine for South-East Europe (SE4SEE) is a socio-cultural search engine running on the grid infrastructure. It offers a personalized, on-demand, country-specific, category-based Web search facility. The main goal of SE4SEE is to attack the page freshness problem by performing the search on the original pages residing on the Web, rather than on the previously fetched copies as done in the traditional search engines. SE4SEE also aims to obtain high download rates in Web crawling by making use of the geographically distributed nature of the grid. In this work, we present the architectural design issues and implementation details of this search engine. We conduct various experiments to illustrate performance results obtained on a grid infrastructure and justify the use of the search strategy employed in SE4SEE.
ISSN:0306-4573
1873-5371
DOI:10.1016/j.ipm.2006.10.011