Categorized Crawler

A focused crawler traverses the web selecting out relevant pages to a predefined topic and neglecting those out of concern. While surfing the internet it is difficult to deal with irrelevant pages and to predict which links lead to quality pages. In this paper, a technique of effective focused crawling is implemented to improve the quality of web navigation. Here we develop a system which will concern on categories when we search something on net then it gives multiple choices but suppose we want only relevant choice then we have to go through multiple. So in that case we divide the choices in categories to make the crawler efficient.