Design of a Focused Crawler Based on Dynamic Computation of Topic Specific Weight

Abstract- Focused Crawler aims to select relevant web pages from internet. These pages are relevant to some predefined topics. Previous focused crawlers have a problem of not keeping track of user interest and goals.The topic weight table is calculated only once statically and that is less sensitive to potential changes in environment. To address this problem we design a focused crawler based on dynamic computation of topic keywords and their weights. This weight table is constructed according to user query. To check the similarity of web page with respect to the topic keywords, a cosine similarity function is used and priority of extracted links is calculated