BlogPulse: Automated trend discovery for weblogs

Over the past few years, weblogs have emerged as a new com-munication and publication medium on the Internet. In this pa-per, we describe the application of data mining, information ex-traction and NLP algorithms for discovering trends across our sub-set of approximately 100,000 weblogs. We publish daily lists of key persons, key phrases, and key paragraphs to a public web site, BlogPulse.com. In addition, we maintain a searchable index of we-blog entries. On top of the search index, we have implemented trend search, which graphs the normalized trend line over time for a search query and provides a way to estimate the relative buzz of word of mouth for given topics over time. 1