|
Webpage CrawlerDescriptionA Perlscripts to create an index over several webpages. A second creates an index over all words with ranking of the page.Also a CGI-Script is supplied to search the files and give ranked results. Features
TODODocumentation is poor.Implement ONLYFILE similar to pagefetch. Using a configfile instead of editing the .pl direct Consider using a common codebase foo.pm for pagefetch and crawl. See TODO WishlistDownloadcrawl_1.0.tar.bz2 |