General information

For information please see the Language Observatory Project page and the UbiCrawler Project page.

How to Stop UbiCrawler

UbiCrawler supports the Robot Exclusion Standard. if you want to exlcude your site from being crawled by UbiCrawler see The Web Robots Pages.

Briefly, you can put this robots.txt file at the root of the web server you want to exclude from the crawling.

For any information, feel free to email s077003@ics.nagaokaut.ac.jp.