## ## robots.txt ## ## This file is used to control the indexing of all Niagara College Web sites. ## Lines within this file can prevent search engine crawlers (robots) from ## indexing certains parts of the Web sites. ## ## Be very careful with this file, since it can prevent crawlers such as Google ## from indexing the sites. ## ## Details on A Standard for Robot Exclusion and this file are available from: ## http://www.robotstxt.org/wc/norobots.html ## ## Details on applying exclusions directly within HTML documents, excluding the ## use of the Atomz tag, are available from: ## http://www.robotstxt.org/wc/meta-user.html ## User-agent: * Disallow: /