# /robots.txt file for http://www.clivepanto.co.uk # created 16.11.06 # dan [at] squarebracket [dot] net # NOTE: I added these robots directives because I noticed that some pages from # the old site were appearing on Google. Ideally I would remove these pages and create # a custom 404 page which leads visitors back to the homepage, but I don't think custom # 404 pages are supported by the web hosts - dAN User-agent: * Disallow: /_css Disallow: /_data Disallow: /_images Disallow: /_swf Disallow: /oldSite Disallow: /sections Disallow: /sounds Disallow: /W3SVC111 Disallow: welcome.html Disallow: indexInner.html Disallow: spotlightMenu.swf Disallow: index.OLD.html Disallow: index.OLD_2.html Disallow: stats.html User-agent: Googlebot-Image Disallow: /_images