## robots.txt for http://www.w3.org/ ## $Id: robots.txt,v 1.17 1998/10/25 02:37:04 renaudb Exp $ ## For use by search.w3.org User-agent: W3Crobot/1 Disallow: /Out-Of-Date # AltaVista Search User-agent: AltaVista Intranet V2.0 W3C Webreq Disallow: /Out-Of-Date User-agent: * Disallow: /hits # This is restricted to W3C Members only Disallow: /webalizer # This is restricted to W3C Members only Disallow: /webgraph # This is restricted to W3C Team only Disallow: /oldsite # This is restricted to W3C Members only Disallow: /webalizergraphical # This is restricted to W3C Team only Disallow: /images