# robots.txt, www.carolinawebdirectory.com 2017-06-15 # # For: http://www.carolinawebdirectory.com/ # User-agent: Googlebot Disallow: User-agent: Mediapartners-Google* Disallow: User-agent: bingbot Disallow: User-agent: msnbot Disallow: User-agent: * Disallow: Sitemap: http://www.carolinawebdirectory.com/sitemap.xml Sitemap: http://www.carolinawebdirectory.com/sitemap.html Sitemap: http://www.carolinawebdirectory.com/sitemap.txt