User-agent: Mediapartners-Google* Disallow: # FULL access (Alta Vista) User-agent: Scooter Disallow: # FULL access (FAST/AllTheWeb) User-agent: FAST-WebCrawler Disallow: # FULL access (Google) User-agent: Googlebot Disallow: # FULL access (Inktomi) User-agent: Slurp Disallow: # FULL access (Lycos) User-agent: Lycos_Spider_(T-Rex) Disallow: # FULL access (All Spiders) User-agent: * Disallow: Sitemap: https://www.webcomindia.net/sitemap.xml