# robots.txt for thatchergraham.com # www.robotstxt.org/ User-agent: * Allow: / User-agent: 008 Disallow: / User-agent: GPTbot Disallow: / User-agent: Google-Extended Disallow: / User-agent: Mediapartners-Google Disallow: User-agent: AdsBot-Google Crawl-delay: 4 User-agent: CCBot Crawl-delay: 4 User-agent: Cliqzbot Disallow: / User-agent: coccoc Crawl-delay: 4 User-agent: discobot Disallow: / User-agent: duckduckbot Disallow: User-agent: dotbot Disallow: / User-agent: facebookexternalhit Disallow: User-agent: Googlebot Disallow: User-agent: ia_archiver Disallow: / User-agent: MJ12bot Disallow: / User-agent: msnbot Crawl-delay: 120 User-Agent: OmniExplorer_Bot Disallow: / User-agent: Slurp Crawl-delay: 4 User-agent: Swiftbot Crawl-delay: 4 User-agent: teoma Crawl-delay: 4 User-agent: Telefonica Crawl-delay: 4 User-agent: Twitterbot Crawl-delay: 4 User-agent: voltron Disallow: / User-agent: yacybot Disallow: / User-agent: Yandex Crawl-delay: 4 #SITEMAP Sitemap: https://thatchergraham.com/sitemap.xml