# Global rules User-Agent: * Allow: /wp-content/uploads/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-admin/ Disallow: /readme.html Disallow: /refer/ Disallow: /wp-json/ Crawl-delay: 600 Sitemap: https://www.lawyerly.com.au/sitemap_index.xml # Block GPTBot and Google-Extended User-Agent: GPTBot Disallow: / User-Agent: Google-Extended Disallow: / # Block specific bots User-Agent: Nuclei Disallow: / User-Agent: WikiDo Disallow: / User-Agent: Riddler Disallow: / User-Agent: PetalBot Disallow: / User-Agent: Zoominfobot Disallow: / User-Agent: Go-http-client Disallow: / User-Agent: Node/simplecrawler Disallow: / User-Agent: CazoodleBot Disallow: / User-Agent: dotbot/1.0 Disallow: / User-Agent: Gigabot Disallow: / User-Agent: Barkrowler Disallow: / User-Agent: BLEXBot Disallow: / User-Agent: magpie-crawler Disallow: / User-agent: LinkedInBot Disallow: /