# Global rules User-agent: * Allow: /wp-admin/admin-ajax.php Disallow: /wp-admin/ Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Disallow: /*?add-to-cart= Disallow: /*?*add-to-cart= # Block search result pages Disallow: /*?s= Disallow: /search/* # Prevent crawling CF challenge URLs Disallow: /cdn-cgi/bm/cv/ Disallow: /cdn-cgi/challenge-platform/ # Low-value legacy endpoints Disallow: /trackback/ Disallow: /xmlrpc.php # Sitemap # ----------------- Sitemap: https://shinrinyoku.lt/sitemap.xml # Ban bots that don't benefit us (Polite request) # -------------------------------- User-agent: Nuclei User-agent: WikiDo User-agent: Riddler User-agent: PetalBot User-agent: Zoominfobot User-agent: Go-http-client User-agent: Node/simplecrawler User-agent: CazoodleBot User-agent: dotbot/1.0 User-agent: Gigabot User-agent: Barkrowler User-agent: BLEXBot User-agent: magpie-crawler Disallow: /