# START YOAST BLOCK # --------------------------- User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://sthenostechnologies.com/sitemap_index.xml # AI and LLM crawlers are deliberately allowed. Machine-readable site summary: # https://sthenostechnologies.com/llms.txt # --------------------------- # END YOAST BLOCK # Explicit allow for the AI search and assistant crawlers (Perplexity's documented # recommendation; the others are listed so no crawler has to infer from the wildcard). # Parity with the wildcard group: wp-admin stays closed except admin-ajax. User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Claude-SearchBot User-agent: Claude-User User-agent: Googlebot User-agent: bingbot User-agent: Applebot User-agent: DuckAssistBot Allow: /wp-admin/admin-ajax.php Disallow: /wp-admin/ Allow: /