User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: PetalBot Disallow: / User-agent: Bytespider Disallow: / User-agent: Amazonbot Disallow: / User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Google-Extended Disallow: / User-agent: meta-externalagent Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: Barkrowler Disallow: / User-agent: SeekportBot Disallow: / User-agent: Diffbot Disallow: / User-agent: magpie-crawler Disallow: / User-agent: Timpibot Disallow: / User-agent: * # Public pages Allow: /$ Allow: /movie/ Allow: /movies/movie/ Allow: /movies/category/ Allow: /category/ Allow: /anime/ Allow: /manga/ Allow: /read/ Allow: /watch/ # /movies/ homepage redirects to / — crawlers should use / directly Disallow: /movies/$ # /main/ redirects to / — no indexable content here Disallow: /main/ # Admin Disallow: /watch2d/watch2d_admin/ # Auth Disallow: /accounts/ Disallow: /logout/ # AJAX / API Disallow: /ajax/ Disallow: /api/ Disallow: /resolve-download/ Disallow: /check-streamable/ Disallow: /stream/ Disallow: /access/ Disallow: /wp_auth_encrypt_ping/ # Management Disallow: /anime/management/ Disallow: /manga/management/ # Action endpoints Disallow: /movie/*/like/ Disallow: /movie/*/watchlist/ Disallow: /movie/*/comment/ Disallow: /comment/*/delete/ # PWA internals Disallow: /sw.js Disallow: /offline.html Disallow: /api/push-subscribe/ # Assets Disallow: /static/ Disallow: /media/ # Search result pages (avoid crawling paginated/filtered duplicates) Disallow: /movies/search/ Disallow: /anime/search/ Disallow: /manga/search/ Sitemap: https://watch2d.org/sitemap.xml Crawl-delay: 2