crawlers

Top Performers

AI Content Signals

Block AI Crawlers

Dark Visitors – Bot & AI Agent Analytics, Robots.txt Generator & Blocker, LLM Referral Tracker

Robots.txt rewrite

4 WordPress plugins in the crawlers category

Total Plugins

Active Installs

2.8K+

Average Score

Best Score

99.93

🥇

/ai-content-signals

Add Content Signals to your robots.txt to control how AI crawlers can use your content.

Score 991 error

v1.0.140+Scanned 28.12.2025, 18:00:13

🥈

/block-ai-crawlers

Tell AI (Artificial Intelligence) companies not to scrape your site for their AI products.

Score 993 errors

v1.5.41K+Scanned 15.11.2025, 08:23:31

🥉

/dark-visitors

Get realtime visibility into crawlers, scrapers, LLM assistants, and AI agents browsing your website. Generate a robots.txt to opt out of AI training.

Score 9520 errors6 warnings

v1.24.0800+Scanned 09.12.2025, 20:30:13

AI Content Signals

Block AI Crawlers

Dark Visitors – Bot & AI Agent Analytics, Robots.txt Generator & Blocker, LLM Referral Tracker

Robots.txt rewrite

/robotstxt-rewrite

Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

Score 7956 errors16 warnings

v1.6.11K+Scanned 15.11.2025, 01:44:00

Score Distribution

Number of plugins in each score range

81–1003 plugins

61–801 plugin

41–600 plugins

21–400 plugins

0–200 plugins

All Plugins

Complete leaderboard for plugins tagged "crawlers"

4 total row(s)