Merki viðbótar: robots.txt
-
-
Check Search Engine Visibility on Migration
(1 samtals einkunnagjafir)Checks if a site it's inivisible to search engines after a migration. If so, then the plugin warns you to review this setting.
-
AI Deny
(1 samtals einkunnagjafir)Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.
-
Unblock CSS & JS for Googlebot
(0 samtals einkunnagjafir)Modifies robots.txt to allow Googlebot access JS and CSS files.
-
CeeWP Robots.txt Manager
(0 samtals einkunnagjafir)Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
-
Block Common Crawl via robots.txt
(0 samtals einkunnagjafir)Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
-
Copyright AI Content Licensing – Block AI Crawlers + Get Paid
(0 samtals einkunnagjafir)AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.
-
Block Feed and Comments via robots.txt
(0 samtals einkunnagjafir)Blocks some Feed and Comment resources in order to avoid spam bots
-
IntentDeep Virtual Files – AI-Ready: Robots.txt, Security.txt, Ads.txt, LLMS.txt
(1 samtals einkunnagjafir)Create robots.txt, ads.txt, security.txt, llms.txt & JSON files with AI-ready content generation (ChatGPT, Claude, Gemini) at any path. No FTP needed.
-
ChatBot Blocker by CellarWeb
(0 samtals einkunnagjafir)ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.
-
LJPL Armored robots.txt
(0 samtals einkunnagjafir)Add some directives to your robots.txt file to keep your site safer
-
ProAI TXT Manager for LLMS and Robots
(1 samtals einkunnagjafir)Automatically generates and manages llms.txt and robots.txt files for your WordPress site with AI-optimized content.
-
Thin Content Manager
(1 samtals einkunnagjafir)See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.
-
Robots.txt Extender
(0 samtals einkunnagjafir)Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
-
HumanGate
(0 samtals einkunnagjafir)Protect your content from AI training crawlers and scraping bots. Add refusal signals, enforce blocks, and deter large-scale extraction.
-
A3 Robots Warning
(0 samtals einkunnagjafir)Warns you of server IP address changes, so you can take care of Search Engine Visibility settings.
-
Elthian AI Licensing Lite
(0 samtals einkunnagjafir)Manage how AI models interact with your content. Implements llms.txt, robots.txt, AI Sitemaps, and machine-readable JSON policies.
-
SEO Auditor Tools
(0 samtals einkunnagjafir)Scan your WordPress site for SEO issues and get actionable fixes. Includes sitemap, robots.txt, LLMS.txt, Open Graph, cookie consent, analytics, UTM b …
-
Kandeshop LLMS.txt Generator
(0 samtals einkunnagjafir)Create and manage an llms.txt file from your WordPress admin to guide LLM/AI crawlers. Set policies and disallow rules.
-
Virtual LLMS.TXT Generator
(0 samtals einkunnagjafir)Safely creates a virtual llms.txt dynamically. Features interactive bot targeting, map auto-syncing, and decoupled custom instructions.