WordlleBot

Last updated: 23 September 2026

What is WordlleBot?

WordlleBot is the crawler used by Wordlle, a content platform. It checks a website’s own pages so that articles written for that website link only to pages that really exist.

When does it visit?

Only when a Wordlle customer asks Wordlle to add internal links for their own website, for example when they generate an article. It does not crawl the web in general.

How to recognise it

WordlleBot identifies itself with this user agent:

Mozilla/5.0 (compatible; WordlleBot/1.0; +https://wordlle.ai/bot)

What it fetches

your robots.txt and XML sitemap files;
the first part (up to 64 KB) of up to about 50 pages per article — enough to read the title, main heading and basic tags.

How it behaves

It follows your robots.txt rules.
It makes at most 6 requests to your site at a time, and backs off if your server says “slow down” (429) or is unavailable (503).
It never submits forms, logs in or visits pages behind a login.
It keeps only a short-lived copy of your sitemap files, never stores your pages’ content, and never uses it to train AI models.

How to block WordlleBot

Add these lines to your robots.txt file:

User-agent: WordlleBot
Disallow: /

Note: if you block WordlleBot, Wordlle can’t add internal links to articles for your site.

How to allow WordlleBot (if your firewall blocks it)

In your firewall or security service, create a rule that allows requests whose user agent contains “WordlleBot”.
In a website security plugin, add WordlleBot to its allowlist or relax its rate limiting for it.
Otherwise, ask your hosting provider to allow the user agent above.

IP addresses

WordlleBot does not use a fixed IP address yet, so please allow it by its user agent.