PliersBot
PliersBot is the web crawler behind Pliers. If you've seen it in your logs, this page explains why it visited and what you can do about it.
How to recognise it
PliersBot sends this user agent with every request:
PliersBot/1.0 (+https://pliers.dev/bot)
It never sends another crawler's user agent. To check how AI crawlers are treated, Pliers reads your robots.txt rules for them rather than pretending to be one.
We don't publish a fixed list of IP addresses. To confirm a visit was ours, email bot@pliers.dev with the time and the address it came from.
Why it visited your site
PliersBot only crawls a hostname after someone has added it to a Pliers account and proved they control it with a DNS TXT record named _pliers-verify. followed by the hostname. Only one Pliers account can verify a hostname.
So if PliersBot is crawling your site, someone with access to your domain's DNS asked it to: usually you, your web developer or your marketing agency. It visits to:
- run a site health audit, the way search engines and AI crawlers read the site
- read pages so Pliers can propose structured data for the owner to review
It doesn't log in, submit forms or post anything. It only sends GET requests.
What it fetches and how often
- Files:
/robots.txt,/llms.txt, your sitemaps (up to six sitemap files per audit) and the pages they and your internal links lead to. - How much: up to the page limit of the owner's plan for each audit, and only on verified hostnames. Redirects to any other hostname aren't followed.
- How fast: up to four requests at a time during an audit, each with a 30 second timeout.
- How often: on a schedule the site owner chooses, between daily and every 90 days (weekly is typical), plus when the owner starts a check by hand.
- How it reads: plain HTML, without running JavaScript, the way most AI crawlers read a page.
robots.txt
PliersBot reads your robots.txt to report which search and AI crawlers it allows or blocks.
PliersBot doesn't apply Disallow rules addressed to PliersBot itself, because it only crawls sites whose owners have verified them and asked for an audit, which includes reporting on what robots.txt blocks. To stop it visiting, see below.
How to slow it down or stop it
- If it's your Pliers account: change or turn off the site audit schedule in Settings, or remove the hostname under Domains.
- If you didn't expect it: email bot@pliers.dev with your hostname. We'll tell you whether it's verified in an account, and stop crawling it if the person who verified it no longer has your permission.
- To block it yourself: block requests whose user agent contains
PliersBotin your firewall, CDN or server settings. Pliers will report the site as unreachable to the account owner.