What TermlyBot does
TermlyBot is the scanner used by Termly's Cookie Consent Manager; it loads a customer's website to detect the cookies in use. It honors robots.txt, so a Disallow rule that covers it causes cookie scans to fail, and Termly documents an 'Allow: /' group for the TermlyBot user agent to permit scanning while other bots stay disallowed. Termly also publishes four scanner IP addresses to allowlist when a firewall or hosting provider blocks the scan. If the homepage does not finish loading within 60 seconds, the scanner times out and returns a page load failure.
How to control TermlyBot
Target TermlyBot in your robots.txt with the TermlyBot token. Rules apply per bot, so you can allow this one while blocking others, or the reverse.
Allow TermlyBot
User-agent: TermlyBot
Allow: /Block TermlyBot
User-agent: TermlyBot
Disallow: /Termly documents that a robots.txt Disallow can make its scans fail and publishes four scanner IP addresses (44.242.40.109, 44.225.121.171, 52.37.21.48, 52.40.238.4) to allowlist.
How to identify TermlyBot
Temso identifies TermlyBottraffic by matching the request's User-Agent header against this pattern. User-agent strings can be spoofed, so treat a match as an indication, not proof.
TermlyBotTermlyBot FAQ
What is TermlyBot?
TermlyBot is the scanner behind Termly's Cookie Consent Manager; it loads a customer's website to detect and categorize the cookies in use. It scans from four published IP addresses and times out if the homepage takes more than 60 seconds to load.
How do I block TermlyBot?
Add a robots.txt group with 'User-agent: TermlyBot' and 'Disallow: /'. Termly's documentation indicates the scanner respects robots.txt disallows, and blocking it will cause cookie scans run from a Termly account for your site to fail.
About Operational Bots
Monitoring, security scanning, link previews, webhooks, and feed fetchers: the utility traffic that keeps integrations and shared links working.
Most of this traffic is service-critical or user-triggered. Webhooks and previews don't follow robots.txt, and blocking them tends to break things you rely on.
