What DataForSeoBot does
DataForSeoBot crawls website pages and adds all links it finds to DataForSEO's backlink database. According to the documentation, it collects only link data, does not gather any other information about the site, and does not trigger ads or inflate traffic numbers. It identifies itself with the user agent 'Mozilla/5.0 (compatible; DataForSeoBot; +https://dataforseo.com/dataforseo-bot)' and obeys robots.txt, including the Crawl-delay directive, with a default delay of 5 seconds.
How to control DataForSeoBot
Target DataForSeoBot in your robots.txt with the DataForSeoBot token. Rules apply per bot, so you can allow this one while blocking others, or the reverse.
Allow DataForSeoBot
User-agent: DataForSeoBot
Allow: /Block DataForSeoBot
User-agent: DataForSeoBot
Disallow: /DataForSEO publishes the bot's IPv4 and IPv6 subnets (for example 136.243.220.208/29) and supports reverse DNS verification against the pattern crawling-gateway-*.dataforseo.com.
How to identify DataForSeoBot
Temso identifies DataForSeoBottraffic by matching the request's User-Agent header against this pattern. User-agent strings can be spoofed, so treat a match as an indication, not proof.
DataForSeoBotDataForSeoBot FAQ
What is DataForSeoBot?
DataForSeoBot is DataForSEO's web crawler. It visits pages and records the links it finds to build and maintain the company's backlink database, and it collects no other data about your site.
How do I block DataForSeoBot?
Add a robots.txt group with 'User-agent: DataForSeoBot' and 'Disallow: /'. The bot obeys robots.txt and the Crawl-delay directive, so you can also slow it down instead; if no delay is set it defaults to 5 seconds between requests.
About SEO & Analytics Crawlers
Crawlers behind SEO and marketing-intelligence platforms: backlink databases, site audits, rank tracking, and brand monitoring.
Blocking these has no effect on search or AI visibility. It mainly limits what third-party tools (including your competitors' tools) can see about your site.
