What Barkrowler does
Barkrowler is the crawler operated by Babbar.tech to maintain a graph representation of the web that powers its SEO and marketing tools. It crawls publicly cited URLs, including redirect and 404 pages, so temporary states are not missed. Crawled page content is not stored; the system keeps only links and meta-information about pages, and no nominative data is retained. By default it waits 5 seconds between two requests to the same host and 2.5 seconds between requests to the same IP of the same domain.
How to control Barkrowler
Target Barkrowler in your robots.txt with the Barkrowler token. Rules apply per bot, so you can allow this one while blocking others, or the reverse.
Allow Barkrowler
User-agent: Barkrowler
Allow: /Block Barkrowler
User-agent: Barkrowler
Disallow: /Babbar publishes Barkrowler's IP ranges at https://www.babbar.tech/barkrowler-ip-ranges.json and supports reverse DNS verification against the babbar.eu suffix.
How to identify Barkrowler
Temso identifies Barkrowlertraffic by matching the request's User-Agent header against this pattern. User-agent strings can be spoofed, so treat a match as an indication, not proof.
BarkrowlerBarkrowler FAQ
What is Barkrowler?
Barkrowler is Babbar.tech's web crawler. It builds and maintains a graph representation of the web for Babbar's SEO tools, storing links and page meta-information rather than page content.
How do I block Barkrowler?
Add a robots.txt group with 'User-agent: Barkrowler' and 'Disallow: /' (or disallow specific sections only). The bot honors robots.txt disallow directives and accepts a custom Crawl-delay in a barkrowler user-agent group if you want to slow it down instead.
About SEO & Analytics Crawlers
Crawlers behind SEO and marketing-intelligence platforms: backlink databases, site audits, rank tracking, and brand monitoring.
Blocking these has no effect on search or AI visibility. It mainly limits what third-party tools (including your competitors' tools) can see about your site.
