What Lumar does
Lumar, formerly Deepcrawl, operates a website crawler that collects data for its website intelligence platform, used to monitor a site's technical health and performance. The crawler responds to two user agent tokens, "lumar" and the legacy "deepcrawl", which is kept so existing customer configurations keep working. It does not support the crawl-delay directive; Lumar recommends bot management systems for granular rate control instead.
How to identify Lumar
Temso identifies Lumartraffic by matching the request's User-Agent header against this pattern. User-agent strings can be spoofed, so treat a match as an indication, not proof.
deepcrawl|lumarLumar FAQ
What is Lumar?
Lumar, formerly known as Deepcrawl, is a website intelligence platform whose crawler collects data used to monitor a site's technical health and performance. Its documentation states the crawler respects the robots.txt protocol.
Can I block Lumar with robots.txt?
Yes. Lumar respects robots.txt, so add a group with "User-agent: lumar" and "Disallow: /" (the legacy token "deepcrawl" also works). If crawling persists despite the exclusion, Lumar's documentation says to contact support@lumar.io.
About SEO & Analytics Crawlers
Crawlers behind SEO and marketing-intelligence platforms: backlink databases, site audits, rank tracking, and brand monitoring.
Blocking these has no effect on search or AI visibility. It mainly limits what third-party tools (including your competitors' tools) can see about your site.
