What Marfeel Audits does
The Marfeel Audits Crawler periodically re-crawls URLs that receive traffic on sites using Marfeel's analytics platform, checking for structural issues and metadata problems. Like all Marfeel crawlers, it only visits canonical URLs and their amphtml counterparts, and it does not proactively crawl sites to discover new content: Marfeel only crawls URLs with active users. It identifies as mrfCompass-Booldog for mobile and desktop pages and mrfCompass-Marshall for amphtml pages. Re-crawls are rate limited to 1,000 requests every 5 minutes.
How to identify Marfeel Audits
Temso identifies Marfeel Auditstraffic by matching the request's User-Agent header against this pattern. User-agent strings can be spoofed, so treat a match as an indication, not proof.
mrfCompass-(Booldog|Marshall)Marfeel Audits FAQ
What is Marfeel Audits?
Marfeel Audits is a crawler from the publisher analytics company Marfeel that periodically re-crawls URLs receiving traffic on customer sites to detect structural issues and metadata problems. It only visits canonical URLs and their amphtml counterparts and does not crawl sites to discover new content.
Can I block Marfeel Audits with robots.txt?
Marfeel's documentation does not describe robots.txt handling; its crawlers run as part of the Marfeel product on customer sites and only crawl URLs that receive traffic. To control it at the server level, filter by its user agents (mrfCompass-Booldog and mrfCompass-Marshall) or by the static IPs Marfeel publishes at hub.marfeel.com/crawler-ips.json.
About SEO & Analytics Crawlers
Crawlers behind SEO and marketing-intelligence platforms: backlink databases, site audits, rank tracking, and brand monitoring.
Blocking these has no effect on search or AI visibility. It mainly limits what third-party tools (including your competitors' tools) can see about your site.
