What Marfeel Preview does
Marfeel Preview is one of several crawlers Marfeel operates alongside its analytics platform, with mobile and desktop variants identified by user agents containing mrfCompass-Preview/1.0. Marfeel's other crawlers cover editorial metadata, page audits, flowcards, social previews, and autoposting images, under the mrfCompass and NewsRoom.BI names. Marfeel publishes its crawlers' static IP addresses at hub.marfeel.com/crawler-ips.json (and in range format at hub.marfeel.com/crawler-ip-ranges.json) and rate-limits re-crawls to 1,000 requests every 5 minutes.
How to control Marfeel Preview
Target Marfeel Preview in your robots.txt with the mrfCompass-Preview token. Rules apply per bot, so you can allow this one while blocking others, or the reverse.
Allow Marfeel Preview
User-agent: mrfCompass-Preview
Allow: /Block Marfeel Preview
User-agent: mrfCompass-Preview
Disallow: /Marfeel publishes static crawler IPs at hub.marfeel.com/crawler-ips.json and hub.marfeel.com/crawler-ip-ranges.json, and all of its crawler IPs reverse-resolve to crawler.marfeel.com; the documentation does not describe robots.txt handling.
How to identify Marfeel Preview
Temso identifies Marfeel Previewtraffic by matching the request's User-Agent header against this pattern. User-agent strings can be spoofed, so treat a match as an indication, not proof.
mrfCompass-PreviewMarfeel Preview FAQ
What is Marfeel Preview?
Marfeel Preview is a crawler in Marfeel's mrfCompass family, used by the Marfeel analytics platform, with mobile and desktop variants whose user agents contain mrfCompass-Preview/1.0. Its requests come from Marfeel's published static IPs, which reverse-resolve to crawler.marfeel.com.
How do I block Marfeel Preview?
Marfeel's documentation does not state whether its crawlers honor robots.txt. To block Marfeel Preview reliably, filter the static IP lists Marfeel publishes at hub.marfeel.com/crawler-ips.json, all of which reverse-resolve to crawler.marfeel.com. Since Marfeel crawls sites that use its platform, blocking it may affect your own Marfeel integration.
About Operational Bots
Monitoring, security scanning, link previews, webhooks, and feed fetchers: the utility traffic that keeps integrations and shared links working.
Most of this traffic is service-critical or user-triggered. Webhooks and previews don't follow robots.txt, and blocking them tends to break things you rely on.
