What Marfeel Social does
Marfeel Social is the crawler Marfeel uses to power social experiences on Facebook, X (Twitter), Telegram, Reddit, and LinkedIn. It identifies itself with mrfCompass-Social/1.0 in its user agent and crawls from Marfeel's public IP addresses, which are published in a crawler-ips.json file. Marfeel asks publishers to whitelist these IPs in their WAF or security systems, including on Cloudflare, so the crawler is not blocked.
How to control Marfeel Social
Target Marfeel Social in your robots.txt with the mrfCompass-Social token. Rules apply per bot, so you can allow this one while blocking others, or the reverse.
Allow Marfeel Social
User-agent: mrfCompass-Social
Allow: /Block Marfeel Social
User-agent: mrfCompass-Social
Disallow: /Requests can be verified by checking that a reverse DNS lookup on the source IP resolves to crawler.marfeel.com, and Marfeel publishes its crawler IP addresses in a crawler-ips.json file.
How to identify Marfeel Social
Temso identifies Marfeel Socialtraffic by matching the request's User-Agent header against this pattern. User-agent strings can be spoofed, so treat a match as an indication, not proof.
mrfCompass-SocialMarfeel Social FAQ
What is Marfeel Social?
Marfeel Social is a Marfeel crawler that fetches pages to support social experiences on Facebook, X (Twitter), Telegram, Reddit, and LinkedIn. It identifies itself with mrfCompass-Social/1.0 in its user agent and crawls from Marfeel's published public IP addresses.
How do I block Marfeel Social?
Add a robots.txt group with "User-agent: mrfCompass-Social" followed by "Disallow: /". Note that Marfeel's documentation instead recommends whitelisting its published crawler IPs in your WAF so the crawler is not blocked.
About Operational Bots
Monitoring, security scanning, link previews, webhooks, and feed fetchers: the utility traffic that keeps integrations and shared links working.
Most of this traffic is service-critical or user-triggered. Webhooks and previews don't follow robots.txt, and blocking them tends to break things you rely on.
