How to control FacebookBot
Target FacebookBot in your robots.txt with the FacebookBot token. Rules apply per bot, so you can allow this one while blocking others, or the reverse.
Allow FacebookBot
User-agent: FacebookBot
Allow: /Block FacebookBot
User-agent: FacebookBot
Disallow: /How to identify FacebookBot
Temso identifies FacebookBottraffic by matching the request's User-Agent header against this pattern. User-agent strings can be spoofed, so treat a match as an indication, not proof.
FacebookBotFacebookBot FAQ
What is FacebookBot?
FacebookBot is a user agent token associated with Meta. Meta's current crawler documentation does not list FacebookBot; it describes FacebookExternalHit, which crawls content shared on Facebook, Instagram, or Messenger, along with Meta-WebIndexer, Meta-ExternalAds, Meta-ExternalAgent, and Meta-ExternalFetcher.
How do I block FacebookBot?
Add a robots.txt group with User-agent: FacebookBot followed by Disallow: /. Note that Meta's documentation no longer describes this token, and it states that some of its crawlers, such as FacebookExternalHit during security or integrity checks and Meta-ExternalFetcher, may bypass robots.txt rules.
About Operational Bots
Monitoring, security scanning, link previews, webhooks, and feed fetchers: the utility traffic that keeps integrations and shared links working.
Most of this traffic is service-critical or user-triggered. Webhooks and previews don't follow robots.txt, and blocking them tends to break things you rely on.
