What Mojeekbot does
MojeekBot is the web crawler for the Mojeek search engine, fetching and indexing pages to power Mojeek's search results. It requests no more than one page from a site within the same 1 second period and does not support the nonstandard crawl-delay directive. It follows the Robot Exclusion Standard, obeying the first robots.txt record whose User-Agent contains "MojeekBot" and otherwise falling back to the wildcard entry, and it honors the noindex, nocache, and nofollow meta tags.
How to control Mojeekbot
Target Mojeekbot in your robots.txt with the Mojeekbot token. Rules apply per bot, so you can allow this one while blocking others, or the reverse.
Allow Mojeekbot
User-agent: Mojeekbot
Allow: /Block Mojeekbot
User-agent: Mojeekbot
Disallow: /Genuine MojeekBot traffic can be verified by a reverse DNS lookup resolving to a mojeek.com hostname confirmed with a forward DNS lookup, or by matching the request IP against Mojeek's published list of MojeekBot IP addresses.
How to identify Mojeekbot
Temso identifies Mojeekbottraffic by matching the request's User-Agent header against this pattern. User-agent strings can be spoofed, so treat a match as an indication, not proof.
MojeekbotMojeekbot FAQ
What is Mojeekbot?
MojeekBot is the crawler that builds the index for the Mojeek search engine. It fetches at most one page from a site per 1 second period and respects robots.txt and the noindex, nocache, and nofollow meta tags.
How do I block Mojeekbot?
Add a robots.txt group with User-agent: MojeekBot and Disallow: /. MojeekBot obeys the first record whose User-Agent contains "MojeekBot" (falling back to the "*" entry), and it does not support the nonstandard crawl-delay directive; to keep a crawled page out of results, use a noindex meta tag instead.
About Search Engine Crawlers
Classic search indexers that now also feed AI features: Google's AI Overviews and AI Mode build on Googlebot's index, and Microsoft Copilot builds on Bingbot's.
Blocking these removes you from both traditional rankings and the AI answers built on top of those indexes, usually the most costly block of all.
