Webz.io bots

2 bots in the directory · Reviewed July 2026

Webz.io operates 2 bots tracked in this directory. Each page below covers what the bot does and how to identify it.

Omgilibot

Crawls public web content for Webz.io data feeds licensed for AI training.

AI Training

VelenPublicWebCrawler

Collects public web content for Webz.io's licensed data feeds.

AI Training

Control every Webz.io bot at once

robots.txt lets one rule group target multiple user-agents. These snippets cover all 2 Webz.io tokens in this directory. For finer control, set rules per bot on each bot's page.

Allow all Webz.io bots

User-agent: omgilibot
User-agent: VelenPublicWebCrawler
Allow: /

Block all Webz.io bots

User-agent: omgilibot
User-agent: VelenPublicWebCrawler
Disallow: /
← Back to the AI Bot Directory