What Cotoyogi does
Cotoyogi is a web crawler operated by the Center for Research and Development on Data Lake at ROIS-DS, a Japanese research organization, to collect Japanese-language data resources for AI training. It identifies itself with the user-agent string "Mozilla/5.0 (compatible; Cotoyogi/4.0; +https://ds.rois.ac.jp/center8/crawler/)" and crawls from the published IP range 157.1.136.4 to 157.1.136.11. It obeys robots.txt, including wildcard rules and the Crawl-delay directive (for example, Crawl-delay: 30.0 limits it to one request every 30 seconds), and it honors a robots meta tag with content="nofollow" to stop link following. Webmasters can also send requests to crawler@rois.ac.jp with their site's hostname, aliases, and IP addresses.
How to control Cotoyogi
Target Cotoyogi in your robots.txt with the Cotoyogi token. Rules apply per bot, so you can allow this one while blocking others, or the reverse.
Allow Cotoyogi
User-agent: Cotoyogi
Allow: /Block Cotoyogi
User-agent: Cotoyogi
Disallow: /Cotoyogi crawls from a published IP range (157.1.136.4 to 157.1.136.11) and supports wildcard rules and the Crawl-delay directive in robots.txt as well as robots meta tags.
How to identify Cotoyogi
Temso identifies Cotoyogitraffic by matching the request's User-Agent header against this pattern. User-agent strings can be spoofed, so treat a match as an indication, not proof.
CotoyogiCotoyogi FAQ
What is Cotoyogi?
Cotoyogi is a web crawler operated by the Center for Research and Development on Data Lake at ROIS-DS that collects Japanese-language data resources. It identifies itself as Cotoyogi/4.0 and crawls from the IP range 157.1.136.4 to 157.1.136.11.
How do I block Cotoyogi?
Add a robots.txt group with "User-agent: Cotoyogi" followed by "Disallow: /". The crawler also supports wildcard rules and Crawl-delay for rate limiting, honors a robots meta tag with content="nofollow", and its operator accepts requests by email at crawler@rois.ac.jp.
About AI Training Crawlers
Crawlers that collect content to train foundation models. Data gathered today shapes what future model versions know about your brand.
Blocking these doesn't affect live citations, but it limits what future models learn about you from your own site, leaving third-party sources to fill the gap.
