NyroloBot Crawler Information

1. Identifying NyroloBot in Your Server Logs

When a freelancer or agency audits a website on Nyrolo, our cloud engine sends HTTP requests identifying itself with the following User-Agent string:

User-Agent: NyroloBot/1.0 (+https://nyrolo.com/crawler-info; audit-bot@nyrolo.com)

2. Crawl Politeness & Boundaries

NyroloBot is strictly bounded and will never scrape your entire database or overwhelm your hosting:

• Low Concurrency: A maximum of 3 concurrent requests per domain.
• Page Limit: Free scans stop after 25 pages; Pro scans stop after 100 pages.
• Timeout: Requests terminate after 8 seconds.
• Payload Cap: Discards response bodies exceeding 2 MB.
• No Form Submissions: NyroloBot never submits login forms or leads.

3. How to Block NyroloBot via robots.txt

NyroloBot strictly obeys standard robots.txt directives. To block NyroloBot from your entire site, add this snippet to your /robots.txt file:

User-agent: NyroloBot
Disallow: /

To block NyroloBot only from private staging paths:

User-agent: NyroloBot
Disallow: /staging/
Disallow: /private/