About Our Crawler

What is this crawler?

Lyrapro is an SEO audit and website analysis platform operated by PMW Communications Limited. When a user of our platform runs an audit on a website, our crawler visits the publicly accessible pages of that site to collect technical SEO data — page titles, metadata, response codes, performance indicators, and similar information.

This is the same category of activity performed by other SEO audit tools such as Screaming Frog, Ahrefs Site Audit, and Moz Pro. It is standard practice in the SEO industry.

What does it do?

• Fetches publicly accessible pages via standard HTTP requests
• Reads page titles, meta descriptions, headings, and link structure
• Checks HTTP response codes and redirect chains
• Submits URLs to Google PageSpeed Insights for performance data
• Reads your robots.txt and respects all directives
• Identifies itself honestly — it never impersonates a human browser

Our crawler does not log in to password-protected areas, submit forms, execute purchases, or access any non-public content.

Will it appear in Google Analytics?

No. Google Analytics fires only when JavaScript executes in a real browser session. Our crawler uses standard HTTP requests — no JavaScript is executed, so no Analytics events are triggered. You will not see a traffic spike in GA4 or Universal Analytics as a result of a Lyrapro audit.

You may see requests in your server access logs or CDN/firewall dashboards (Cloudflare, etc.) with the user-agent string shown above. This is expected and harmless.

How do I block it?

Add the following to your robots.txt file:

User-agent: Lyrapro
Disallow: /

Our crawler checks robots.txt before visiting any pages and will respect a Disallow: / directive immediately.

Crawl frequency and rate limiting

Our crawler only visits a site when a user explicitly requests an audit — it does not run continuously or re-crawl sites on a schedule. Crawls are rate-limited and a site will typically be visited only once per audit request, with a reasonable delay between page fetches.

Contact

If you have questions or concerns about a crawl of your site, please contact PMW Communications Limited:

[email protected]