LinkWeaveBot

LinkWeaveBot crawls a website only when a LinkWeave AI user adds that site and starts a scan. It reads public pages to count internal links and suggest new ones.

How it identifies itself

User agent: LinkWeaveBot/0.1 (+https://linkweaveai.com/bot)

How it behaves

• Follows robots.txt rules for LinkWeaveBot and for *.
• Reads at most 200 pages per scan, with at most 3 requests in flight and a pause between requests.
• Skips pages marked noindex, images, PDFs and other non-HTML files.
• Never submits forms or logs in.

How to block it

Add this to your robots.txt:

User-agent: LinkWeaveBot
Disallow: /

Questions or problems: [email protected]