HermesStackBot/1.0
User-Agent: HermesStackBot/1.0 (+https://<site>/bot)
This bot fetches public storefront homepages only to measure technical stack attributes: commerce platform, theme hints, third-party script hosts, and coarse performance samples.
- Obeys robots.txt (Disallow → permanent skip)
- Max 1 request per 2 seconds per domain; max 4 concurrent domains
- Conditional GET (ETag / If-Modified-Since)
- Does not store product descriptions, prices, images, or customer data
- No CAPTCHA solving; no logged-in areas
Removal request
Email stackwatch-removal@localhost with your domain. We add it to the exclusion list and purge dataset rows. No re-crawl.