Kcreately-SEO-Monitor.
If you found this page from an entry in your server logs, this is the crawler that made the request. Everything you need to identify it, verify what it did, or block it is below.
What this crawler does
Kcreately-SEO-Monitor reads publicly available pages to monitor SEO and content changes on behalf of our clients. It looks at the same things any visitor or search engine crawler sees — page titles, meta descriptions, headings, links, and visible copy — and records when they change over time.
It crawls slowly and deliberately. Sites we monitor under an agreement are fetched at most once per second, with no more than two requests in flight at a time. Sites we have no agreement with are crawled at half that — one request every two seconds, one at a time. If your robots.txt sets a Crawl-delay that is slower than our own limit, yours becomes the ceiling. If it is still causing a problem on your site, email us and we will slow it down or stop it.
Strictly read-only
The crawler only issues requests to fetch pages. It never:
- Submits forms of any kind
- Logs in, or attempts to access anything behind authentication
- Creates, edits, or deletes anything on your site
- Attempts to access private, admin, or non-public areas
It reads what is publicly served to it and nothing else. Nothing it does changes the state of your site. Only GET and HEAD requests are ever issued — anything else is refused at the point where requests are made, so a form submission is not something it is able to do. It also skips cart, checkout, login, logout, and admin paths outright, even when it finds them linked.
It respects robots.txt
The crawler fetches your robots.txt at the start of every run, before requesting any page. Rules written for our token, and rules written for *, are both obeyed, as is Crawl-delay.
If we cannot read your robots.txt at all — because it times out, or a firewall refuses to serve it — we treat that as a refusal and skip the site. We do not assume permission we were not given.
How to identify it in your logs
Every request the crawler makes carries this exact user-agent string. Match on it to find our requests in your access logs:
Kcreately-SEO-Monitor/1.0 (+https://kcreately.co/crawler; crawler@kcreately.co)Any request claiming to be Kcreately-SEO-Monitor that does not match this string is not us — please report it to the contact address below.
How to block it
To stop the crawler from accessing your site entirely, add this to your robots.txt:
User-agent: Kcreately-SEO-Monitor
Disallow: /To keep it out of specific areas only, list those paths instead:
User-agent: Kcreately-SEO-Monitor
Disallow: /private/
Disallow: /checkout/Because robots.txt is re-read at the start of every run, a new rule takes effect the next time the crawler visits. If you would rather not wait, email us and we will remove your domain directly.
Questions or removal requests
Email crawler@kcreately.co with any question about this crawler — including a request to remove your domain from our monitoring entirely. A person reads that address, and we reply as soon as we can. Removal requests are the ones we pick up first.