Some cookies are necessary for SecondDoor to work. Others are optional, and tell us how the site and the product are used. Accept all, or decline all optional ones. Without a selection, nothing optional is set. More in our cookie policy.
Basic scanPublisher · Blog property/Scanned 8 Sept 2026, 16:04 UTC/1 browser pass
AI crawlers are blocked at the network edge despite robots.txt permission, preventing agents from reading the content the site publishes.
Wide. Agents are dropping out well before humans do.
Ordered by what the evidence says is costing most. Written for whoever owns the site, not whoever builds it.
3 pieces of evidence and the recommended fix are recorded for this issue, with /.well-known/security.txt written from your own pages.
This is a basic scan, so it raises the three issues the deterministic evidence supports. A deep scan sends two agents over the site and raises up to ten, each with cited evidence and the screens to prove it.
A deep scan walks the site with two agents, records cited evidence and screenshots, and keeps a mission timeline. It comes with the paid plans. Making an account costs nothing and gives you one basic scan a month.
The score and the audit trail stay public. The evidence and the files open with an account.
The audit trail behind every number above. Not measured is not zero.
Machine discoverability
Robots.txt names 1 AI crawler explicitly and allows 14 AI agents including GPT, Claude, Perplexity and Google Extended. A sitemap index declares 416 URLs.
4 observations recorded.
Programmatic onboarding
Not scored: a blog is not measured on this.
Pricing legibility
Not scored: a blog is not measured on this.
Agent-aware instrumentation
Robots.txt names claudebot and allows 14 AI agents, but no MCP manifest exists at the 3 standard paths checked. No llms.txt, ai-plugin.json or OpenAPI spec published.
4 observations recorded.
Machine-fetchable trust
The homepage answers automated requests with HTTP 200 and structured data. No security.txt file exists at /.well-known/security.txt. No Web Bot Auth signals are published.
2 observations recorded.
Commercial rails
Not scored: a blog is not measured on this.
Steps to first value
The primary call to action, 'Get Started with Digital CS', is 2 steps from the homepage and leads to a signup form. The form is 2 steps away. A visitor reaches the entry point in 2 clicks and can begin reading content immediately after.
1 observation recorded.
Required fields
The signup form contains 2 fields total. 1 of 2 is required: 'Enter Email'. The other field is optional. A visitor can sign up with minimal friction by providing only an email address.
1 observation recorded.
Verification walls
The signup page does not display any verification requirement such as email confirmation, phone verification or CAPTCHA. A visitor can submit the form without evidence of a verification step appearing on the page itself, though.
1 observation recorded.
Error recovery
Of 3 form inputs on the signup page, 1 carries a validation rule and 1 carries a description. No inline error containers or live regions are present.
1 observation recorded.
It got through 5 of 13.
The agent got through 5 of 13 requests, but could not ask whether the door opens for requests carrying the AI crawlers' names. It came up empty on 7 other checks too. That is enough missing for a machine to give up before it reaches a purchase.