firecrawl.dev

Journey

· Snapshot & citation

77.8/ 100

B · Ready with gaps

Waymark scored firecrawl.dev 77.8/100 (B) on 24 Aug 2026.

firecrawl.dev is usable with gaps. Discovery is the strongest layer, and Access is the open one. Next: openAPI document.

FindMixed
16.8/20
13 of 17 checks passed
DoorMixed
20.8/30
18 of 27 checks passed
ToolsMixed
32.4/40
11 of 15 checks passed
Pay
N/A
No cart or pay rail — out of the denominator.

What should the prompt cover?

17 findings · 15 selected

Failures (12)

Warnings (5)

Group by
1. Can an agent discover and trust you?ROBOTSSITEMAPDISCOVERYSKILLS 76/100

Whether an agent can find this origin from public files and treat it as the real one.

pass
HTTPS reachable 2/2
Evidence. Homepage responded 200 over HTTPS.
Probed homepage.
pass
robots.txt present 2/2
Evidence. Valid robots.txt with User-agent rules.
Probed robots.txt.
pass
XML sitemap 2/2
Evidence. Found sitemap.xml or sitemap index.
failed
Well-known AI catalog 0/1
Evidence. No ai-plugin.json or ai-catalog.json.
Recommended fix. Add /.well-known/ai-plugin.json or /.well-known/ai-catalog.json.
pass
AGENTS.md 1/1
Evidence. Found /agents.md.
partial
robots.txt AI policy Required 1/2
Evidence. robots.txt present but no named AI crawlers.
Probed robots.txt.
Recommended fix. Name GPTBot, ClaudeBot, Google-Extended, PerplexityBot and state allow or deny.
pass
Sitemap for agents Recommended 2/2
Evidence. Sitemap document fetched.
Probed sitemap.
failed
HTTP Link header bonus 0/1
Evidence. No rel=sitemap|describedby|api-catalog|alternate on homepage.
Probed homepage + sitemap.
Recommended fix. Send RFC 8288 Link headers for related machine resources.
failed
ai-plugin.json bonus 0/1
Evidence. No /.well-known/ai-plugin.json.
Probed well-known paths.
Recommended fix. Optionally publish a plugin-style capability manifest.
n/a
API catalog linkset bonus 0/2
Evidence. No public API catalog (N/A).
scanner error
Wikipedia sitelink bonus 0/4
Evidence. Wikidata SPARQL The operation was aborted
Scanner error — not counted as a site fail and not in the score denominator.
scanner error
Wikidata official website bonus 0/3
Evidence. Wikidata SPARQL The operation was aborted
Scanner error — not counted as a site fail and not in the score denominator.
scanner error
Brand official-website match Recommended 0/3
Evidence. Wikidata SPARQL The operation was aborted
Scanner error — not counted as a site fail and not in the score denominator.
pass
Public MCP registry listing bonus 1/1
Evidence. Registry hit at https://registry.modelcontextprotocol.io/v0/servers?search=firecrawl.
Probed public URLs named in the evidence.
pass
Package homepage match bonus 1/1
Evidence. npm package homepage matches firecrawl.dev.
Probed homepage.
pass
Sitemap lastmod bonus 1/1
Evidence. Sitemap has lastmod.
n/a
related-website-set bonus 0/1
Evidence. No related-website-set (N/A unless multi-origin).
n/a
ads.txt bonus 0/1
Evidence. No ads inventory (N/A).
2. Do you welcome agents?ROBOTSCRAWLBOT AUTH 88/100

Whether crawlers and signed bots are allowed through rather than blocked at the door.

pass
AI crawlers not blanket-blocked 2/2
Evidence. No blanket Disallow: / for common AI bots.
n/a
robots Crawl-delay bonus 0/1
Evidence. No Crawl-delay (optional).
n/a
Web Bot Auth keys Recommended 0/2
Evidence. No http-message-signatures-directory.
partial
CORS / API hint 0.5/1
Evidence. No CORS header or obvious API path.
Recommended fix. If you expose an API, send Access-Control-Allow-Origin for intended clients.
pass
CSP or X-Frame-Options 1/1
Evidence. CSP or X-Frame-Options present.
3. Does an agent understand who you are and what you do?HTMLJSON-LDLLMS.TXTSKILLSDOCSNLWEB 50/100

Whether the site explains the product in language a model can ingest.

pass
Title and description 2/2
Evidence. Title and meta description present.
failed
JSON-LD structured data 0/4
Evidence. No JSON-LD on the homepage.
Probed homepage.
Recommended fix. Add JSON-LD (Organization, WebSite, or SoftwareApplication).
pass
html lang attribute 1/1
Evidence. html[lang] is set.
failed
JSON-LD entities Recommended 0/4
Evidence. No JSON-LD.
Recommended fix. Embed Organization, Product, Offer, SoftwareApplication, or FAQPage.
n/a
JSON-LD sameAs bonus 0/2
Evidence. No JSON-LD.
n/a
Open Graph basics bonus 0/2
Evidence. No og meta with canonical.
pass
llms.txt 2/2
Evidence. Found /llms.txt with content.
pass
llms.txt index Recommended 2/2
Evidence. llms.txt has content.
pass
llms.txt size and links Recommended 2/2
Evidence. llms.txt 6921 chars, 36 URL(s).
pass
llms-full.txt bonus 1/1
Evidence. llms-full.txt present.
n/a
Section llms.txt bonus 0/1
Evidence. No /docs/llms.txt.
n/a
NLWeb schemamap bonus 0/1
Evidence. No schemamap (N/A unless you offer NL search).
failed
Trust pages Recommended 0/2
Evidence. No about/privacy/contact link.
Recommended fix. Link about or privacy from the homepage.
n/a
Speakable markup bonus 0/1
Evidence. No SpeakableSpecification (N/A unless voice content).
n/a
humans.txt bonus 0/1
Evidence. No /humans.txt (optional).
pass
security.txt Recommended 1/1
Evidence. RFC 9116 security.txt with Contact.
failed
RSS or Atom feed 0/1
Evidence. No RSS/Atom link.
Recommended fix. Expose an RSS or Atom feed for machine subscribers.
n/a
RSS or Atom document bonus 0/1
Evidence. No /feed or /rss.xml document.
4. Can an agent integrate with you?LINKSSKILLSDOCSAPIOPSMCPSDK 81/100

Whether there is a documented machine door into the product.

failed
OpenAPI / Swagger link 0/2
Evidence. No OpenAPI/Swagger link in HTML.
Probed OpenAPI.
Recommended fix. Link to an OpenAPI or Swagger document from the homepage.
pass
Login or docs link 3/3
Evidence. Login or developer docs link found.
pass
MCP well-known card 2/2
Evidence. MCP server card found under .well-known.
Probed well-known paths.
pass
MCP SSE / HTTP hint 1/1
Evidence. Page mentions MCP or SSE transport.
n/a
openapi.json fetchable 0/0
Evidence. API surface without a fetchable OpenAPI document.
Probed OpenAPI.
pass
Webhook or API docs 2/2
Evidence. Webhook or API docs mention found.
pass
Agent skills index 2/2
Evidence. Skills index or mention found.
failed
OpenAPI document Required 0/7
Evidence. OpenAPI probe.
Probed OpenAPI.
Recommended fix. Publish an OpenAPI document at a stable URL. Verify: curl -sI https://firecrawl.dev/openapi.json
pass
Public API surface Recommended 7/7
Evidence. Docs or API paths look callable.
pass
Developer portal Recommended 6/6
Evidence. Developer hub found.
pass
MCP server Recommended 6/6
Evidence. MCP probe.
pass
MCP server card Recommended 2/2
Evidence. MCP card JSON found.
pass
Agent Skills files bonus 2/2
Evidence. Skills file or index found.
pass
CLI tool Recommended 3/3
Evidence. CLI mention found.
pass
GraphQL GET hint bonus 2/2
Evidence. GraphQL GET or docs mention.
n/a
OpenAPI UI page bonus 0/1
Evidence. No swagger-ui/redoc page.
n/a
OpenAPI (legacy slot) 0/0
Evidence. API surface without OpenAPI.
Probed OpenAPI.
5. Is your integration well-built?APIMCP 100/100

Whether the integration surface is complete enough to call with confidence.

pass
MCP initialize Required 3/3
Evidence. initialize HTTP 200 at https://www.firecrawl.dev/api/mcp
Probed public URLs named in the evidence.
pass
MCP server card Recommended 2/2
Evidence. MCP card JSON found.
6. Can an agent use you reliably in production?MCPAPIOPS 45/100

Whether errors, idempotency, and limits are visible before a call fails.

partial
Rate limit signal Recommended 1/2
Evidence. API surface without a rate-limit signal.
Recommended fix. Document or send rate-limit headers on APIs.
partial
Idempotency signal Recommended 1/3
Evidence. API surface without idempotency notes.
Recommended fix. Document idempotency keys for mutating calls.
partial
Machine-readable errors Recommended 1/4
Evidence. API surface without a JSON error shape.
Recommended fix. Return a JSON or problem+json error body.
pass
Honest 404 Recommended 2/2
Evidence. 404/410 on probe path.
7. Can an agent authenticate to you?SDKOAUTHAUTH.MDMCP 95/100

Whether an agent can obtain access without a human in the loop.

pass
OAuth / OIDC well-known 2/2
Evidence. OAuth or OIDC discovery document found.
pass
OAuth 2.0 surface Required 5/5
Evidence. Authorization or token endpoint in discovery.
pass
OAuth AS metadata Required 3/3
Evidence. AS or OIDC metadata document fetched.
Probed public URLs named in the evidence.
pass
PKCE S256 Required 2/2
Evidence. S256 listed in code_challenge_methods_supported.
pass
OAuth protected resource Recommended 2/2
Evidence. oauth-protected-resource found.
pass
Scoped permissions Recommended 5/5
Evidence. Named scopes found.
pass
auth.md bonus 2/2
Evidence. Fetched /auth.md.
Probed public URLs named in the evidence.
failed
change-password well-known bonus 0/1
Evidence. Login surface without /.well-known/change-password.
Probed well-known paths.
Recommended fix. If users have passwords, serve /.well-known/change-password.
8. Can an agent transact with you?PRICINGX402MPPUCPACPAP2 100/100

Whether an agent can price, pay, or check out on a documented rail.

n/a
x402 payment bonus 0/0
Evidence. No cart/SKU/checkout and no live payment rail (Pay N/A).
n/a
Agentic checkout (ACP) bonus 0/0
Evidence. No cart/SKU/checkout and no live payment rail (Pay N/A).
n/a
ACP delegated payment bonus 0/0
Evidence. No cart/SKU/checkout and no live payment rail (Pay N/A).
n/a
Universal Commerce Protocol bonus 0/0
Evidence. No cart/SKU/checkout and no live payment rail (Pay N/A).
n/a
Machine Payments Protocol bonus 0/0
Evidence. No cart/SKU/checkout and no live payment rail (Pay N/A).
pass
Pricing page Recommended 3/3
Evidence. Fetched /pricing.
Probed public URLs named in the evidence.
pass
pricing.md bonus 2/2
Evidence. Fetched /pricing.md.
Probed public URLs named in the evidence.
9. Can a user act through an agent?APPS 0/100

Whether a person can finish a job through an agent-facing UI.

failed
MCP Apps UI hint bonus 0/1
Evidence. No MCP Apps hint (N/A unless you return UI).
Recommended fix. If you return UI, declare io.modelcontextprotocol/ui resources.
n/a
A2A agent card Required 0/2
Evidence. No agent-card.json (N/A unless A2A).
n/a
Web app manifest bonus 0/1
Evidence. No web app manifest (N/A).
10. Can an agent operate your website directly?MARKDOWNA11YHTMLWEBMCPNLWEBLLMS.TXT 67/100

Whether an agent can read and operate the site itself when there is no API or MCP.

failed
Markdown negotiation bonus 0/1
Evidence. Homepage did not negotiate markdown.
Probed homepage.
Recommended fix. Respond to Accept: text/markdown with a markdown body.
pass
/index.md fallback bonus 1/1
Evidence. Fetched /index.md.
Probed public URLs named in the evidence.
n/a
WebMCP page tools bonus 0/1
Evidence. No in-page WebMCP (N/A).
n/a
NLWeb /ask bonus 0/1
Evidence. No NLWeb /ask (N/A).
pass
Agent mode view bonus 1/1
Evidence. mode=agent responded.
Probed public URLs named in the evidence.
n/a
NodeInfo bonus 0/1
Evidence. No nodeinfo (N/A).
n/a
oEmbed discovery bonus 0/1
Evidence. No oEmbed (N/A unless embeddable).

About this snapshot & how to cite it

Public technical signals observed by Waymark. A score describes this snapshot; it does not guarantee that an agent will complete a task. Private and authenticated workflows are outside this scan.

Snapshot: . Cite the domain, score, scan time, and report URL. This URL serves the latest completed snapshot and can change after a rescan.

Methodology and limits · Markdown · JSON evidence

Scanner issues (not site fails): , , .

Share this snapshot

Embed the latest score. A badge is a public snapshot, not a certification.

Waymark score badge for firecrawl.dev
Open badge SVG ↗

Also on the Board

Same-category snapshots, ordered by score. Scan times may differ.

Email me if this score changes

Join the monitoring waitlist. Monitoring is not active yet. This saves your interest; it does not schedule scans or send change alerts.

By joining, you agree to save your email and this domain for monitoring launch contact, for up to 180 days. Request removal via Contact. No billing.

Email this report

Send the current snapshot and a link. One email. Not a list.

We'll send firecrawl.dev as it stands on this page.