Docs menuMap Site

API reference

Map Site

POST /map · Map and crawl

View .md

POSThttps://api.clawifi.dev/map1 credit per started 10 URLs returned

  • Send your key as Authorization: Bearer $CLAWIFI_API_KEY; see Authentication.
  • Add "dry_run": true (or ?dry_run=true) to see what the call would cost; nothing runs and nothing is charged.
  • Hosted MCP tool: map_site on https://api.clawifi.dev/mcp.
  • Credits: 1 per started 10 URLs returned (at least 1). Every price is on Pricing and credits.

Request#

curl -X POST https://api.clawifi.dev/map \
  -H "Authorization: Bearer $CLAWIFI_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url":"https://example.com"}'

Body

FieldTypeDefaultRequired
allow_subdomainsbooleanfalseno
browser_profilestring (optional)no
force_browserbooleanfalseno
ignore_query_paramsbooleantrueno
max_urlsinteger100no
robots_policy"respect" | "ignore""respect"no
same_domain_onlybooleantrueno
searchstring (optional)no
sourcesarray of "robots" | "sitemap" | "html_links" | "rss" | "docs_paths"no
timeout_secondsinteger (optional)no
urlstringyes
wait_until"commit" | "domcontentloaded" | "load" | "networkidle""domcontentloaded"no

Response#

200 with a MapResponse object: discovered_count, errors, success, url, urls.

Errors use the shared shape; see Errors. Try public operations without a key in the playground.

Was this page helpful? Tell us · Last updated 2026-10-22