Docs menuFetch and scrape

Web tools

Fetch and scrape

A page or a PDF comes back as markdown, with page markers and ruled tables. Pass a question and you get only the passages that answer it, each with its heading and offset.

View .md

Recorded response#

Response (recorded playground run, trimmed)
{
  "url": "https://docs.python.org/3/library/asyncio.html",
  "title": "asyncio — Asynchronous I/O — Python 3.15.0 documentation",
  "markdown": "# `asyncio` — Asynchronous I/O[¶](#module-asyncio)\n\nasyncio is a library to write **concurrent** code using\nthe **async/await** syntax.\n\nasyncio is used as a foundation for multiple Python asynchronous frameworks that provide high-performan…"
}

POST /fetch#

Fetch Url. Full parameters on the endpoint page.

curl -X POST https://api.clawifi.dev/fetch \
  -H "Authorization: Bearer $CLAWIFI_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url":"https://example.com"}'

POST /scrape#

Scrape Url. Full parameters on the endpoint page.

curl -X POST https://api.clawifi.dev/scrape \
  -H "Authorization: Bearer $CLAWIFI_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url":"https://example.com"}'

POST /extract#

Extract Url. Full parameters on the endpoint page.

curl -X POST https://api.clawifi.dev/extract \
  -H "Authorization: Bearer $CLAWIFI_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url":"https://example.com"}'

Was this page helpful? Tell us · Last updated 2026-10-22