Web tools
Fetch and scrape
A page or a PDF comes back as markdown, with page markers and ruled tables. Pass a question and you get only the passages that answer it, each with its heading and offset.
Recorded response#
{
"url": "https://docs.python.org/3/library/asyncio.html",
"title": "asyncio — Asynchronous I/O — Python 3.15.0 documentation",
"markdown": "# `asyncio` — Asynchronous I/O[¶](#module-asyncio)\n\nasyncio is a library to write **concurrent** code using\nthe **async/await** syntax.\n\nasyncio is used as a foundation for multiple Python asynchronous frameworks that provide high-performan…"
}
POST /fetch#
Fetch Url. Full parameters on the endpoint page.
curl -X POST https://api.clawifi.dev/fetch \
-H "Authorization: Bearer $CLAWIFI_API_KEY" \
-H "Content-Type: application/json" \
-d '{"url":"https://example.com"}'
from clawifi import Clawifi
client = Clawifi() # reads CLAWIFI_API_KEY
result = client.fetch("https://example.com")
fetch_url(url="https://example.com")
POST /scrape#
Scrape Url. Full parameters on the endpoint page.
curl -X POST https://api.clawifi.dev/scrape \
-H "Authorization: Bearer $CLAWIFI_API_KEY" \
-H "Content-Type: application/json" \
-d '{"url":"https://example.com"}'
from clawifi import Clawifi
client = Clawifi() # reads CLAWIFI_API_KEY
result = client.scrape("https://example.com")
scrape_url(url="https://example.com")
POST /extract#
Extract Url. Full parameters on the endpoint page.
curl -X POST https://api.clawifi.dev/extract \
-H "Authorization: Bearer $CLAWIFI_API_KEY" \
-H "Content-Type: application/json" \
-d '{"url":"https://example.com"}'
from clawifi import Clawifi
client = Clawifi() # reads CLAWIFI_API_KEY
result = client.extract("https://example.com")
extract_url(url="https://example.com")
Was this page helpful? Tell us · Last updated 2026-10-22