--- name: fastcrawl description: Scrape, crawl, map, extract, screenshot, parse PDFs, and monitor pages via the Fastcrawl cloud API. --- # Fastcrawl Cloud scraping for agents. Base: `https://fastcrawl.net` Auth: `Authorization: Bearer *** from https://fastcrawl.net/app` Free tier: 2,000 credits/month, no card. See [pricing.md](/pricing.md) & [auth.md](/auth.md). ## Prefer MCP Connect streamable HTTP at `https://mcp.fastcrawl.net/mcp` with the Bearer key. Tools: scrape, crawl, map, search, extract, screenshot, pdf, parse, monitor_create, monitor_list, monitor_run, monitor_delete. ## REST fallback POST `/api/v1/scrape/` `{"url":"..."}` → markdown. POST `/api/v1/crawl/` then GET `/api/v1/crawl/{id}/`. POST `/api/v1/extract/` `{"url":"...","schema":{...}}`. POST `/api/v1/monitors/` `{"url":"...","schedule":"daily"}` → change-detection webhooks. Failed calls are never charged. 1 credit per successful page. ## Scrape options `{"url":"...","formats":"markdown|html|json","timeout":30,"fetchMode":"auto|http|browser"}` - `fetchMode:auto` (default) — HTTP first, browser fallback for JS/SPA. Fast on static pages. - `fetchMode:http` — no browser, ~14ms on static pages. Use for known-static sites. - `fetchMode:browser` — always render JS. For heavy SPAs set `timeout` up to 60. ## Monitors Create a monitor to re-scrape on a schedule and get a webhook POST only when content changes: ``` POST /api/v1/monitors {"url":"https://…","schedule":"daily","timezone":"Asia/Hong_Kong","hour":9,"webhook_url":"https://…"} ``` `monitor_run` fires it now (1 credit). `monitor_list` shows status. `monitor_delete` removes it. Docs: https://fastcrawl.net/docs llms.txt: https://fastcrawl.net/llms.txt