OverviewDocs

One key, plain JSON, one fast endpoint. Turn any URL into clean Markdown, search the web, or pull typed JSON out of a page. Every call is authenticated with your API key and returns in one round trip.Reference for every endpoint and data product. Also as llms.txt for agents.

Base URL and authentication

Base URL: https://api.crawl4ai.com
Authorization: Bearer sk_live_...

No key yet? Get a free API key.

Endpoints

Endpoint What it does
POST /scrape Fetch a page and return clean Markdown (and/or HTML).
POST /scrape/batch Scrape many URLs in one call — up to 50 — and stream a result per line as each finishes.
POST /scrape/jobs For big lists — up to 10,000 URLs — or when your code cannot hold a connection open for slow pages.
GET /search Crawl4AI's own web search: results ranked and cleaned for reading, browser-free.
GET /serp Google's results page as structured data: true ranks, every block Google showed, and the place the page was localised to.
GET /answer Ask a question, get a direct answer.
POST /extract Pull structured, typed data out of a page with an instruction and/or a JSON schema.
POST /site Every page under a URL, as Markdown, level by level: the start page (level 0), the pages it links to (level 1), and so on to depth.
POST /scan Every URL of one site, without crawling it.
POST /recipes/{name} Ready-made scrapers.
POST /monitors Watch a page and get told when it changes in the way you care about.
POST /price Give it websites, get their prices.
POST /lead/people/search Find the people and the companies you want to reach.
GET /verify Check if an email address can receive mail, without sending any mail.
/mcp Use Crawl4AI as native tools inside ChatGPT, Claude, Cursor or any MCP client.

Something unclear or wrong on this page? Tell us.