Crawl any website, extract structured content, power your AI. One API, zero infrastructure headaches.
Built on Firecrawl's battle-tested engine — the same tech used by thousands of developers.
Get LLM-ready markdown from any URL. No HTML noise, no boilerplate — just the content you need.
Crawl entire websites with smart link discovery. Get thousands of pages with one API call.
One header, done. X-Api-Key: your_key — no OAuth, no complex setup.
Handles SPAs, React apps, dynamic content. Full headless Chrome rendering built in.
Rotating proxies and anti-bot evasion. Get past rate limits and Cloudflare without pain.
Track your requests, monitor usage, and stay under your monthly limits in real time.
No API key needed for the demo. Enter any URL and see the magic.
Pay monthly, cancel anytime. No hidden fees, no per-seat pricing.
Base URL: https://crawl.pau1.cloud — Auth: X-Api-Key: your_key
Scrape a single URL and get clean markdown content back.
| Parameter | Type | Description | |
|---|---|---|---|
| url | string | required | The URL to scrape |
| formats | array | optional | ["markdown", "html", "links"] — default: ["markdown"] |
| onlyMainContent | boolean | optional | Strip nav, footer, ads. Default: true |
| timeout | number | optional | Timeout in ms. Default: 30000 |
Crawl an entire website recursively and return all pages as markdown.
| Parameter | Type | Description | |
|---|---|---|---|
| url | string | required | Starting URL to crawl from |
| limit | number | optional | Max pages to crawl. Default: 10 |
| includePaths | array | optional | URL patterns to include, e.g. ["/blog/*"] |
| excludePaths | array | optional | URL patterns to exclude |
Check your current month's usage and remaining quota.