Firecrawl ยท Firecrawl
One API that turns any website into LLM-ready markdown or structured JSON.
Bottom line
The best available tool for turning the web into model input โ clean output, a small well-designed API and a real open-source escape hatch. Just budget from the format you will actually use, because JSON extraction costs five times the headline rate.
Firecrawl is the tool we reach for whenever the output is destined for a language model. Markdown comes back boilerplate-stripped and structurally intact on the first call, the API is small enough to hold in your head, and the MCP server makes it a natural web layer for agents. It is genuinely open source and self-hostable, so you are not captive. The reservation is billing shape rather than price: base scraping is a bargain at a credit a page, but JSON mode adds four credits, ZDR one and prompt-injection checking four more, so the structured output most people want costs five to six times the advertised rate.
Key features
- LLM-ready markdown with boilerplate stripped on the first call
- Schema-guided or prompt-driven JSON extraction, no parser to write
- Endpoints for scrape, crawl, map, search, interact, parse, extract, monitor and agent
- Natural-language crawl configuration in v2, replacing path-pattern tuning
- Open source and self-hostable via Docker
- SDKs for Python, Node.js, Rust and Go
- MCP server for Claude, Cursor and VS Code
What works
- Best-in-class LLM-ready markdown โ clean and structurally intact first time
- Small, well-designed API that most developers get working in ten minutes
- Genuinely open source and self-hostable, so there is a real exit
- Per-page pricing is forecastable enough to quote fixed-price client work
- MCP server makes it a strong default web layer for AI agents
- /map is billed per call, making URL discovery very cheap
What to watch
- JSON mode adds 4 credits per page โ the format most people want costs 5x
- Hobby tier runs $3.80 per 1,000 pages against Standard's $0.99
- Credits do not roll over below the Scale plan
- Auto-recharge top-ups cost up to 2.5x the plan rate on Standard and Growth
- Less control than a dedicated platform on heavily defended sites
- X posts cost 30 credits each due to the Grok X Query surcharge
Firecrawl
Firecrawl
Score breakdown6
Free 1,000 credits/mo ยท Hobby from $19/mo ยท Standard from $99/mo
Firecrawl does one thing extremely well: it turns arbitrary web pages into clean, LLM-ready text without you writing a parser. One call to /scrape and boilerplate, navigation and cookie banners are gone. The catch is that the moment you ask for structured output, the price per page quintuples โ and that surcharge is where most Firecrawl bills actually come from.
Firecrawl at a glance
Public pricing and documentation, September 2026
1,000
Free credits
Per month, no card needed
1
Credit per page
Plain markdown scrape or crawl
+4
Credits for JSON mode
Turns 1 credit into 5
30
Credits per X post
Grok X Query surcharge
What Firecrawl actually is
Firecrawl is an API that converts websites into data a language model can use. You give it a URL; it handles the proxies, JavaScript rendering, caching and rate limiting, and returns markdown, HTML, schema-guided JSON, a screenshot or a brand profile. There is no scraper to build and no browser fleet to maintain.
That framing matters, because Firecrawl is not really a general web-scraping platform. It is a context layer for AI systems โ built for RAG pipelines, agent loops and documentation ingestion, where the requirement is clean text rather than a bespoke extractor for one stubborn site.
The endpoints
The API is small enough to hold in your head, which is a genuine design achievement:
/scrapeโ one page, in whatever format you ask for./crawlโ an entire site in a single job, with v2 accepting natural-language instructions instead of hand-tuned path patterns and depth settings./mapโ every link on a site, returned in seconds. Billed per call, not per page, which makes it very cheap for URL discovery./searchโ find sources on the live web, then scrape them./interactโ click, fill and navigate before extracting, for content behind logins or actions./parseโ PDFs and documents./extractโ LLM-driven structured extraction against a schema or a plain prompt./monitorand/agentโ change tracking and autonomous multi-step retrieval, the latter still in preview.
The natural-language crawl configuration in v2 is the upgrade most worth knowing about. Describing what you want in a sentence, rather than reverse-engineering include-path regexes, removes the fiddliest part of setting up a site crawl.
Output quality
This is Firecrawl's strongest suit and the reason to choose it. Markdown comes back boilerplate-stripped and structurally intact โ headings survive as headings, tables as tables, and the navigation chrome that poisons naive scrapes is gone. For anything that gets chunked and embedded, that difference in cleanliness translates directly into retrieval quality.
JSON mode is equally impressive on capability, if not on price. Pass a schema and get typed objects; pass a plain prompt and let the model choose the shape. Either way you skip writing and maintaining a parser, which is normally the part of a scraping project that rots fastest when a site redesigns.
Pricing, briefly
Plans run Free at 1,000 credits, Hobby $19 for 5,000, Standard $99 for 100,000, Growth $399 for 500,000 and Scale $749 for 1,000,000, plus custom Enterprise. Annual billing is a flat two-months-free discount. A plain page is 1 credit, which puts Standard at just under a dollar per thousand pages.
The number that matters more is what your actual workload costs once surcharges apply, and that deserves its own treatment โ we break down every endpoint, surcharge and top-up rate in the Firecrawl pricing breakdown.
The surcharges are where the money goes
Base scraping is cheap; options are not. JSON mode adds 4 credits per page, zero-data-retention adds 1, PDF parsing adds 1 per PDF page, and prompt-injection checking adds 4. A JSON extraction with ZDR enabled is six credits a page โ six times the headline rate.
Developer experience
Firecrawl ships SDKs for Python, Node.js, Rust and Go, and an MCP server that plugs straight into Claude, Cursor and VS Code. The API shape is conventional and the docs are good. Most engineers get a usable result inside ten minutes, which is a low bar that a surprising number of scraping tools fail.
The MCP server deserves particular mention. Giving an agent a clean, reliable web-fetch tool is a genuinely hard problem, and Firecrawl's output being model-ready by default means the agent spends no tokens cleaning HTML. Agent frameworks increasingly use it as their web data layer for exactly that reason.
Open source and self-hosting
Firecrawl is open source and self-hostable via Docker, and the open version is not a token gesture โ it covers the core scraping and crawling engine plus Map, Search, batch scrape, Extract, JSON mode, change tracking and the SDKs.
What the hosted API adds is managed infrastructure, higher concurrency, and LLM-based extraction applied during the crawl. So the honest calculus is: self-host if you have the ops appetite and want to escape credit maths; pay for the hosted version if you would rather not run a browser fleet. Having a real exit is more than most competitors offer.
Prove it on the free tier first
1,000 monthly credits with no card is enough to scrape a thousand plain pages โ or 200 pages with JSON extraction. Run your real target set, not a demo URL, and check the output quality before you commit. Try Firecrawl free.
Where Firecrawl struggles
Three honest weaknesses. First, heavily defended sites. Firecrawl handles ordinary anti-bot measures well, but it gives you far less control than a platform with configurable residential proxy pools and fingerprint rotation. On the hardest targets โ major marketplaces and social platforms with aggressive defences โ a purpose-built scraper still wins. Our Apify vs Firecrawl comparison covers that split in detail.
Second, the Hobby tier is poor value. At $19 for 5,000 credits it works out at $3.80 per thousand pages, against $0.99 on Standard. It is a 3.8x unit-rate penalty for being small, and anyone hitting its ceiling regularly should jump rather than top up.
Third, credits do not roll over below the Scale plan, and auto-recharge top-ups are priced well above the plan rate โ up to 2.5x on Standard and Growth. Bursty workloads pay for that pattern twice.
Who should use Firecrawl
- Anyone building RAG or agent pipelines โ this is the tool's home turf, and it is excellent at it.
- Teams ingesting documentation, knowledge bases or content at scale โ clean markdown out of the box.
- Agencies quoting fixed-price work โ per-page pricing is forecastable in a way compute-metered platforms are not.
- Developers who want an exit โ the open-source build means you are not permanently captive.
It is the wrong tool if you are scraping a handful of heavily defended platforms, if you need deep browser-automation control, or if your budget cannot absorb the JSON surcharge on high volumes.
Why the output quality actually matters
It is easy to dismiss "clean markdown" as a cosmetic feature. It isn't, and the reason is downstream. A naive scrape returns the article plus the nav bar, the cookie banner, the footer, the related-posts rail and three newsletter prompts. When that gets chunked and embedded, every one of those fragments becomes a retrievable chunk competing with your actual content.
The result is a retrieval layer that surfaces navigation text when someone asks a question. Cleaning it afterwards means writing site-specific heuristics that break on the next redesign โ which is precisely the maintenance burden most teams adopt Firecrawl to avoid. Paying at the extraction step to avoid poisoning the index is usually the cheaper trade.
The same logic applies to structure. Firecrawl preserves headings as headings and tables as tables, which means header-aware chunking works and tabular data survives instead of collapsing into an unparseable run of text.
Workflows it fits well
- Documentation and knowledge-base ingestion โ point
/crawlat a docs site and get a clean corpus. This is the canonical use case and the one it handles most cleanly. - Agent web access โ the MCP server gives an agent a fetch tool whose output needs no cleanup, so no tokens are spent stripping HTML mid-loop.
- Competitive and content monitoring โ
/monitortracks changes across a page set, billing only when checks error. - Research pipelines โ
/searchfinds live sources and/scrapefetches them, in two calls rather than a search API plus a scraper plus glue. - Document processing โ
/parsehandles PDFs at a modest surcharge, which covers the reports and filings that usually need separate tooling.
How it compares to the alternatives
Against building your own with Playwright and a parser, Firecrawl wins on time-to-first-result and loses on unit cost at very high volume. The crossover is not really about price, though โ it is about who maintains the extraction logic when sites change. If that person is you, and you have many sites, Firecrawl is cheap at almost any tier.
Against a scraping platform like Apify, the split is cleaner: Firecrawl for ordinary pages at a predictable per-page rate, Apify for defended targets where you need residential proxies and site-specific scrapers. We work through that in detail in Apify vs Firecrawl, and it is genuinely common to run both.
Against self-hosting Firecrawl itself โ a real option, since the open-source build is substantial โ you trade credits for ops. That is a good trade if you already run containers and a bad one if a browser fleet would be your team's new pager duty.
Verdict
Firecrawl is the best available answer to "turn the web into model input", and that is a narrower claim than "best scraping tool" โ deliberately so. The output quality is genuinely superior to rolling your own extraction, the API is small and well-designed, and the open-source escape hatch is real.
The reservation is entirely about billing shape rather than headline price. The advertised rate is for the least useful output format. Plain markdown at a credit a page is a bargain; the structured JSON most people actually want costs five times that, before ZDR or PDF surcharges. Budget from the format you will really use, and Firecrawl is very good value. Budget from the sticker price, and you will be surprised.
1,000 free credits monthly, no card ยท Paid plans from $19/month
How we assessed this
Plan prices, credit allowances, rate limits and per-endpoint credit costs are taken from Firecrawl's public pricing page and billing documentation as of September 2026. Per-thousand-page costs and unit-rate comparisons are our own arithmetic from those published rates. Disclosure: links to Firecrawl are affiliate links; no vendor reviewed this article.
Frequently Asked Questions
8 questions answered
Enjoyed this article?
Share it with someone who'd love it.
Written by
AI Magic Editorial Team
We write about AI image generation, creative workflows, and how creators use AI Magic to ship faster โ built on the latest from Google Gemini.