Firecrawl

Crawl and convert pages to clean markdown for retrieval.

Free tier Free monthly credits; paid plans priced per page crawled Verified 2026-11-10 searchcrawlingragmarkdown

Use it for

Turning a site or a result list into text an agent can read

Skip it if

A general-purpose search index — it is a fetch-and-extract layer first

Given a URL or a list of results, it fetches pages, renders JavaScript where needed, and returns clean markdown with links intact. The value is the extraction quality: navigation, cookie banners, and boilerplate removed, which is exactly the noise that makes naive scraping useless for retrieval. It also offers a search endpoint, but crawling is the part it does better than most.

Related tools

All tools

3 alternatives overlap with this one. Compare them →