F
Firecrawl
Web scraping API built for LLMs — turn any website into LLM-ready data — 89K+ stars
Open Sourcefreemium
About
Firecrawl is a web scraping API that turns entire websites into clean, LLM-ready markdown or structured data. Handles JavaScript rendering, anti-bot bypassing, sitemaps, and recursive crawling. Provides scrape (single URL), crawl (entire site), map (discover URLs), and extract (structured data) endpoints. Essential infrastructure for RAG pipelines and AI agents that need web data.
Details
| Type | web-scraping, data-extraction, api |
| Integrations | langchain, llamaindex, crewai, any-llm |
| Language | python, typescript |
Tags
web-scrapingragapillm-datamarkdownpythonopen-source
Quick Info
- Organization
- Mendable
- Pricing
- freemium
- Free Tier
- Yes
- Updated
- Apr 1, 2026
102.1Ktoday138
Also in Dev Tools
C
Crawl4AI
Open-source web crawler optimized for LLMs and AI agents — 62K+ stars
OSSFree
unclecode
63.1Ktoday72
H
Headroom Context Optimization
Reduce LLM API costs by 50-90% through advanced context compression
OSSFree
Shubham Saboo
104.2Ktoday74
M
Mem0
Persistent, adaptive memory layer for AI agents and assistants
OSSfreemium
Mem0
51.6Ktoday284