What you unlock
Web scraping
Scrape any URL and extract clean, structured content — ready for AI processing and analysis.
Site crawling
Crawl entire websites recursively to discover pages, map site structure, and extract content at scale.
Deep research
Run multi-step research tasks that follow links, gather data, and synthesize findings across the web.
Structured extraction
Extract specific data fields from web pages using schemas — product prices, article metadata, contact info, and
more.
Connect Firecrawl
Get your API key
Sign up or log in at firecrawl.dev, navigate to your dashboard, and copy your API key.
Agent tools
Any agent in your workspace can use Firecrawl tools once an API key is connected.Scraping
| Tool | Description |
|---|---|
| Scrape | Scrape a single URL and extract its content |
| Batch scrape | Scrape multiple URLs in a single request |
| Extract | Extract structured data from a URL using a schema |
Crawling & Mapping
| Tool | Description |
|---|---|
| Crawl | Crawl a website recursively starting from a URL |
| Get crawl status | Check the status of a running crawl job |
| Map URLs | Map the URL structure of a website |
| Search | Search the web and return structured results |
Deep Research & AI Agents
| Tool | Description |
|---|---|
| Deep research | Run a multi-step research task across the web |
| Get research status | Check the status of a deep research task |
| Start agent | Launch an AI agent to perform complex web tasks |
| Get agent status | Check the status of a running agent task |
LLMs.txt & Usage
| Tool | Description |
|---|---|
| Generate LLMs.txt | Generate an LLMs.txt file for a website |
| Get credit usage | Check your Firecrawl credit consumption |
Triggers
Automated triggers for Firecrawl are not yet available. Triggers will be added in a future update — check back soon.
Example use cases
Competitor research on demand
Competitor research on demand
Ask your agent to scrape a competitor’s pricing page and extract their plan names, prices, and feature lists into a
structured table — instant competitive intelligence without manual research.
Content aggregation for knowledge bases
Content aggregation for knowledge bases
Crawl your documentation site and extract all pages into structured content. Use the results to build a searchable
knowledge base or feed it into another AI system.
Deep research on a topic
Deep research on a topic
Ask your agent to research a topic like “serverless database trends” — Firecrawl’s deep research follows links
across multiple sources and synthesizes a comprehensive report.
Troubleshooting
My API key isn't working
My API key isn't working
Verify the key was copied from firecrawl.dev and hasn’t expired. Generate a fresh key if
the current one doesn’t work.
Scrape returns empty content
Scrape returns empty content
Some websites use heavy JavaScript rendering that may not be captured by default. Check Firecrawl’s documentation
for options like enabling JavaScript rendering or wait-for selectors.
Crawl job seems stuck
Crawl job seems stuck
Large sites can take time to crawl. Use “Get crawl status” to check progress. If the job is truly stuck, cancel it
and retry with a smaller scope (e.g., limit max pages or depth).
Credit usage is higher than expected
Credit usage is higher than expected
Each scrape, crawl page, and research step consumes credits. Use “Get credit usage” to monitor consumption and
consider batching operations to reduce overhead.
Back to Integrations
View all available integrations