<< All versions
Skill v1.0.2
currentAutomated scan100/100firecrawl/cli/firecrawl-crawl
+2 new
──Details
PublishedOctober 2, 2026 at 01:32 PM
Content Hashsha256:f4f2b262564c1532...
Git SHAe07a08ef7a2f
Bump Typepatch
──Files
Files (1 file, 1.8 KB)
SKILL.md1.8 KBactive
SKILL.md · 46 lines · 1.8 KB
version: "1.0.2" name: firecrawl-crawl description: | Bulk-extract many pages from one site or section. Use for "crawl", "everything under /docs", or content spanning linked pages. allowed-tools:
- Bash(firecrawl *)
- Bash(npx firecrawl-cli *)
firecrawl crawl
Bulk extract content from a website. Crawls pages following links up to a depth/limit.
Prerequisite: crawl requires authentication (no keyless free tier); without credentials the CLI prompts an interactive login.
Quick start
bash
# Crawl a docs sectionfirecrawl crawl "<url>" --include-paths /docs --limit 50 --wait -o .firecrawl/crawl.json# Full crawl with depth limitfirecrawl crawl "<url>" --max-depth 3 --wait --progress -o .firecrawl/crawl.json# Check status of a running crawlfirecrawl crawl <job-id>
Run firecrawl crawl --help for the full option list.
Done when: the crawl reaches a terminal status and the saved output under .firecrawl/ contains the expected pages.
Tips
- Use
--waitwhen you need the results immediately. It has no default timeout; use--timeout <seconds>to bound polling. Without--wait, crawl returns a job ID for async polling. - Scope crawls with `--include-paths` whenever the request names a section — crawl only the pages you need.
- Crawl consumes credits per page. Check
firecrawl credit-usagebefore large crawls (credit-usagerequires authentication).
See also
- firecrawl-scrape — scrape individual pages
- firecrawl-map — discover URLs before deciding to crawl
- firecrawl-download — download site to local files (uses map + scrape)
- firecrawl-build-scrape — building bulk extraction into an app instead of running it here