aeondave/malskill/hakrawler

Claude Code and agent skill by aeondave/malskill

Trust tier 3
  • community
Source check pending

Checking that the SKILL.md file is still in the repository.

Auth/lab ref: Fast Go web crawler for discovering URLs, endpoints, and JavaScript files. For crawling web applications to build a URL inventory before fuzzing or during OSINT on web infrastructure.

Install

npx vskill@latest install aeondave/malskill/hakrawler

SKILL.md

Hakrawler

Fast Go web crawler — discover URLs, JS files, forms, and endpoints.

Quick Start

bash
go install github.com/hakluke/hakrawler@latest
 
# Crawl a domain
echo https://target.com | hakrawler
 
# Depth 3, include subdomains
echo https://target.com | hakrawler -d 3 -subs
 
# Output as JSON
echo https://target.com | hakrawler -json
 
# Pipe multiple domains
cat domains.txt | hakrawler -d 2

Core Flags

FlagPurpose
-d NDepth (default: 1)
-subsInclude subdomains
-uUnique URLs only
-insecureSkip TLS verification
-t NThreads
-timeout NTimeout per request (s)
-H "K:V"Custom header
-jsonJSON output
-scope REGEXLimit to URL pattern
-plainPrint plain text (no color)
-proxy <url>HTTP/SOCKS5 proxy
-cookie <str>Cookie string
-drDisable following redirects
-w NWait N ms between requests

Common Workflows

Build URL inventory for fuzzing:

bash
echo https://target.com | hakrawler -d 3 -u | tee urls.txt
# Feed to ffuf
ffuf -w urls.txt:URL -u URL -mc 200

Discover JS files:

bash
echo https://target.com | hakrawler -d 2 | grep "\.js$"

Combine with httpx for live check:

bash
cat domains.txt | hakrawler | httpx -silent -mc 200

Scope-limited crawl (stay in scope):

bash
echo https://target.com | hakrawler -d 3 -scope ".*\.target\.com.*" -u

Extract API endpoints:

bash
echo https://target.com | hakrawler -d 3 -u | \
  grep -E "(/api/|/v[0-9]+/|\.json|\.xml)" | sort -u

Form action discovery:

bash
echo https://target.com | hakrawler -json | \
  jq -r 'select(.type=="form") | .source'

Multi-target via live hosts:

bash
subfinder -d target.com -silent | \
  httpx -silent | \
  hakrawler -d 2 -u | sort -u > all_urls.txt

Resources

FileWhen to load
references/crawl-tips.mdScope filtering, JS analysis, pipeline patterns, JS secret extraction

Security

  • Security scanPassed, 95 of 100Pattern checks on the skill's files.
  • Model reviewPassed

See the full security report

Quality evaluation

  • Task evaluationNot runNo evaluation yet. Run one in Skill Studio.

See evaluation results

Source

Popularity

Repository stars
22
Repository forks
1
7-day trend score
21

Stars and forks are for the whole GitHub repository, not this skill alone. Not refreshed yet.

Works with

Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.

  • Claude Code
  • Cursor
  • GitHub Copilot
  • Windsurf
  • Codex
  • Gemini CLI
  • Cline
  • Amp
  • Roo Code
  • Goose
  • Continue
  • Kilo Code
  • Junie
  • Trae
  • OpenHands
  • Qwen Code
  • AI Agent
  • Tabnine Chat
  • Sourcegraph Cody
  • Amazon Q
  • Firebase Genkit
  • Sweep
  • Devin
  • Phind
  • Mentat
  • Claude Desktop
  • Aider
  • GPT Pilot
  • Plandex
  • bolt.new
  • v0
  • Replit Agent
  • Anse
  • TypingMind
  • BetterChatGPT
  • LibreChat
  • Warp AI
  • Pieces
  • Fig AI
Embed badge
vskill VERIFIED badge
[![vskill VERIFIED](https://verified-skill.com/api/v1/skills/aeondave/malskill/hakrawler/badge)](https://verified-skill.com/skills/aeondave/malskill/hakrawler)

Something wrong with this skill or its page? Tell us.