tonitangpotato/skm/web-scraping

Claude Code and agent skill by tonitangpotato/skm

Trust tier 3
  • community
Source check pending

Checking that the SKILL.md file is still in the repository.

Fetch web pages, extract content, and scrape data from URLs

Install

npx vskill@latest install tonitangpotato/skm/web-scraping

SKILL.md

Web Scraping Skill

Extract content from web pages and URLs.

Capabilities

  • Fetch and render web pages
  • Extract text, tables, and structured data
  • Handle JavaScript-rendered content
  • Follow pagination and links
  • Respect robots.txt and rate limits

Usage

When a user provides a URL or asks to fetch content from a website:

  1. Validate the URL format
  2. Check robots.txt if doing bulk scraping
  3. Fetch the page content
  4. Extract the requested information
  5. Return structured results

Examples

  • "Scrape the product prices from this page"
  • "Fetch the article content from https://example.com/post"
  • "Extract all links from this webpage"
  • "Get the main text from this URL"

Rate Limiting

  • Wait 1 second between requests to the same domain
  • Maximum 100 requests per session
  • Respect Retry-After headers

Security

  • Security scanPassed, 90 of 100Pattern checks on the skill's files.
  • Model reviewPassed

See the full security report

Quality evaluation

  • Task evaluationNot runNo evaluation yet. Run one in Skill Studio.

See evaluation results

Source

Popularity

Repository stars
3
7-day trend score
0

Stars and forks are for the whole GitHub repository, not this skill alone. Not refreshed yet.

Works with

Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.

  • Claude Code
  • Cursor
  • GitHub Copilot
  • Windsurf
  • Codex
  • Gemini CLI
  • Cline
  • Amp
  • Roo Code
  • Goose
  • Continue
  • Kilo Code
  • Junie
  • Trae
  • OpenHands
  • Qwen Code
  • AI Agent
  • Tabnine Chat
  • Sourcegraph Cody
  • Amazon Q
  • Firebase Genkit
  • Sweep
  • Devin
  • Phind
  • Mentat
  • Claude Desktop
  • Aider
  • GPT Pilot
  • Plandex
  • bolt.new
  • v0
  • Replit Agent
  • Anse
  • TypingMind
  • BetterChatGPT
  • LibreChat
  • Warp AI
  • Pieces
  • Fig AI
Embed badge
vskill VERIFIED badge
[![vskill VERIFIED](https://verified-skill.com/api/v1/skills/tonitangpotato/skm/web-scraping/badge)](https://verified-skill.com/skills/tonitangpotato/skm/web-scraping)

Something wrong with this skill or its page? Tell us.