Overview
The ScrapeGraphAI Claude Code Skill ships with just-scrape, the official CLI for the v2 API. Once installed, agents like Claude Code, Cursor, Copilot, Cline, and Windsurf can scrape websites, extract structured data, search the web, crawl sites, and set up page-change monitors — all from natural language prompts. The skill wiresjust-scrape into your agent’s skill directory so the agent knows when and how to invoke the CLI.
GitHub Repository
Browse the CLI and skill source
Installation
Setup
Install the CLI and set your ScrapeGraphAI API key:Get your API key from the dashboard. The CLI also accepts the key via a
.env file, ~/.scrapegraphai/config.json, or an interactive prompt.Capabilities
The skill maps to the v2 API surface viajust-scrape:
extract
Extract structured data from any URL using AI (
just-scrape extract)search
Search the web and extract structured results (
just-scrape search)scrape
Fetch a page in 8 formats: markdown, html, screenshot, branding, links, images, summary, json
markdownify
Convert any webpage into clean markdown (wraps
scrape -f markdown)crawl
Crawl multi-page sites with depth, link, and pattern controls
monitor
Schedule page-change monitors with cron intervals, webhooks, and activity polling
Removed from v1:
sitemap, agentic_scraper, generate-schema, validate. There is no direct replacement on v2.Example Prompts
Once the skill is installed, you can use natural language prompts directly in your AI coding agent:just-scrape command, handle authentication, poll for async results (crawls), and return structured data.
Supported Agents
This skill works with any AI coding agent that supports the skills protocol:- Claude Code — Anthropic’s CLI agent
- Cursor — AI-powered code editor
- GitHub Copilot — AI pair programmer
- Cline — VS Code AI agent
- Windsurf — AI coding assistant
- And any other agent supporting skills.sh
Support
Need help with the skill?GitHub Issues
Report bugs and request features
Discord Community
Get help from our community