Skip to main content

​
Overview

The ScrapeGraphAI Claude Code Skill gives AI coding agents full access to ScrapeGraphAI’s web scraping, search, and crawling APIs. Once installed, agents like Claude Code, Cursor, Copilot, and Cline can scrape websites, extract structured data, and crawl pages — all from natural language prompts.

GitHub Repository

View the skill source code and documentation

​
Installation

2
The fastest way to install. Requires Node.js.
3
npx skills add ScrapeGraphAI/skill
4
This clones the skill and symlinks it into your ~/.claude/skills/ directory automatically.
5
Option 2: Manual install
6
Clone the repository and create the symlink yourself:
7
git clone https://github.com/ScrapeGraphAI/skill.git ~/.claude/skills/scrapegraphai
ln -sf ~/.claude/skills/scrapegraphai/SKILL.md ~/.claude/skills/scrapegraphai.md
8
Option 3: Project-level install
9
Install the skill for a single project only:
10
mkdir -p .claude/skills
git clone https://github.com/ScrapeGraphAI/skill.git .claude/skills/scrapegraphai
ln -sf .claude/skills/scrapegraphai/SKILL.md .claude/skills/scrapegraphai.md

​
Setup

Set your ScrapeGraphAI API key as an environment variable: 
export SGAI_API_KEY="sgai-..."
Get your API key from the dashboard.

​
What’s Included

The skill installs the following files:
FileDescription
SKILL.mdMain skill file with API reference, examples, and decision guide
references/api-endpoints.mdFull parameter tables for all endpoints
references/sdk-examples.mdPython and JavaScript SDK examples
references/advanced-features.mdStealth mode, schemas, scrolling, pagination, and more

​
Capabilities

SmartScraper

Extract structured data from any webpage using natural language prompts

SearchScraper

Search the web and extract results with AI or as markdown

Markdownify

Convert any webpage into clean, formatted markdown

SmartCrawler

Crawl multiple pages from a website with depth and path controls

Sitemap

Extract all URLs from a website’s sitemap

Agentic Scraper

Browser automation — login, click, navigate, fill forms, then extract

​
Example Prompts

Once the skill is installed, you can use natural language prompts directly in your AI coding agent: 
Scrape https://example.com/products and extract all product names, prices, and ratings

Search the web for "best React UI libraries 2025" and extract the top 5 with pros and cons

Convert https://example.com/docs/getting-started to markdown and save it to docs/

Crawl https://example.com/blog with depth 2 and extract the title and summary from each post

Get all URLs from the sitemap of https://example.com

Log into https://example.com/dashboard, click "Reports", and extract the table data
The agent will automatically select the right ScrapeGraphAI endpoint, handle authentication, poll for async results, and return structured data.

​
Supported Agents

This skill works with any AI coding agent that supports the skills protocol:
  • Claude Code — Anthropic’s CLI agent
  • Cursor — AI-powered code editor
  • GitHub Copilot — AI pair programmer
  • Cline — VS Code AI agent
  • Windsurf — AI coding assistant
  • And any other agent supporting skills.sh

​
Support

Need help with the skill?

GitHub Issues

Report bugs and request features

Discord Community

Get help from our community