Skip to main content
just-scrape can be installed as a skill for AI coding agents via Vercel’s skills.sh. This lets agents like Claude, Cursor, and others call ScrapeGraphAI commands directly during a coding session.

​
Install the skill

bunx skills add https://github.com/ScrapeGraphAI/just-scrape
Browse the skill page: skills.sh/scrapegraphai/just-scrape/just-scrape

​
What this enables

Once installed, your coding agent can:
  • Scrape a website to gather data needed for a task
  • Convert documentation pages to markdown for context
  • Search the web and extract structured results
  • Check your credit balance mid-session
  • Browse request history

​
How agents use it

Agents invoke the skill in --json mode so output is clean and token-efficient: 
just-scrape smart-scraper https://api.example.com/docs \
  -p "Extract all endpoint names, methods, and descriptions" \
  --json

just-scrape search-scraper "latest release notes for react-query" \
  --num-results 3 --json

​
Manual setup with Cursor

If you are using Cursor without the skills.sh integration, configure just-scrape via the MCP Server for the best experience. Alternatively, add a script to your project that Cursor can call: 
# .cursor/scrape.sh
#!/bin/bash
just-scrape smart-scraper "$1" -p "$2" --json
Then tell Cursor: “Run .cursor/scrape.sh <url> <prompt> to scrape a page.”

​
Tips

  • Set SGAI_API_KEY in your shell profile so the skill picks it up automatically across all agent sessions.
  • Use --json every time — agents don’t need spinners or banners.
  • Pass --schema with a JSON schema to get typed, predictable output that agents can parse reliably.
just-scrape smart-scraper https://example.com \
  -p "Extract company info" \
  --schema '{"type":"object","properties":{"name":{"type":"string"},"founded":{"type":"number"},"employees":{"type":"string"}}}' \
  --json