What is the Knowledge Base?
The Knowledge Base is your go-to place for practical guides, troubleshooting, and step-by-step instructions for ScrapeGraphAI. Whether you use the API, thejust-scrape CLI, or integrate with AI tools like Cursor or Lovable, you’ll find answers here.
Use it to get started quickly, fix common errors, learn scraping patterns, and manage your account and credits.
Scraping tools
How do I use ScrapeGraphAI inside Lovable to build apps that scrape the web?
Use ScrapeGraphAI in Lovable projects for AI-powered web scraping.
How do I add web scraping to UI components built with Vercel's v0?
Integrate ScrapeGraphAI with v0-generated components.
How do I add web data extraction to apps built with Bolt.new?
Add real-time web data extraction to Bolt.new apps.
How do I use ScrapeGraphAI with Cursor for AI-assisted scraping code?
Speed up development with ScrapeGraphAI and Cursor.
Troubleshooting
How do I fix CORS errors when calling the ScrapeGraphAI API from the browser?
Call the API from the server instead of the browser to avoid CORS and protect your key.
Why am I getting empty results from my extraction and how do I fix it?
Common causes and fixes when extractions return no data.
What happens when I hit rate limits and how do I handle them?
Understand rate limit responses and how to handle them.
How do I diagnose and fix timeout errors on complex or slow websites?
Resolve request timeouts for slow or complex pages.
Scraping Guides
How do I extract data from pages that need JavaScript to render?
Extract from dynamic pages that require JavaScript execution.
How do I scrape multi-page results using the pagination parameter?
Use the pagination parameter for multi-page extractions.
How do I pass custom HTTP headers for authentication or anti-bot bypass?
Pass custom headers to handle auth or anti-bot protections.
How do I route ScrapeGraphAI requests through my own proxy?
Route requests through your proxy for geo-targeting or privacy.
CLI (just-scrape)
How do I install the CLI, set up my API key, and run my first scrape?
Install the CLI, set your API key, and run your first scrape in minutes.
How do I get JSON output from just-scrape to pipe to jq or other tools?
Use the —json flag to pipe clean JSON to jq, files, or scripts.
How do I give AI coding agents web scraping via the skills.sh integration?
Expose just-scrape to AI agents as a skill through skills.sh.
Where can I find examples for smart-scraper, crawl, agentic-scraper and other commands?
Practical examples for every CLI command.
Account & Credits
How do I create, rotate, and revoke my ScrapeGraphAI API keys?
Create, rotate, and revoke API keys from the dashboard.
How are credits counted and how do I monitor my usage?
How credits work and how to check your usage.
What are the rate limits and concurrent job limits per plan?
Requests per minute and concurrent job limits by plan.