# ScrapeGraphAI

## Docs

- [Get crawl status](https://docs.scrapegraphai.com/api-reference/endpoint/crawl/get-status.md): Poll a running or finished crawl job.
- [Manage crawl jobs](https://docs.scrapegraphai.com/api-reference/endpoint/crawl/manage.md): Stop, resume, and delete running crawl jobs.
- [Start crawl](https://docs.scrapegraphai.com/api-reference/endpoint/crawl/start.md): Kick off an async multi-page crawl and return a job id.
- [Credits](https://docs.scrapegraphai.com/api-reference/endpoint/credits.md): Check remaining credits, plan, and job quotas.
- [Extract](https://docs.scrapegraphai.com/api-reference/endpoint/extract.md): Natural-language structured extraction from a URL, HTML, or markdown.
- [History](https://docs.scrapegraphai.com/api-reference/endpoint/history.md): Look up past requests by ID, or list recent requests with optional filters.
- [Create monitor](https://docs.scrapegraphai.com/api-reference/endpoint/monitor/create.md): Schedule a recurring fetch with change detection.
- [Manage monitors](https://docs.scrapegraphai.com/api-reference/endpoint/monitor/manage.md): List, inspect, update, pause, resume, delete monitors and fetch tick activity.
- [Scrape](https://docs.scrapegraphai.com/api-reference/endpoint/scrape.md): Fetch a URL and return its content in one or more formats.
- [Search](https://docs.scrapegraphai.com/api-reference/endpoint/search.md): Run a web search and fetch the top results in one call.
- [Error handling](https://docs.scrapegraphai.com/api-reference/errors.md): Error payload shape and HTTP status codes returned by the v2 API
- [Introduction](https://docs.scrapegraphai.com/api-reference/introduction.md): REST API reference for ScrapeGraphAI v2
- [Open Source](https://docs.scrapegraphai.com/contribute/opensource.md): ScrapeGraphAI open-source ecosystem
- [💬 Chat with Webpage](https://docs.scrapegraphai.com/cookbook/examples/chat-webpage.md): Build a RAG chatbot for any webpage using ScrapeGraph and LanceDB
- [🏢 Company Information](https://docs.scrapegraphai.com/cookbook/examples/company-info.md): Extract structured company data from websites
- [🌟 GitHub Trending](https://docs.scrapegraphai.com/cookbook/examples/github-trending.md): Monitor trending repositories and developers
- [🏠 Homes Listings](https://docs.scrapegraphai.com/cookbook/examples/homes.md): How to extract real estate data from Homes.com
- [📄 Pagination Examples](https://docs.scrapegraphai.com/cookbook/examples/pagination.md): Walk through paginated listings with the Extract service
- [🔬 News Research Agent](https://docs.scrapegraphai.com/cookbook/examples/research-agent.md): Build an AI research agent with ScrapeGraph and Tavily
- [📰 Wired Articles](https://docs.scrapegraphai.com/cookbook/examples/wired.md): How to extract articles from Wired.com
- [Introduction](https://docs.scrapegraphai.com/cookbook/introduction.md): Learn from practical examples using ScrapeGraphAPI
- [Dashboard](https://docs.scrapegraphai.com/dashboard/overview.md): Overview of your ScrapeGraphAI dashboard
- [User Settings](https://docs.scrapegraphai.com/dashboard/settings.md): Manage your account settings and preferences
- [Anthropic](https://docs.scrapegraphai.com/developer-guides/llm-sdks-and-frameworks/anthropic.md): Use ScrapeGraphAI with Claude for web scraping + AI workflows
- [Gemini](https://docs.scrapegraphai.com/developer-guides/llm-sdks-and-frameworks/gemini.md): Use ScrapeGraphAI with Google Gemini AI for web scraping + AI workflows
- [Installation](https://docs.scrapegraphai.com/install.md): Install and get started with ScrapeGraphAI v2 SDKs
- [🦐 Agno](https://docs.scrapegraphai.com/integrations/agno.md): Wire ScrapeGraph into Agno agents with the first-party ScrapeGraphTools toolkit
- [👥 CrewAI](https://docs.scrapegraphai.com/integrations/crewai.md): Wrap ScrapeGraph endpoints as native CrewAI tools
- [🦜 LangChain](https://docs.scrapegraphai.com/integrations/langchain.md): Wrap ScrapeGraph endpoints as vanilla LangChain tools
- [🕸️ LangGraph](https://docs.scrapegraphai.com/integrations/langgraph.md): Build stateful workflows with ScrapeGraph endpoints as LangGraph nodes
- [🦙 LlamaIndex](https://docs.scrapegraphai.com/integrations/llamaindex.md): Build LlamaIndex agents and RAG pipelines with ScrapeGraphAI
- [Introduction](https://docs.scrapegraphai.com/introduction.md): Welcome to ScrapeGraphAI - AI-Powered Web Data Extraction
- [Managing your API keys](https://docs.scrapegraphai.com/knowledge-base/account/api-keys.md): How to create, rotate, and revoke your ScrapeGraphAI API keys
- [Understanding credits](https://docs.scrapegraphai.com/knowledge-base/account/credits.md): How credits are counted and how to monitor your usage
- [Plans & Pricing](https://docs.scrapegraphai.com/knowledge-base/account/pricing.md): Overview of ScrapeGraphAI plans, pricing, and what each tier includes
- [Rate limits by plan](https://docs.scrapegraphai.com/knowledge-base/account/rate-limits.md): Requests per minute and concurrent job limits for each plan
- [Using ScrapeGraphAI with Bolt.new](https://docs.scrapegraphai.com/knowledge-base/ai-tools/bolt.md): Add real-time web data extraction to apps built with Bolt.new
- [Using ScrapeGraphAI with Cursor](https://docs.scrapegraphai.com/knowledge-base/ai-tools/cursor.md): Speed up development with AI-assisted scraping code in Cursor
- [Using ScrapeGraphAI with Lovable](https://docs.scrapegraphai.com/knowledge-base/ai-tools/lovable.md): Build AI-powered apps that scrape the web using ScrapeGraphAI inside Lovable projects
- [Using ScrapeGraphAI with v0](https://docs.scrapegraphai.com/knowledge-base/ai-tools/v0.md): Integrate web scraping into UI components generated with Vercel v0
- [Using just-scrape as a coding agent skill](https://docs.scrapegraphai.com/knowledge-base/cli/ai-agent-skill.md): Give AI coding agents access to web scraping through the just-scrape skill
- [CLI command examples](https://docs.scrapegraphai.com/knowledge-base/cli/command-examples.md): Practical examples for every just-scrape command
- [Getting started with just-scrape](https://docs.scrapegraphai.com/knowledge-base/cli/getting-started.md): Install and configure the just-scrape CLI in minutes
- [Using JSON mode for scripting](https://docs.scrapegraphai.com/knowledge-base/cli/json-mode.md): Pipe just-scrape output to jq, files, or other tools with --json
- [Knowledge Base](https://docs.scrapegraphai.com/knowledge-base/introduction.md): Frequently asked questions and guides for ScrapeGraphAI
- [Using custom headers](https://docs.scrapegraphai.com/knowledge-base/scraping/custom-headers.md): Pass custom HTTP headers to bypass authentication or anti-bot protections
- [Scraping JavaScript-heavy websites](https://docs.scrapegraphai.com/knowledge-base/scraping/javascript-rendering.md): Extract data from dynamic pages that require JavaScript execution
- [Handling pagination](https://docs.scrapegraphai.com/knowledge-base/scraping/pagination.md): Scrape multi-page results with Crawl or iterate URLs yourself
- [Proxy & Fetch Configuration](https://docs.scrapegraphai.com/knowledge-base/scraping/proxy.md): Control proxy routing, stealth mode, and geo-targeting with FetchConfig
- [Why am I getting empty results?](https://docs.scrapegraphai.com/knowledge-base/troubleshooting/empty-results.md): Common reasons why extractions return no data and how to fix them
- [Understanding rate limiting](https://docs.scrapegraphai.com/knowledge-base/troubleshooting/rate-limiting.md): What happens when you hit rate limits and how to handle them gracefully
- [Handling timeout errors](https://docs.scrapegraphai.com/knowledge-base/troubleshooting/timeout-errors.md): Diagnose and resolve request timeouts for complex or slow websites
- [JavaScript SDK](https://docs.scrapegraphai.com/sdks/javascript.md): Official JavaScript/TypeScript SDK for ScrapeGraphAI v2
- [Mocking & Testing](https://docs.scrapegraphai.com/sdks/mocking.md): Test ScrapeGraphAI v2 functionality without consuming API credits
- [Python SDK](https://docs.scrapegraphai.com/sdks/python.md): Official Python SDK for ScrapeGraphAI v2
- [Headers & Cookies](https://docs.scrapegraphai.com/services/additional-parameters/headers.md): Customize request headers and cookies for web scraping
- [Pagination](https://docs.scrapegraphai.com/services/additional-parameters/pagination.md): Extract data from multiple pages with SmartScraper pagination
- [Proxy Configuration](https://docs.scrapegraphai.com/services/additional-parameters/proxy.md): Configure proxy settings, fetch modes, and geotargeting for web scraping requests
- [Wait Time](https://docs.scrapegraphai.com/services/additional-parameters/wait-ms.md): Control how long the scraper waits before capturing page content
- [AI Agent Skill](https://docs.scrapegraphai.com/services/cli/ai-agent-skill.md): Give AI coding agents direct access to web scraping through just-scrape
- [Commands](https://docs.scrapegraphai.com/services/cli/commands.md): Full reference for every just-scrape command and its flags
- [Examples](https://docs.scrapegraphai.com/services/cli/examples.md): Practical examples for every just-scrape command
- [CLI — just-scrape](https://docs.scrapegraphai.com/services/cli/introduction.md): Command-line interface for ScrapeGraph AI
- [JSON Mode](https://docs.scrapegraphai.com/services/cli/json-mode.md): Machine-readable output for scripting and AI agents with --json
- [Crawl](https://docs.scrapegraphai.com/services/crawl.md): Multi-page website crawling with flexible output formats
- [Extract](https://docs.scrapegraphai.com/services/extract.md): AI-powered structured data extraction from any webpage
- [History](https://docs.scrapegraphai.com/services/history.md): Look up past requests and fetch the full results — including content from crawled pages.
- [Claude Desktop](https://docs.scrapegraphai.com/services/mcp-server/claude.md): Configure ScrapeGraph MCP in Claude Desktop (remote-first)
- [Cursor](https://docs.scrapegraphai.com/services/mcp-server/cursor.md): Configure ScrapeGraph MCP in Cursor (remote-first)
- [Introduction](https://docs.scrapegraphai.com/services/mcp-server/introduction.md): Get started with ScrapeGraphAI MCP Server - Connect LLMs to web scraping tools
- [Smithery](https://docs.scrapegraphai.com/services/mcp-server/smithery.md): Install ScrapeGraph MCP Server via Smithery
- [Monitor](https://docs.scrapegraphai.com/services/monitor.md): Scheduled web monitoring with AI-powered extraction and change detection
- [Scrape](https://docs.scrapegraphai.com/services/scrape.md): Scrape web pages in markdown, HTML, screenshot, JSON, and more
- [Search](https://docs.scrapegraphai.com/services/search.md): AI-powered web search with structured data extraction
- [Toonify](https://docs.scrapegraphai.com/services/toonify.md): Serialize structured data to a compact LLM-friendly format that cuts token usage by 30–60%
- [Transition from Firecrawl to ScrapeGraph v2](https://docs.scrapegraphai.com/transition-from-firecrawl.md): A practical guide for migrating your scraping workflows from Firecrawl to ScrapeGraph v2
- [Transition Guide from v1 to v2](https://docs.scrapegraphai.com/transition-from-v1-to-v2.md): Move from v1 to v2 quickly and safely
- [AI & LLM Applications](https://docs.scrapegraphai.com/use-cases/ai-llm.md): Power your AI applications with real-time web data
- [Content Aggregation](https://docs.scrapegraphai.com/use-cases/content-aggregation.md): Build powerful content aggregators and news monitoring systems
- [Lead Generation](https://docs.scrapegraphai.com/use-cases/lead-generation.md): Automate lead discovery and enrichment with intelligent web scraping
- [Market Intelligence](https://docs.scrapegraphai.com/use-cases/market-intelligence.md): Monitor competitors and market trends with automated data collection
- [Overview](https://docs.scrapegraphai.com/use-cases/overview.md): Transform web data into actionable insights with intelligent scraping
- [Research & Analysis](https://docs.scrapegraphai.com/use-cases/research-analysis.md): Build powerful research tools with deep web search capabilities
- [SEO & Analytics](https://docs.scrapegraphai.com/use-cases/seo-analytics.md): Monitor and optimize your digital presence with automated SEO tracking

## Optional

- [Official Website](https://scrapegraphai.com/)
- [Blog](https://scrapegraphai.com/blog)