Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.scrapegraphai.com/llms.txt

Use this file to discover all available pages before exploring further.

You are viewing the v1 (legacy) documentation. In v2, crawling uses crawl.start(), crawl.status(), crawl.stop(), and crawl.resume(). See the v2 documentation.

​
Overview

SmartCrawler enables AI-powered extraction across multiple pages of a website, automatically navigating and collecting structured data.

​
Usage

from scrapegraph_py import Client

client = Client(api_key="your-api-key")

response = client.crawl(
    website_url="https://example.com",
    user_prompt="Extract all blog post titles",
    depth=2
)