Skip to main content

​
Overview

The ScrapeGraphAI MCP Server is a production-ready Model Context Protocol (MCP) server that connects Large Language Models (LLMs) to the ScrapeGraph AI API. It enables AI assistants like Claude and Cursor to perform AI-powered web scraping, research, and crawling directly through natural language interactions.

⭐ Star us on GitHub

If this server is helpful, a star goes a long way. Thanks!

​
What is MCP?

The Model Context Protocol (MCP) is a standardized way for AI assistants to access external tools and data sources. By using the ScrapeGraphAI MCP Server, your AI assistant gains access to powerful web scraping capabilities without needing to write code.

​
Key Features

8 Powerful Tools

Access markdown conversion, AI extraction, search, crawling, sitemap discovery, and agentic workflows

Remote & Local

Use the hosted HTTP endpoint or run locally via Python

Universal Compatibility

Works with Cursor, Claude Desktop, and any MCP-compatible client

Production Ready

Robust error handling, timeouts, and reliability tested in production

​
Available Tools

The MCP server exposes 8 enterprise-ready tools:
  1. markdownify - Convert webpages to clean markdown
  2. smartscraper - AI-powered extraction with optional infinite scrolls
  3. searchscraper - Search the web and extract structured results
  4. scrape - Fetch raw HTML with optional JavaScript rendering
  5. sitemap - Discover a site’s URLs and structure
  6. smartcrawler_initiate - Start async multi-page crawls
  7. smartcrawler_fetch_results - Poll crawl results
  8. agentic_scrapper - Multi-step workflows with session persistence

​
Quick Start

1

Get Your API Key

Create an account and copy your API key from the ScrapeGraph Dashboard
2

Choose Your Client

Select your preferred AI assistant: Cursor or Claude Desktop
3

Configure MCP

Follow the setup guide for your client to connect the MCP server
4

Start Scraping

Ask your AI assistant to scrape websites, extract data, or perform research

​
Setup Guides

https://mintcdn.com/scrapegraphaiinc-9e950277/3eC85GCQlhpZd6A9/logo/APP_ICON_2D_DARK.png?fit=max&auto=format&n=3eC85GCQlhpZd6A9&q=85&s=60fd0bda96a73202515632f745e72893

Cursor Setup

Configure ScrapeGraph MCP in Cursor (remote-first)
https://mintcdn.com/scrapegraphaiinc-9e950277/3eC85GCQlhpZd6A9/logo/claude-color.svg?fit=max&auto=format&n=3eC85GCQlhpZd6A9&q=85&s=3662a53324cc391dd67b7ecee91bc21a

Claude Desktop Setup

Configure ScrapeGraph MCP in Claude Desktop (remote-first)
The easiest way to get started is using our hosted MCP endpoint: 
https://mcp.scrapegraphai.com/mcp
This requires no local installation and works seamlessly with both Cursor and Claude Desktop. See the setup guides above for configuration details.

​
Local Installation

Prefer running locally? You can install the Python package and run it via stdio. This gives you more control and doesn’t require internet connectivity for the MCP connection itself.
The remote endpoint is recommended for most users as it’s simpler to set up and maintain.

​
Use Cases

  • Research & Analysis - Extract data from multiple sources for research
  • Content Aggregation - Collect and structure content from websites
  • Market Intelligence - Monitor competitors and market trends
  • Lead Generation - Extract contact information and company data
  • Data Collection - Build datasets from web sources

​
Next Steps

Ready to Start?

Choose your client and start scraping with AI!