Skip to main content

Documentation Index

Fetch the complete documentation index at: https://www.octoparse.com/docs/llms.txt

Use this file to discover all available pages before exploring further.

Connect Octoparse’s web-scraping platform to any MCP-compatible AI agent. Search templates, run cloud tasks, and retrieve data — all from natural language. Works with pre-built Octoparse templates and cloud-supported tasks.

Prerequisites

1

An Octoparse account

Any Octoparse account can connect. Free and Basic users receive 2,000 free records per week for MCP extraction — no upgrade required to get started.
2

An MCP-compatible client

Such as ChatGPT, Claude, OpenClaw, Cursor, VS Code (GitHub Copilot), or Antigravity CLI / Gemini CLI.

Scope & limitations

✅ Can do

  • Search pre-built scraping templates
  • Trigger and monitor cloud task runs
  • Export collected data (JSON / CSV)
  • List and search existing tasks
  • Start or stop a running task
  • Redeem a coupon code

❌ Cannot do

  • Run local-only tasks (desktop client required)
  • Create or edit task configurations
  • Upload custom scraping templates
  • Access account settings or billing
  • Scrape without a pre-built template

Quick start

Server URL

Server URL
https://mcp.octoparse.com

Authentication methods

Path A: OAuth 2.1

Browser-based login. Recommended for most users. No API key needed — just sign in to Octoparse when prompted.

Path B: API key

Direct API key authentication. Best for automated or headless environments like Claude Code, VS Code, TRAE, and OpenClaw.Get your key from your Octoparse account center.

Supported clients

https://op-official-us-1251101074.cos.na-siliconvalley.myqcloud.com/mcp/chatgpt.svg

ChatGPT

https://op-official-us-1251101074.cos.na-siliconvalley.myqcloud.com/mcp/claude.svg

Claude

https://op-official-us-1251101074.cos.na-siliconvalley.myqcloud.com/mcp/openclaw.svg

OpenClaw

https://op-official-us-1251101074.cos.na-siliconvalley.myqcloud.com/mcp/cursor.svg

Cursor

https://op-official-us-1251101074.cos.na-siliconvalley.myqcloud.com/mcp/vscode.svg

VS Code

https://op-official-us-1251101074.cos.na-siliconvalley.myqcloud.com/mcp/gemini.svg

Antigravity CLI / Gemini CLI

1

Open Customization settings

Click your profile avatar and choose Customize ChatGPT.
2

Enable Developer Mode

Go to Apps → Advanced Settings and turn on Developer Mode (Beta).
3

Create the Octoparse app

Click Create app. Set Name to Octoparse, MCP URL to https://mcp.octoparse.com, leave OAuth Client ID and Secret blank, confirm the acknowledgement, then create the app.
4

Authorize via OAuth

ChatGPT redirects to Octoparse. Sign in and click Allow.
See full setup guide
Path A: OAuth
1

Open Settings → Integrations

In the Claude sidebar, go to Settings → Integrations.
2

Add the server URL

Click Add Integration and enter https://mcp.octoparse.com.
3

Authorize via OAuth

Click Connect. A browser window opens. Sign in and click Allow.
See full setup guide
Path B: API Key (Claude Code)Add to ~/.claude/settings.json:
    {
      "mcpServers": {
        "octoparse": {
          "type": "http",
          "url": "https://mcp.octoparse.com",
          "headers": {
            "x-api-key": "YOUR_API_KEY"
          }
        }
      }
    }
Path A: OAuth
1

Install OpenClaw

Install OpenClaw, then run the onboard command.
2

Register the MCP server

Set the Octoparse MCP server and verify the configuration.
3

Restart the Gateway

Restart the Gateway to apply the configuration.
4

Authorize via OAuth

Your first Octoparse tool call opens a browser for OAuth. Sign in and click Allow.

Path B: API Key
    mcporter config add octoparse https://mcp.octoparse.com
    mcporter config set octoparse header.x-api-key "YOUR_API_KEY"
Then add to OpenClaw config:
    {
      "mcp": {
        "servers": {
          "octoparse": {
            "command": "mcporter",
            "args": ["run", "stdio", "--server", "octoparse"]
          }
        }
      }
    }
Path A: OAuth
1

Open Cursor Settings

Open Cursor and click the settings icon in the top-right corner.
2

Go to Tools & MCP

In the left sidebar, select Tools & MCP.
3

Add a custom MCP server

Click Add Custom MCP. Cursor opens the MCP configuration file. Add https://mcp.octoparse.com and save.
See full setup guide
Path B: API KeyAdd to ~/.cursor/mcp.json:
    {
      "mcpServers": {
        "octoparse": {
          "type": "http",
          "url": "https://mcp.octoparse.com",
          "headers": {
            "x-api-key": "YOUR_API_KEY"
          }
        }
      }
    }
Requires an active GitHub Copilot subscription.
Path A: OAuthAdd to .vscode/mcp.json:
    {
      "servers": {
        "octoparse": {
          "type": "http",
          "url": "https://mcp.octoparse.com"
        }
      }
    }
See full setup guide
Path B: API Key
    {
      "servers": {
        "octoparse": {
          "type": "http",
          "url": "https://mcp.octoparse.com",
          "headers": {
            "x-api-key": "YOUR_API_KEY"
          }
        }
      }
    }
Path A: OAuth
1

Prerequisites

Make sure you have Node.js and a Google account.
2

Set up Antigravity CLI or existing Gemini CLI

Google is transitioning Gemini CLI to Antigravity CLI. For individual and free users, Gemini CLI is expected to stop serving requests on June 18, 2026. We recommend setting up Octoparse MCP with Antigravity CLI where available.
3

Start and authenticate

For existing Gemini CLI users, run gemini, choose Google login, and complete sign-in in the browser. New users should use Antigravity CLI if their environment supports MCP configuration.
See Gemini CLI setup guide
Path B: API KeyAdd to ~/.gemini/settings.json:
    {
      "mcpServers": {
        "octoparse": {
          "type": "http",
          "url": "https://mcp.octoparse.com",
          "headers": {
            "x-api-key": "YOUR_API_KEY"
          }
        }
      }
    }