Crawleo Documentation

Overview

Connect Crawleo to Cursor IDE to give the AI assistant real-time web search and crawling capabilities while you code.

Prerequisites

Cursor IDE installed (download)
Active Crawleo subscription with API key

MCP tools use the same credits as the REST API. search_web costs 10 credits per page, and crawl_web costs 1-10 credits per page based on proxy settings. View pricing

Configuration

Open Cursor Settings

Open Cursor and go to Settings → Cursor Settings → MCP.Or press Cmd+Shift+P (macOS) / Ctrl+Shift+P (Windows/Linux) and search for “MCP”.

Add MCP Server

Click Add MCP Server and configure:

Name: crawleo
URL: https://api.crawleo.dev/mcp
Headers:
Authorization: Bearer YOUR_API_KEY

Save and Verify

Save the configuration. The Crawleo tools should now be available in your AI conversations.

Alternative: Manual Configuration

You can also edit the MCP configuration file directly:

macOS
Windows
Linux

Edit ~/.cursor/mcp.json:

{
  "mcpServers": {
    "crawleo": {
      "url": "https://api.crawleo.dev/mcp",
      "headers": {
        "Authorization": "Bearer YOUR_API_KEY"
      }
    }
  }
}

Edit %USERPROFILE%\.cursor\mcp.json:

{
  "mcpServers": {
    "crawleo": {
      "url": "https://api.crawleo.dev/mcp",
      "headers": {
        "Authorization": "Bearer YOUR_API_KEY"
      }
    }
  }
}

Edit ~/.cursor/mcp.json:

{
  "mcpServers": {
    "crawleo": {
      "url": "https://api.crawleo.dev/mcp",
      "headers": {
        "Authorization": "Bearer YOUR_API_KEY"
      }
    }
  }
}

Example Use Cases

Once connected, use Crawleo with Cursor for:

Research Libraries

Search for the best Python libraries for data validation in 2025 
and compare their features.

Read Documentation

Crawl the FastAPI documentation at https://fastapi.tiangolo.com 
and show me how to set up authentication.

Check API References

Search for the Stripe API documentation and show me how to 
create a subscription.

Debug Help

Search for solutions to "React hydration mismatch error" 
and summarize the best fixes.

Workflow Tips

Combine Crawleo web search with Cursor’s codebase understanding for powerful research and implementation workflows.

Example workflow:

Ask Cursor to search for best practices using Crawleo
Have Cursor analyze your current code
Get suggestions that combine web knowledge with your codebase context

Video Tutorial

Troubleshooting

MCP server not connecting

Restart Cursor after configuration changes
Verify the URL is exactly https://api.crawleo.dev/mcp
Check your API key is valid

Tools not available in chat

Open a new chat window after configuring MCP
Check the MCP status indicator in Cursor settings
Verify your Crawleo subscription is active

Need Help?

Contact support if you’re still having issues.

Getting Started

API Overview

Search APIs

Crawling APIs

Core Concepts

MCP Integration

Integrations

Cursor IDE

Overview

Prerequisites

Configuration

Alternative: Manual Configuration

Example Use Cases

Workflow Tips

Video Tutorial

Troubleshooting

Need Help?

​Overview

​Prerequisites

​Configuration

​Alternative: Manual Configuration

​Example Use Cases

​Workflow Tips

​Video Tutorial

​Troubleshooting

Need Help?

Overview

Prerequisites

Configuration

Alternative: Manual Configuration

Example Use Cases

Workflow Tips

Video Tutorial

Troubleshooting