Skip to main content

​
Overview

Connect Crawleo to Anthropic’s Claude Desktop application to give Claude real-time web search and crawling capabilities.

​
Prerequisites

  • Claude Desktop installed (download)
  • Active Crawleo subscription with API key

​
Configuration

1

Open Claude Desktop Settings

Open Claude Desktop and navigate to Settings → Developer → Edit Config.This opens the claude_desktop_config.json file.
2

Add Crawleo MCP Server

Add the Crawleo MCP configuration to your config file:
{
  "mcpServers": {
    "crawleo": {
      "url": "https://api.crawleo.dev/mcp",
      "headers": {
        "Authorization": "Bearer YOUR_API_KEY"
      }
    }
  }
}
Replace YOUR_API_KEY with your actual Crawleo API key.
3

Restart Claude Desktop

Close and reopen Claude Desktop to load the new configuration.
4

Verify Connection

Look for the MCP tools icon (hammer) in the chat interface. Click it to see the available Crawleo tools:
  • web.search
  • web.crawl

​
Example Prompts

Once connected, try these prompts with Claude: 
Crawl https://docs.python.org/3/tutorial/index.html and create 
a study guide based on the content.

Research the top 3 JavaScript frameworks in 2025. Search for 
recent articles and compare their features.

Crawl this blog post [URL] and analyze the author's main arguments.

​
Configuration File Location

The Claude Desktop config file is located at:
OSPath
macOS~/Library/Application Support/Claude/claude_desktop_config.json
Windows%APPDATA%\Claude\claude_desktop_config.json
Linux~/.config/Claude/claude_desktop_config.json

​
Full Configuration Example

Here’s a complete example with Crawleo configured: 
{
  "mcpServers": {
    "crawleo": {
      "url": "https://api.crawleo.dev/mcp",
      "headers": {
        "Authorization": "Bearer crl_abc123xyz789"
      }
    }
  }
}

​
Troubleshooting

  1. Verify your API key is correct
  2. Ensure the JSON syntax is valid
  3. Restart Claude Desktop completely
  4. Check that you have an active Crawleo subscription
  • Verify your API key is valid at crawleo.dev
  • Ensure the Authorization header includes Bearer prefix
  • Check for extra spaces or formatting issues in the config
  • Check your internet connection
  • Verify the MCP URL is exactly https://api.crawleo.dev/mcp
  • Try regenerating your API key if issues persist

Need Help?

Contact support if you’re still having issues.