Skip to main content

​
What is MCP?

The Model Context Protocol (MCP) is an open standard that enables AI assistants to connect directly to external tools and data sources. Crawleo provides native MCP support, allowing AI assistants to search the web and crawl URLs without custom integration code.

​
MCP Endpoint

https://api.crawleo.dev/mcp

​
Available Tools

When connected via MCP, AI assistants have access to two tools:

web.search

Perform real-time web searches and optionally crawl results.

web.crawl

Crawl specific URLs and extract content.

​
Compatible Platforms

Crawleo MCP works with all major AI assistants and development environments:

Claude Desktop

Anthropic’s Claude desktop application.

Cursor IDE

AI-powered code editor.

Windsurf IDE

Codeium’s AI development environment.

GitHub Copilot

GitHub’s AI pair programmer.

​
Why Use MCP?

Connect AI assistants to Crawleo without writing any integration code. Just configure and go.
AI assistants can naturally decide when to search the web or crawl pages based on your requests.
Give your AI assistant access to live web data, not just its training data.
Same strict privacy guarantees as the REST API - no data retention, no training on your data.

​
Quick Setup

The basic configuration pattern is the same across all platforms: 
{
  "mcpServers": {
    "crawleo": {
      "url": "https://api.crawleo.dev/mcp",
      "headers": {
        "Authorization": "Bearer YOUR_API_KEY"
      }
    }
  }
}
Select your platform from the navigation to see detailed setup instructions.

​
Example Usage

Once configured, you can ask your AI assistant things like:
  • “Search for the latest news about artificial intelligence”
  • “Crawl this documentation page and summarize it”
  • “Find and compare pricing from these three websites”
  • “Research the top Python web frameworks and their features”
The AI will automatically use Crawleo’s tools to fetch real-time web data.

​
Resources

MCP.so Listing

View Crawleo on MCP.so directory.

GitHub Examples

Code examples and integrations.