Base URL
All API requests should be made to:Authentication
All endpoints require authentication using your API key. You can provide it in one of two ways: Option 1: Authorization HeaderGet Your API Key
Sign up and subscribe to get your API key.
Available Endpoints
Crawleo provides two main API endpoints:Search API
GET /searchReal-time web search with optional automatic crawling of results.
Crawler API
GET /crawlDirect URL crawling with JavaScript rendering support.
Output Formats
Both APIs support multiple output formats optimized for different use cases:| Format | Crawler Parameter | Description | Best For |
|---|---|---|---|
| Raw HTML | output_format=raw_html | Original page source | Full content preservation |
| Enhanced HTML | output_format=enhanced_html | Clean HTML (no ads, scripts) | Cleaner processing |
| Markdown | output_format=markdown | Structured markdown | RAG pipelines, LLMs |
Response Format
All responses are returned as JSON. Successful responses include the requested data, while errors return an error object:HTTP Status Codes
| Code | Description |
|---|---|
200 | Success |
400 | Bad Request - Invalid parameters |
401 | Unauthorized - Invalid or missing API key |
403 | Forbidden - Insufficient permissions |
429 | Credits exhausted or concurrent request limit reached |
500 | Internal Server Error |
Credits System
API usage is tracked using credits. Each API call deducts credits from your monthly allowance based on your subscription plan.Credit Costs by Endpoint
| API Endpoint | Credits Cost |
|---|---|
| Search API | 10 credits per page of results |
| Crawl API (no proxy) | 1 credit per page |
| Crawl API (standard proxy) | 2 credits per page |
| Crawl API (premium proxy) | 10 credits per page |
Subscription Plans
| Plan | Credits/Month | Concurrent Requests | Price |
|---|---|---|---|
| Free | 10,000 | 5 | $0/month |
| Developer | 100,000 | 20 | $20/month |
| Pro | 1,000,000 | 50 | $100/month |
| Scale | 2,500,000 | 100 | $200/month |
Credits & Pricing
View detailed pricing, usage examples, and optimization tips.
Concurrent Request Limits
Each plan has a maximum number of concurrent requests. If you exceed this limit, you’ll receive a429 response with the message:
MCP Integration
For AI assistants and IDEs, Crawleo also provides a Model Context Protocol (MCP) endpoint:MCP Integration
Learn how to connect AI assistants directly to Crawleo.