Overview
The Search API provides real-time web search with optional automatic crawling of search results. Perfect for AI applications that need fresh web data.
Endpoint
GET https://api.crawleo.dev/api/v1/search
Parameters
Required Parameters
Number of results to return per page (1-50).
Maximum number of search result pages to fetch.
Localization Parameters
Language code for search results (e.g., en, es, fr, de).
Country code for search results (e.g., US, GB, DE).
Geographic location for localized results.
Device Simulation
Device type to simulate. Options: desktop, mobile, tablet.
Return the original HTML source of each result page.
Return clean HTML with ads, scripts, and tracking removed.
Return plain text content extracted from each result page.
Return content as structured Markdown (recommended for RAG/LLM).
Auto-Crawling
Automatically crawl each search result URL and include page content.
Example Requests
Basic Search
curl -X GET "https://api.crawleo.dev/api/v1/search?query=machine%20learning&count=10" \
-H "Authorization: Bearer YOUR_API_KEY"
Search with Auto-Crawling and Markdown Output
curl -X GET "https://api.crawleo.dev/api/v1/search?query=python%20tutorials&count=5&auto_crawling=true&get_page_text_markdown=true" \
-H "Authorization: Bearer YOUR_API_KEY"
Localized Search
curl -X GET "https://api.crawleo.dev/api/v1/search?query=news&setLang=de&cc=DE&count=10" \
-H "Authorization: Bearer YOUR_API_KEY"
Response
A successful response returns search results with optional crawled content:
{
"results" : [
{
"title" : "Introduction to Machine Learning" ,
"url" : "https://example.com/ml-intro" ,
"snippet" : "A comprehensive guide to machine learning..." ,
"markdown" : "# Introduction to Machine Learning \n\n Machine learning is..."
}
],
"total_results" : 1000 ,
"page" : 1
}
Array of search result objects. Show Result object properties
Title of the search result.
URL of the search result.
Short description/snippet from the search engine.
Full HTML source (if get_raw_html=true).
Clean HTML content (if get_ai_enhanced_html=true).
Plain text content (if get_page_text=true).
Markdown content (if get_page_text_markdown=true).
Estimated total number of results available.
Use Cases
Use auto_crawling=true with get_page_text_markdown=true to fetch search results and their full content in a single request, formatted for LLM consumption.
Combine with localization parameters to gather region-specific information for AI research agents.
Use get_ai_enhanced_html=true to collect clean content from multiple sources without ads and scripts.