#crawling

Mirror of

Crawlbase Web MCP Server (Model Context Protocol) connects AI agents and large language models (LLMs) with real-time web data. Built on Crawlbase’s proven web scraping and crawling infrastructure, it handles JavaScript rendering, anti-bot protection, and web data extraction at scale — powering Claude, Cursor, and Windsurf. It delivers a reliable, production-ready pipeline of live, structured data for AI workflows and intelligent applications.

MCP server for podcast discovery through web crawling

Discover, extract, and interact with the web - one interface powering automated access across the public internet.

MCP (Model Context Protocol) server wrapping Crawl4AI library as functions using Python

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

A Model Context Protocol (MCP) compliant server designed for comprehensive web research. It uses Tavily's Search and Crawl APIs to gather detailed information on a given topic, then structures this data in a format perfect for LLMs to create high-quality markdown documents.

A Model Context Protocol (MCP) compliant server designed for comprehensive web research. It uses Tavily's Search and Crawl APIs to gather detailed information on a given topic, then structures this data in a format perfect for LLMs to create high-quality markdown documents.

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

Real-time web search and crawling capabilities for AI assistants through Model Context Protocol (MCP)

Rust MCP server that gives AI agents reliable web access. Bypasses Cloudflare and bot protection using Chrome-level TLS fingerprinting, no headless browser needed. 10 tools for scraping, crawling, search, structured extraction, summarization, and more. Output is clean markdown optimized for LLMs with 67% fewer tokens than raw HTML. 8 of 10 tools work locally without an API key.

Web scraping, crawling, and data extraction for AI agents. 5 built-in tools: scrape (clean markdown from any URL), crawl (follow links across entire sites), map (discover all URLs on a domain), extract (structured JSON via schema), and search (web search with optional page scraping). 833ms average latency, single binary, 6 MB RAM. Self-host free or use managed cloud at fastcrw.com with 500 free credits. Firecrawl-compatible API. Works with Claude Desktop, Claude Code, Cursor, Windsurf, and any MCP-compatible client.