#scraping

Official Firecrawl MCP Server - Adds powerful web scraping to Cursor, Claude and any other LLM clients.

Model Context Protocol server that integrates AgentQL's data extraction capabilities.

Browser automation and web scraping

Extracts clean markdown from noisy public web pages so agents can read content without nav clutter, scripts, or ad-heavy markup.

Mirror of

Mirror of

MCP server to download entire websites

Mirror of

Mirror of

Example MCP server and instructions for connecting Anthropic LLMs to external web scraping tools, with real-world examples and Bright Data integration.

A Browser Automation Tool for Humans and AI - Built with Playwright, optimized for Bun runtime, supporting CLI and MCP Server modes for webpage analysis and automation

A browser automation MCP server for AI models like Claude and Gemini 2.5, enabling web browsing capabilities through natural language

This project demonstrates how to use Cloudflare Browser Rendering to extract web content for LLM context. It includes experiments with the REST API and Workers Binding API, as well as an MCP server implementation that can be used to provide web context to LLMs.

Web Search tools are a series of tools that allow Claude to acces de internet via MCP Server

MCP server for browser automation with screenshot and console logging capabilities

Direct access to 40+ scraping and search tools. Extract structured data from Google (Search, Maps, Trends), Amazon, Airbnb, Social Media, and any web page directly into your AI agent.

Mirror of

Scrape any webpage as clean Markdown and extract YouTube transcripts. Enterprise grade infrastructure at $0.001 per request.

Bridge the gap between your web crawler and AI language models using Model Context Protocol (MCP). With mcp-server-webcrawl, your AI client filters and analyzes web content under your direction or autonomously, extracting insights from your web content. Support for WARC, wget, InterroBot, Katana, and SiteOne crawlers is available out of the gate. The server includes a full-text search interface with boolean support, resource filtering by type, HTTP status, and more.

Crawlbase Web MCP Server (Model Context Protocol) connects AI agents and large language models (LLMs) with real-time web data. Built on Crawlbase’s proven web scraping and crawling infrastructure, it handles JavaScript rendering, anti-bot protection, and web data extraction at scale — powering Claude, Cursor, and Windsurf. It delivers a reliable, production-ready pipeline of live, structured data for AI workflows and intelligent applications.

Example MCP server and instructions for connecting Anthropic LLMs to external web scraping tools, with real-world examples and Bright Data integration.

Roo MCP Server - Real-world automation for web scraping and browser control

MCP server for browser automation via Puppeteer. Executes arbitrary JavaScript with direct access to Puppeteer Browser instance. Single "execute" tool runs your code in a sandboxed Node.js VM with a browser global - full Puppeteer API access in one call.

A Model Context Protocol (MCP) server implementation that integrates with web scraping capabilities.

An MCP server that provides web content to your agent.

An MCP server for (free!) search results via duckduckgo

Model Context Protocol (MCP) server for Windsurf integration with image generation and web scraping capabilities.

AI-powered website crawling, analysis, and export via MCP. 38 tools for crawl control, browser enrichment capture, WARC/ZIP/single-HTML export, observation timeline, and evidence-backed findings. 4 resources, 4 prompts. Dual-mode: full (38 tools) or code (6 tools). Install: npx crawlio-mcp

A Playwright-based Node.js tool that bypasses search engine anti-scraping mechanisms to execute Google searches. Local alternative to SERP APIs with MCP server integration.

Discover, extract, and interact with the web - one interface powering automated access across the public internet.

MCP server for Firecrawl Simple — a web scraping and site mapping tool enabling LLMs to access and process web content

Basic MCP Server for Web Scraping

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

x402-native API gateway for AI agents. 20+ capabilities (web scraping, screenshots, search, email, translate) — pay-per-use in USDC, no API keys needed.

MCP server for using ScrAPI to scrape web pages.

Mirror of

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

B4n1Web is an ultra-lightweight agentic browser engine (6MB) for AI agents. It provides three browsing modes: Light (HTTP fetch + HTML parsing), JS (JavaScript extraction), and Render (full headless browser with Chromium). Perfect for web scraping, data extraction, E2E testing, and autonomous AI agents that need to navigate and extract content from websites without the overhead of a full browser. Features: - Ultra-lightweight binary (6MB) - Python SDK available on PyPI - MCP server for integration with Claude, Cursor, OpenCode, Windsurf, Antigravity - SQLite-based SecurityShield for safe browsing - Multiple modes: Light, JS, Render MCP Server: Command: b4n1web mcp -p 8080 Port is configurable — change 8080 to any available port Tools: goto (navigate & extract content), get_links (extract all links from current page)

Search Google, scrape webpage and retrieve content in markdown.