Web Content Retrieval (full webpage, filtered content, or Markdown-converted), Custom User-Agent, Multi-HTTP Method Support (GET/POST/PUT/DELETE/PATCH), LLM-Controlled Request Headers, LLM-Accessible Response Headers, and more.
Overview
What is mcp-server-requests?
The mcp-server-requests project is a service designed for HTTP requests that enables LLMs (Large Language Models) to read web pages. It supports various features such as converting web pages to Markdown, customizing User-Agent strings, and multiple HTTP methods.
How to use mcp-server-requests?
To use mcp-server-requests, clone the repository from GitHub, install the package, and run the server with the provided command. You can then use various subcommands to fetch web content or perform HTTP requests.
Key features of mcp-server-requests?
- Converts web pages to Markdown format.
- Allows customization of User-Agent strings.
- Supports multiple HTTP methods: GET, POST, PUT, DELETE, PATCH.
- Provides options for controlling request and response headers.
Use cases of mcp-server-requests?
- Fetching and processing web content for data analysis.
- Automating web scraping tasks with customizable headers.
- Integrating web content retrieval into LLM applications.
FAQ from mcp-server-requests?
- Can I customize the User-Agent?
Yes! You can specify a custom User-Agent or use a randomly generated one.
- What HTTP methods are supported?
The service supports GET, POST, PUT, DELETE, and PATCH methods.
- How do I install mcp-server-requests?
You can install it by cloning the repository and running
pip install .in the project directory.