
web scraping api mcp
为AI工作流提供可直接集成的网页抓取API,无需编写代码即可完成复杂数据任务。
Repository Info
About This Server
为AI工作流提供可直接集成的网页抓取API,无需编写代码即可完成复杂数据任务。
Model Context Protocol (MCP) - This server can be integrated with AI applications to provide additional context and capabilities, enabling enhanced AI interactions and functionality.
Documentation
🚀 We’ve just launched our new MCP server!
If you're building or using AI agents, you can now plug our web scraping API directly into your autonomous workflows. Just add the following to your MCP config:
{
"mcpServers": {
"web-scraping-api-by-instantapi-ai": {
"command": "npx",
"args": [
"-y",
"mcp-remote",
"https://web-scraping-api-by-instantapi-ai.help-052.workers.dev/sse",
"--header",
"Authorization:${AUTH_HEADER}"
],
"env": {
"AUTH_HEADER": "Bearer <YOUR_API_KEY>"
}
}
}
}
🔐 Just replace <YOUR_API_KEY> with your API key from InstantAPI.ai. Sign up for your own API key here: https://web.instantapi.ai/#pricing-03-254921
Once connected, your AI agent can automatically invoke any of our scraping endpoints—/scrape, /links, /next, /search—to complete complex web data tasks, without needing any HTML selectors or manual logic.
🧠 Example real-world task from a user:
Go to https://www.domain.com.au/sale/bowral-nsw-2576/?bedrooms=1-any&bathrooms=1-any&excludeunderoffer=1&establishedtype=established&sort=dateupdated-desc
Extract each property link.
For each, get the full physical address and how many days since it was listed. If not known, assume 0 (today).
Keep paginating until no properties are listed in the last 7 days.
Return all matching addresses.
✅ The agent completed the task autonomously—scraping new leads for a mortgage broker with zero code written.
If you’re building AI workflows, this massively cuts down on glue code and edge case handling. Just give your agent a goal and let it fetch the data.
Quick Start
Clone the repository
git clone https://github.com/zeeb0tt/web-scraping-api-mcpInstall dependencies
cd web-scraping-api-mcp
npm installFollow the documentation
Check the repository's README.md file for specific installation and usage instructions.
Repository Details
Recommended MCP Servers
Discord MCP
Enable AI assistants to seamlessly interact with Discord servers, channels, and messages.
Knit MCP
Connect AI agents to 200+ SaaS applications and automate workflows.
Apify MCP Server
Deploy and interact with Apify actors for web scraping and data extraction.
BrowserStack MCP
BrowserStack MCP Server for automated testing across multiple browsers.
Zapier MCP
A Zapier server that provides automation capabilities for various apps.