by laurentvv · MCP Server · ★ 36
Web Crawler MCP A powerful web crawling tool that integrates with AI assistants via the MCP (Model Context Protocol). This project allows AI assistants to crawl websites, extract dynamic content, navigate through links, and save structured Markdown files directly. 📋 Features Native integration with AI assistants via MCP Return scraped Markdown content directly to the AI Extracts and surfaces internal/external links for AI navigation Wait for dynamic CSS selectors before scraping (SPA support) Website crawling with configurable depth Detailed crawl result statistics -
| Stars | 36 |
| Forks | 12 |
| Language | Python |
| Category | MCP Server |
| Quality Score | 60.548/100 |
| Last Updated | 2026-04-14 |
| Created | 2025-03-10 |
| Platforms | browser, mcp, python |
| Est. Tokens | ~23k |
Explore other popular mcp server tools:
crawl4ai-mcp is Web crawling tool that integrates with AI assistants via the MCP. It is categorized as a MCP Server with 36 GitHub stars.
crawl4ai-mcp is primarily written in Python. It covers topics such as ai-tools, crawl4ai, mcp.
You can find installation instructions and usage details in the crawl4ai-mcp GitHub repository at github.com/laurentvv/crawl4ai-mcp. The project has 36 stars and 12 forks, indicating an active community.