MCPServers
Markdown Web Crawl - MCP server logo

Markdown Web Crawl

2
0

Summary

This MCP implementation, developed by JMH, is a Python-based web crawler designed for extracting and saving website content as markdown files. It offers features like website structure mapping, batch URL processing, and configurable output settings. The project integrates with FastMCP for easy installation and deployment, and leverages libraries such as BeautifulSoup and requests for efficient web scraping. Its focus on markdown output and straightforward configuration makes it particularly suitable for content aggregation, site archiving, or building knowledge bases from web sources. The crawler's ability to create content indexes and its support for concurrent requests set it apart as a tool for both small-scale personal projects and larger data collection tasks.

Available Actions(3)

extract_content

Extracts content from a specified URL and saves it to a file. Parameters: url (string), output_path (string)

scan_linked_content

Scans the linked content from a specified URL. Parameters: url (string)

create_index

Creates an index from the scanned content map. Parameters: content_map (string), output_path (string)

Last Updated: April 25, 2025

Community Reviews

0.0
0 reviews
5
0
4
0
3
0
2
0
1
0

No reviews yet. Be the first to review!

Sign in to join the conversation

Coming soon to
HighlightHighlight AI

Language

TypeScript

Categories

Tags