Add it to Claude Code
claude mcp add mcp-server-scraper -- npx -y mcp-server-scraperMake your agent remember this setup
mcp-server-scraper's config, env vars, and the gotchas you hit — recalled in every future Claude Code, Cursor, and Codex session.
npx conare@latestFree · one command · indexes the sessions already on disk. Set up in the browser instead →
What it does
- Extracts clean markdown from web pages using Mozilla Readability
- Retrieves page metadata including OG tags and canonical links
- Supports batch scraping of multiple URLs
- Performs text searching within page content
- No API keys or accounts required
Tools 5
scrape_urlExtract clean text content from a URL using the Readability engine.extract_linksGet all links with href and anchor text from a URL.extract_metadataGet title, description, OG tags, canonical, and favicon from a URL.search_pageSearch for a query string within the page and return matching lines.scrape_multipleBatch scrape multiple URLs to get title and excerpt per URL.Try it
Original README from ofershap/mcp-server-scraper
mcp-server-scraper
Extract clean, readable content from any URL. Returns markdown text, links, and metadata. No API keys, no config. A free alternative to Firecrawl for scraping docs, blogs, and articles.
npx mcp-server-scraper
Works with Claude Desktop, Cursor, VS Code Copilot, and any MCP client. No accounts or API keys needed.
<sub>Demo built with remotion-readme-kit</sub>
Why
When you're working with an AI assistant and need to reference a docs page, a blog post, or an API reference, you usually end up copy-pasting content manually. Tools like Firecrawl solve this but require a paid API key. This server does the same thing for free. It fetches a URL, runs it through Mozilla Readability (the same engine behind Firefox Reader View), and returns clean markdown. It works well for server-rendered content like documentation sites, blog posts, and articles. It won't handle JavaScript-heavy SPAs, but for the most common use case of "read this docs page and summarize it," it does the job.
Tools
| Tool | What it does |
|---|---|
scrape_url |
Extract clean text content from a URL (Readability-powered) |
extract_links |
Get all links with href and anchor text |
extract_metadata |
Get title, description, OG tags, canonical, favicon |
search_page |
Search for a query string within the page, return matching lines |
scrape_multiple |
Batch scrape multiple URLs, get title + excerpt per URL |
Quick Start
Cursor
Add to .cursor/mcp.json:
{
"mcpServers": {
"scraper": {
"command": "npx",
"args": ["-y", "mcp-server-scraper"]
}
}
}
Claude Desktop
Add to claude_desktop_config.json:
{
"mcpServers": {
"scraper": {
"command": "npx",
"args": ["-y", "mcp-server-scraper"]
}
}
}
VS Code
Add to your MCP settings (e.g. .vscode/mcp.json):
{
"mcp": {
"servers": {
"scraper": {
"command": "npx",
"args": ["-y", "mcp-server-scraper"]
}
}
}
}
Examples
- "Scrape the API docs from https://docs.example.com and summarize them"
- "Extract all links from this page"
- "What's the OG image and description for this URL?"
- "Search this page for mentions of 'authentication'"
- "Scrape these 5 URLs and give me a summary of each"
How it works
Uses Mozilla Readability (the engine behind Firefox Reader View) plus linkedom for fast HTML parsing in Node. No headless browser needed. Works best with server-rendered pages: docs, blogs, articles, news sites.
Development
npm install
npm run typecheck
npm run build
npm test
See also
More MCP servers and developer tools on my portfolio.
Author
<sub>README built with README Builder</sub>