README.md
Advanced web search and scraping server for targeted DuckDuckGo searches
An advanced web search and scraping server that enables AI models to perform targeted DuckDuckGo searches and extract clean content, tables, and metadata from webpages. It provides specialized tools for news discovery, link extraction, and comprehensive search-and-scrape workflows.
Tools (4)
searchPerform a DuckDuckGo search to find relevant webpages and information.scrapeExtract clean content, tables, and metadata from a specific URL.news_searchSearch for recent news articles and discovery links.extract_linksExtract all links from a specific webpage for further discovery.Configuration
claude_desktop_config.json
{"mcpServers":{"mcp-web-scraper":{"command":"npx","args":["-y","@aniruddha1202/mcp-web-scraper"]}}}Try it
→Search DuckDuckGo for the latest developments in quantum computing and summarize the top results.
→Scrape the content and tables from the Wikipedia page for 'Artificial Intelligence' and give me a summary.
→Find recent news articles about global semiconductor supply chain updates using news_search.
→Extract all the links from the homepage of a tech news site to find specific article URLs.