Web Hygiene MCP

Remote MCP server (Streamable HTTP) that gives AI agents seven tools answering from the live web — never from a cache or the model's memory:

Tool	What it does
site_overview(site)	robots.txt (sitemaps declared, AI crawlers addressed, blanket disallow), llms.txt, sitemaps with URL count sample, feeds
list_site_urls(site_or_sitemap, max_urls, include_regex, exclude_regex)	URLs a site publishes in its sitemaps, with lastmod (≤ 2,000)
check_url(url)	HTTP status, full redirect chain, final URL, response time, content type
check_links(urls | site_or_sitemap, max_urls, problems_only)	Bulk check: 404s, 5xx, timeouts, SSL errors, redirect chains, slow pages (≤ 300)
discover_feeds(site)	RSS / Atom / JSON feeds of a website
read_feed(feed_or_site, max_items, include_content)	Normalised feed items: title, link, date in UTC, author, summary, enclosures (≤ 100)
verify_citations(text | urls | citations, check_archive, max_citations)	Per cited URL: verified / mismatch / not-found / redirected-home / paywalled / blocked …, real title/date/author, quote match evidence, Internet Archive copy for dead links (≤ 50)

Connect

URL:    https://bruco3--web-hygiene-mcp.apify.actor/mcp
Header: Authorization: Bearer <YOUR_APIFY_API_TOKEN>

Claude Desktop / Cursor / any Streamable HTTP client:

{
  "mcpServers": {
    "web-hygiene": {
      "url": "https://bruco3--web-hygiene-mcp.apify.actor/mcp",
      "headers": { "Authorization": "Bearer YOUR_APIFY_API_TOKEN" }
    }
  }
}

A free Apify account gives you an API token and $5 of monthly credits. Tool calls are billed pay-per-event to your Apify account: a check_url costs a fraction of a cent; verifying the 10 sources of an answer about two cents. No subscription, nothing to run.

Try it — three prompts

1. "Check the sources in the answer you just gave me: does each link exist, and is the quote really on the page?" → verify_citations
2. "Before we cite anything from example.com, what does the site publish and allow?" → site_overview
3. "Check every link in this README and tell me which are broken or redirected." → check_links

Claude Code: ready-made plugin with two skills — /plugin marketplace add Luca-003/web-hygiene-claude-plugin then /plugin install web-hygiene@luca-003 (repo).

Why

Language models are confident about links and sources they have never fetched. These tools let an agent look before it claims: verify a URL exists and where it leads, check robots.txt and llms.txt before quoting a site, read what a site really publishes, confirm a cited page carries the quoted passage.

Details, pricing, issues

Full documentation, pricing table and issue tracker: https://apify.com/bruco3/web-hygiene-mcp

Related Actors for whole-site / whole-document jobs: Sitemap URL Extractor · Broken Link Checker · Feed Monitor · Citation & Link Verifier

Legal

The tools request only public files sites publish for automated readers (sitemaps, feeds, robots.txt, llms.txt) and public pages you name, with a clear User-Agent. No personal data is collected or stored.

This repository holds the registry metadata (server.json) and documentation; the server runs on Apify.