# ScrapeMole Reader: web pages to Markdown, link previews, RSS feeds, links and sitemaps for AI agents

> Pay-per-call web reading for agents: any public page as clean Markdown, link-preview/SEO metadata (Open Graph, Twitter card, favicon, JSON-LD), RSS/Atom/JSON feeds normalized, every link on a page (internal/external, rel) and a site's XML sitemap as a URL list. USDC via x402, no accounts or API keys; failed calls are never charged.

Pay with x402 v2 (exact, USDC on Base). Call without payment to get a 402 with the price; retry with an x402 client. Only 200 responses are charged.

## Endpoints

- GET https://reader.scrapemole.workers.dev/v1/read ($0.003): Any public web page as clean Markdown (main content only) plus title, author, date and word count.
  - url (required): Public http(s) URL of the page.
  - format: Output format. One of: markdown, text. Default markdown.
  - maxChars: Cut the content at this many characters (1000-200000). Default 50000.
  - images: Keep images as Markdown image links (true/false). Default true.
  - links: Keep hyperlinks as Markdown links (true/false). Default true.
- GET https://reader.scrapemole.workers.dev/v1/meta ($0.001): Link preview / SEO metadata for a URL: title, description, Open Graph, Twitter card, canonical, favicon, feeds, JSON-LD types.
  - url (required): Public http(s) URL.
- GET https://reader.scrapemole.workers.dev/v1/feed ($0.002): Latest items of an RSS, Atom or JSON feed, normalized (title, link, date, author, summary, image). Give a feed URL or a site URL (feed auto-discovered).
  - url (required): Feed URL, or a site/page URL to auto-discover its feed.
  - limit: Max items (1-100). Default 20.
- GET https://reader.scrapemole.workers.dev/v1/links ($0.002): All links on a web page, absolute and deduplicated, with anchor text, internal/external flag, nofollow/sponsored/ugc rel and how often each appears.
  - url (required): Public http(s) URL of the page.
  - type: Which links to return. One of: all, internal, external. Default all.
  - limit: Max distinct links (1-2000). Default 500.
- GET https://reader.scrapemole.workers.dev/v1/sitemap ($0.002): A site's XML sitemap as a URL list with lastmod, changefreq and priority. Finds it via robots.txt or /sitemap.xml; handles sitemap indexes and .xml.gz.
  - url (required): Site URL (e.g. https://example.com) or a sitemap .xml/.xml.gz URL.
  - limit: Max page URLs returned (1-5000). Default 1000.
  - expand: For a sitemap index, also read the first child sitemaps (true/false). Default true.

## MCP

- Remote MCP server (Streamable HTTP): POST https://reader.scrapemole.workers.dev/mcp. Same tools and prices; pay with the x402 MCP transport.

## Docs

- OpenAPI: https://reader.scrapemole.workers.dev/openapi.json
- Terms: https://reader.scrapemole.workers.dev/terms
- Website: https://scrapemole.pages.dev

## Also from ScrapeMole

- ScrapeMole (YouTube search/channel/transcripts, Google Trends): https://scrapemole-api-mainnet.scrapemole.workers.dev
- ScrapeMole Amazon products: https://scrapemole-api.vercel.app
- ScrapeMole Domains (DNS, RDAP/WHOIS, availability, email security, SSL certificates, subdomains): https://domains.scrapemole.workers.dev
- ScrapeMole Onchain (Base/Ethereum prices, DEX prices, ENS/Basenames, gas, tokens, balances, transactions): https://onchain.scrapemole.workers.dev
- ScrapeMole Companies (SEC EDGAR: company profiles, financials, filings): https://companies.scrapemole.workers.dev
- ScrapeMole Wiki (Wikipedia summaries and search, Wikidata facts; CC BY-SA attributed): https://wiki.scrapemole.workers.dev
- ScrapeMole Pulse (ECB FX rates and conversion, time zones, weather forecasts, Hacker News): https://pulse.scrapemole.workers.dev
- ScrapeMole Pkgs (npm and PyPI package metadata, versions, search, download counts): https://pkgs.scrapemole.workers.dev
- ScrapeMole Arxiv (arXiv paper search, metadata, abstracts, category listings): https://arxiv.scrapemole.workers.dev
- ScrapeMole Social (Bluesky search/profiles/feeds, Hacker News search and threads, Lobsters): https://social.scrapemole.workers.dev