/api/v1/augment/scrape
Tools
Web Scrape
Scrape a web page and return its content as markdown. Supports most public web pages; some sites (e.g. X/Twitter, Reddit) that block automated access are rejected immediately.
Authentication: This endpoint accepts either a Bearer API key or a SIGN-IN-WITH-X header for x402 wallet-based authentication. The legacy X-Sign-In-With-X header is also accepted during migration. When using x402, a 402 Payment Required response indicates insufficient balance and includes top-up instructions.
POST
/api/v1/augment/scrape
Envía una URL accesible públicamente en el campo
url. La API devuelve el contenido de la página como markdown.
El scraper primero intenta usar el soporte nativo de markdown del sitio de destino (mediante Cloudflare Markdown for Agents) y, si no, recurre a una extracción con navegador headless. Algunos sitios que bloquean el acceso automatizado (p. ej. X/Twitter, Reddit) se rechazan inmediatamente con un error 400.
Precio: 0,01 $ por solicitud.
Ejemplo (cURL)
Autorizaciones
Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Cuerpo
application/json
The URL to scrape
Ejemplo:
"https://example.com"