All projects matching “fetch”

Retrieve a public HTTPS URL from the US, Germany, Japan, Brazil, or India. Use HTTP mode for lightweight retrieval, or browser mode to render JavaScript pages. For pages with bot protection, set max_tier to L2 for managed unblocking at $0.05 USDC; L0/L1 costs $0.02 USDC. Returns the fetched body and an Ed25519-signed receipt for provenance.

Ysaere Agent Page Extract — $0.02 USDC, no account needed. Input: {"url":"https://ysaere.com","max_chars"?:12000}. Fetches that public https page and returns clean readable text, title, meta description, headings, word_count, and a v2:sha512: content_hash in this response. Failed fetches refused before payment. Wallet only. No account price.

Public sources for agent research: one You.com search plus fetch of up to three public HTTPS pages. Returns structured JSON with page text, metadata, source URLs, fetch timestamps and content hashes for source checking and company research. 0.01 USDC on Base per call via x402 v2; no signup. No browser rendering or synthesized answer. Generate a private request_id locally and reuse it on pending re

Use when a page will not read correctly with a plain fetch — a single-page app, content loaded by JavaScript, or markup so noisy the text is buried. Fetches it with a headless browser (rendering JavaScript) and returns the main readable content as clean Markdown — ideal to feed an LLM as context. JSON body { url } (public http/https), optional include_images (default false). Returns title, final_u

Fetch one URL from a residential IP and get the raw response as JSON: status, final URL, headers and body (text or base64), up to 10 MB. GET, HEAD or POST, your own headers, an optional country. No JavaScript rendering. You pay for the megabytes delivered; a fetch that fails is not charged. Pay per call in stablecoins.

Use before spending tokens, money or crawler capacity fetching an unfamiliar web resource. Resolves redirects (manually, bounded, re-validated per hop) and returns deterministic HTTP/resource facts — final URL, status, content type and length, response time, a bounded HTML title/canonical peek, and a lightweight generic-bot robots.txt indication — so an agent can decide whether a normal web fetch

Check a URL before fetching it: is it alive, final URL after redirects, HTTP status, content type, HTML title, and whether robots.txt allows your user-agent. Link checker and fetch preflight for agents.

Geo web fetch for AI agents. Fetch any public web page from a residential IP in a chosen country (190+ countries, optional city or US state) as clean markdown, text or HTML, with the product price/currency/availability extracted automatically when the page has product data. $0.005 per page, only charged when the page loads. Respects robots.txt; no CAPTCHA solving; sign-in, payment and email servic

Fetch one public static HTML page after robots and public-address checks, then return bounded readable text, title, final URL and source links. Standard x402: POST the URL, sign the 402 and resend the same body. The 402 also returns an encrypted payment_request that pays for exactly the quoted fetch. No browser, login, summary or full-site crawl.

Web page scrape: one URL fetched and rendered by Firecrawl (headless browser), returned as markdown, html, rawHtml and/or links. Not charged when the page cannot be fetched.

Convert HTML to tidy markdown ($0.005 USDC via x402). Pass html (string) and/or url (public https to fetch). At least one required; if both, prefers html and warns. URL fetches use the same allowlist as WELL-002 (https only — http/file/data/localhost/private IPs rejected; 1 MB body, ~10s timeout, max 5 redirects). Returns JSON { source, url?, final_url?, content_type?, markdown, warnings }.

Headless browser rendering for JavaScript-heavy pages and SPAs: full stealth Chromium render, then clean markdown plus title, meta description, and canonical URL. Use when a plain fetch returns an empty shell or a bot wall.

Scrape website page to Markdown. Fetch any public web page URL and get clean, LLM-ready text or Markdown: main content, code blocks, tables, links and headings, for RAG and agent context. Static HTML, Markdown or text; optional section ID. Default 20,000 output characters, max 100,000; input 2 MiB. No JavaScript rendering (see /extract/rendered), logins or paywalls. Empty pages, bad sections, brow

Fetch any public web page and return its main readable content as clean Markdown or plain text plus metadata (title), stripping nav/ads/boilerplate (trafilatura). Optional JS rendering via headless browser for SPAs; markdown or text output. Robots-respecting, public content only — the reader/scraper building block for RAG and agent pipelines.

You.com Search API: real-time web search returning ranked results grouped by section (results.web, results.news), each with url, title and description; web results also carry snippets. Use when an agent needs fresh, citable web data (news, markets, company facts) to ground a decision. Query params: query (required), count 1-100 (default 10), livecrawl (web|news|all; fetches live page contents, cha

Fetch a page and return content, headers, and metadata. $0.01 per request.

Read the main content of a page your own crawler cannot reach, as clean markdown. Send a URL and receive the main content of the page as clean markdown, stripped of navigation, advertising and boilerplate. The page is fetched through a French residential IP with a real Chromium browser, so JavaScript-rendered content is fully resol…

Web page to markdown (read URL as clean text) for LLM agents: main content only (no nav, cookie banners, ads), with title, description, author, dates, language, headings, internal/external links and JSON-LD types, PLUS a prompt-injection scan of the page (visible text, hidden HTML, comments, invisible Unicode) so your agent knows whether the content tries to give it orders. Fetched from Cloudflare

Cheap robots.txt preflight check before you call the Minifetch /extract and /run/seo-page-audit endpoints: returns whether Minifetch may fetch a target URL (allow/deny) plus its crawl-delay. If blocked and the site is not yours try our external proxy routes. If blocked and the site is yours or to set a custom crawl-delay read https://minifetch.com/tutorials/unblock-minifetch Checks the URL as give

Publisher discovery repair plan fetches current public evidence from the supplied target and evaluates the documented criterion. It returns the observation, threshold, verdict, exact evidence source, limitations and a mode-specific action. The check is passive: no login attempt, payload injection, exploit, purchase, form submission or load test is performed.

Unblocker for AI agents: send {url} and get the page back as clean Markdown, with title, description, language, final URL and HTTP status. Gets through Cloudflare and other common bot protection and can render JavaScript-heavy pages. Set format to html or text for those instead. A page that can't be fetched (blocked, error status or empty) is not charged. No API key, proxy or account: pay per call

Returns the page's readable text plus an Ed25519-signed record (final URL after redirects, fetch time, status, sha256 of the body and of the text) that verifies offline. Charged only for 2xx text pages; refused URLs cost nothing.

What changed since your last read: one page of PreReason's change events after a cursor. A briefing's state label, a tracked release, and, for the companies you name (?companies=, at most 200), newer figures, a situation turning on or filed news (?kinds= narrows it). Each event says what changed, when it happened, when PreReason knew it and where to fetch it, never a value. With no cursor it answe

Fetch a web page and return clean Markdown with Litmus intelligence. Requires payment of $0.005 USDC per page.

Fetch a public web page and return just the main article as clean Markdown, with title, byline and excerpt. Menus, ads and footers are removed. Use when you need to read, summarise or quote a web page cheaply without parsing HTML yourself. Returns JSON {title, byline, siteName, excerpt, markdown}. Errors: 400 bad or private URL, 422 no readable article, 502 site returned an error.

Headless scraper proxy for AI agents at $0.01 per accepted scrape. Fetch a public HTTPS URL and return clean LLM-ready Markdown. Agent-safety guarantee: output is validated as clean text before serving; binary or garbled content is rejected with no charge.

Search the web and read the top pages in ONE call: 10 results (title, url, snippet, date) plus the clean text of the best pages, with fetch time and sha256. French and Canada by default when the query is French; official-sources mode (governments, registries, courts, laws); freshness filter; site: restriction. No results = HTTP 404 = you are not charged. Input: query, optional read (0-5), official

Headless scraper proxy for AI agents at $0.01 per accepted scrape. Fetch a public HTTPS URL and return clean LLM-ready Markdown. Agent-safety guarantee: output is validated as clean text before serving; binary or garbled content is rejected with no charge.

Look up a product barcode number: identify and validate EAN-13, EAN-8, UPC-A, UPC-E, GTIN-14, ISBN-13/10, ISSN and ISMN codes (wrong check digits are reported with the correct digit), convert between forms (GTIN-14, EAN-13, UPC-A, ISBN-10 <-> 13) and decode the GS1 prefix. Then fetch product data from open databases: name, brand, quantity, categories, image, labels, Nutri-Score (food, cosmetics, p

Fetch a YouTube transcript from a video URL or 11-char id (video_id, also accepted as ref or url); returns a presigned download URL to the transcript