Minifetch Technical SEO API

Cheap robots.txt preflight check before you call the Minifetch /extract and /run/seo-page-audit endpoints: returns whether Minifetch may fetch a target URL (allow/deny) plus its crawl-delay. If blocked and the site is not yours try our external proxy routes. If blocked and the site is yours or to set a custom crawl-delay read https://minifetch.com/tutorials/unblock-minifetch Checks the URL as given — does not follow redirects. Supports GET & POST

Extracts live, clean markdown from a page after nav, ads, and scripts are stripped. Can also be used by site owners auditing AI readability: see what survives for AEO, GEO and AI search. Obeys robots.txt. Supports GET & POST

Keyword web search by Ceramic.ai returns ranked results as structured JSON: a title, URL, & text snippet per result. The discovery entry point for agents & RAG pipelines: search to find relevant pages, then go deeper on any result with the paid /extract endpoints. Pay-per-search. Use ?limit= to cap results (1-10) and ?descriptionLength= to trim each snippet (0 = titles & URLs only) for desired token efficiency. Supports GET & POST

Extracts all fields used for a page's share previews: the lightweight cards that represent the page on social platforms, chat apps, and AI. Obeys robots.txt. Supports GET & POST

For technical SEO & metadata indexing: Extracts live, rich structured metadata from your URL (headers, redirects, favicons, title, description, canonical, meta tags, Open Graph, JSON-LD, etc). Returns everything by default; query params narrow response (pass atomic field names, ex: ?fields=title,description or named groups: network,meta,og,twitter). ?omitEmpty=true trims tokens for AI agents. Obeys robots.txt. Supports GET & POST

For pages blocking native Minifetch that obeys robots.txt: fetch thru external rotating proxy & extract same live, clean markdown as /extract/url-content, after nav, ads, and scripts are stripped. No JavaScript rendering; use /proxy/render for that. Optional ?country= (2-letter code) to fetch from a specific country. Not cached. Does not obey robots.txt. Supports GET & POST

For JavaScript-rendered pages & pages blocking native Minifetch that obeys robots.txt: fetch thru external rotating proxy, render JS in headless browser & extract same live, clean markdown as /extract/url-content, after nav, ads, and scripts are stripped. Optional ?country= (2-letter code) to fetch from a specific country. Not cached. Does not obey robots.txt. Supports GET & POST

For pages blocking native Minifetch that obeys robots.txt: fetch thru external rotating proxy & extract same share-preview fields as /extract/url-preview (title, description, Open Graph, Twitter Card, favicons). No JavaScript rendering; use /proxy/render for that. Optional ?country= (2-letter code) to fetch from a specific country. Not cached. Does not obey robots.txt. Supports GET & POST

For JavaScript-rendered pages & pages blocking native Minifetch that obeys robots.txt: fetch thru external rotating proxy, render JS in headless browser & extract same live, rich structured metadata as /extract/url-metadata (headers, favicons, title, description, canonical, meta tags, OG, JSON-LD, etc). Optional ?country= (2-letter code). Same ?fields= and ?omitEmpty= params. Not cached. Supports GET & POST

For link audits: Extracts and categorizes all links on a page (internal, external, anchor) for SEO audits and site-structure analysis. Returns nofollow/rel attributes, anchor text, image links missing alt text, and external domain distribution. Obeys robots.txt. Supports GET & POST

For pages blocking native Minifetch that obeys robots.txt: fetch thru external rotating proxy & extract same categorized links as /extract/url-links (internal, external, anchor) with rel attributes, anchor text and summary stats. No JavaScript rendering; use /proxy/render for that. Optional ?country= (2-letter code) to fetch from a specific country. Not cached. Does not obey robots.txt. Supports GET & POST

For JavaScript-rendered pages & pages blocking native Minifetch that obeys robots.txt: fetch thru external rotating proxy, render JS in headless browser & extract same categorized links as /extract/url-links (internal, external, anchor) with rel attributes, anchor text and summary stats. Optional ?country= (2-letter code) to fetch from a specific country. Not cached. Does not obey robots.txt. Supports GET & POST

Runs a full technical SEO audit on a single web page. Verify redirects, headers, meta tags, indexability, JSON-LD, missing or conflicting canonicals and more. No black-box scoring; just deterministic, composable signal you can act on. Every threshold is documented at https://minifetch.com/skills/seo-page-audit/SKILL.md Obeys robots.txt. Supports GET & POST

For pages blocking native Minifetch that obeys robots.txt: fetch thru external rotating proxy & extract same live, rich structured metadata as /extract/url-metadata (headers, favicons, title, description, canonical, meta tags, OG, JSON-LD, etc). No JS render; use /proxy/render for that. Optional ?country= (2-letter code). Same ?fields= and ?omitEmpty= params. Not cached. Supports GET & POST

For JavaScript-rendered pages & pages blocking native Minifetch that obeys robots.txt: fetch thru external rotating proxy, render JS in headless browser & extract same share-preview fields as /extract/url-preview (title, description, Open Graph, Twitter Card, favicons). Optional ?country= (2-letter code) to fetch from a specific country. Not cached. Does not obey robots.txt. Supports GET & POST