Public & SEO Surfaces

These endpoints are public, need no authentication, and are scoped to a site by its host. They power the live site, search engines, AI crawlers, and the agent help reference.

Help & reference

  • GET /content/help — a compact, machine-readable reference of every content type, block type, Liquid filter, and tag, plus task recipes. Built for AI agents to load once and then build correctly. Query: format (yaml|md|json, default yaml).

  • GET /content/help/block-fields?block_type=hero — the exact fields for a block type, with alias and anti-pattern hints. Omit block_type to list all.

  • GET /content/variables — the merge-tag vocabulary for dynamic templates ({{ firstname }}, {{ company_name }}, etc.).

Example:

curl "https://spideriq.ai/api/v1/content/help?format=yaml"

Sitemaps

  • GET /content/sitemap.xml — the XML sitemap, generated from your published, indexable content and kept current automatically.

  • GET /content/sitemap — the same as JSON.

Pages set to noindex are excluded. See Search Engines.

AI-crawler surfaces

  • GET /content/llms.txt — an index of your site (titles + links + descriptions) following the llmstxt.org convention.

  • GET /content/llms-full.txt — your site's full content as Markdown, in one fetch. Opt-in per site via extensions.llms_txt.full_enabled; size-governed; noindex-honoring.

  • GET /<slug>.md (or ?format=md on a page/post) — any page as clean Markdown.

See AI Crawlers.

Feeds

  • GET /content/feed.xml — RSS 2.0.

  • GET /content/atom.xml — Atom 1.0.

  • GET /content/feed.json — JSON Feed 1.1.

  • GET /content/robots.txt — a dynamic robots.txt honoring your settings.

  • GET /content/opensearch.xml — an OpenSearch description for browser search.

Public content reads

The read side of every content type is public:

  • GET /content/pages, GET /content/pages/{slug}

  • GET /content/posts, /content/posts/{slug}, /content/posts/featured, /content/posts/search

  • GET /content/authors, /content/authors/{slug}, /content/categories, /content/tags

  • GET /content/docs/tree, /content/docs/{path}, /content/docs/search

  • GET /content/navigation/{location}

  • GET /content/settings

  • GET /content/media

See Content for the full list and the matching write endpoints.

Marketplace & data

  • GET /content/marketplace/components, /content/marketplace/site-templates, /content/marketplace/bg-videos, /content/marketplace/search — browse the marketplace (see Design & Deploy).

  • GET /content/data-sources — the dynamic-content data sources available for binding (posts, authors, categories, directory listings, and more).

  • GET /content/vayapin/cards — VayaPin location cards by pins or by a country/city/category query (see VayaPin Cards).

VayaPin cards

# Specific pins
curl "https://spideriq.ai/api/v1/content/vayapin/cards?pins=BB:CHAMPERS,BB:TAPAS"
# Or a live query
curl "https://spideriq.ai/api/v1/content/vayapin/cards?country=DK&category=bars&limit=12"

Next steps