For AI agents and crawlers

Machine-readable terms

This section is generated from the site's own configuration, so it always matches robots.txt and the live endpoints.

Formats and negotiation

• Markdown twins. Drop the trailing slash from an article or page address and add .md (/{slug}.md); a section is /category/{slug}.md, the home page /index.md and the last 24 hours /today.md. Every HTML page names its twin in a Link header and in a <link rel="alternate" type="text/markdown"> tag.
• Accept header. Accept: text/markdown on an HTML address is answered at our origin with a 302 to its twin. A copy of the HTML page already cached at the CDN can answer first, so fetch the .md address itself when you want markdown.
• What an article twin carries, in order: title; dateline (UTC, ISO 8601), section and byline; the Corroboration line; the brief; the Indian Opinion Analysis; the Coverage list, one line per source with outlet, stance label, source URL and a one-line note; Tags; Canonical; License; Cite, the citation anchor; and on a restored archive article a Review state line.
• Caching. Twins send an ETag and answer 304 to a matching If-None-Match; they are cached publicly for 30 minutes.
• Plain-text corpus. /llms.txt is the map. /llms-full.txt is an index of the recent day files plus the last two days of briefs inline. /llms-full/YYYY-MM-DD.txt carries every brief of one UTC day; a day with more than 600 briefs is split into parts at ?part=2 and on.

Stance vocabulary

A stance label describes how one outlet framed one story, never the outlet in general: the same outlet can be pro-government on one story and government-critical on the next. Labels are shown only where at least two independent outlets carried the story. The JSON carries the slug; pages and twins print it with a space for the hyphen.

• pro-government: the framing favours the government or the official account.
• government-critical: the framing foregrounds failure, blame or opposition criticism of the government.
• left-leaning: the framing carries a left-of-centre slant on this issue.
• right-leaning: the framing carries a right-of-centre slant on this issue.
• neutral-report: straight news-agency style reporting with no discernible slant.
• sensationalist: drama first: outrage, shock, spectacle or speculation ahead of substance.
• opinion: the item is an opinion or commentary piece rather than a news report.

JSON endpoints

• GET https://indianopinion.org/wp-json/io/v1/briefs?since={ISO 8601}&limit={1-100}&min_importance={outlets}: recent articles, newest first, as {count, items}. Without since it returns the latest; limit defaults to 20 and is capped at 100.
• GET https://indianopinion.org/wp-json/io/v1/brief/{id}: one article; 404 for anything that is not a published article. Every article page names its own in a <link rel="alternate" type="application/json"> tag.
• Fields of every record: id, url, title, brief, opinion, analysis, published, modified, language, section, keywords, corroboration, sources, stances, image, word_count, generated_by, human_reviewed, license, citation_anchor, md, index_state. sources is a list of {url, outlet}; stances a list of {outlet, stance, note}; corroboration the number of independent outlets; index_state is index, or noindex-search for a restored archive article that is kept out of search engine indexes but stays readable and citable here.
• Responses are cached publicly for an hour.

Crawl terms

These are the rules robots.txt serves, read from the same code. Every group carries the same rules.

• Usage grant: Content-Signal: search=yes, ai-input=yes, ai-train=yes
• Usage grant: Content-Usage: train-ai=y, ai-use=y, search=y
• Named and welcome, under exactly the same rules as every other crawler: GPTBot, ChatGPT-User, OAI-SearchBot, ClaudeBot, Claude-SearchBot, Claude-User, anthropic-ai, PerplexityBot, Perplexity-User, Google-Extended, Applebot, Applebot-Extended, Amazonbot, Meta-ExternalAgent, Meta-ExternalFetcher, DuckAssistBot, cohere-ai, MistralAI-User, YouBot, Googlebot, bingbot, DuckDuckBot, GoogleOther, Google-CloudVertexBot, Amzn-SearchBot, Amzn-User, meta-webindexer, FacebookBot, Claude-Web, cohere-training-data-crawler, MistralAI-Index, MistralAI-Training, Timpibot, omgili, omgilibot, Webzio-Extended, Diffbot, AI2Bot, Ai2Bot-Dolma, PetalBot, PanguBot, Bravebot, kagi-fetcher, PhindBot, Andibot, ExaBot, LinkupBot, DeepSeekBot, QwenBot, KimiBot, YandexAdditional, iaskspider.
• Welcome with a Crawl-delay, because they send no referral traffic and this is a small origin: CCBot 10 seconds, Bytespider 30 seconds.
• Path rules, in every group:
  • Disallow: /wp-admin/
  • Allow: /wp-admin/admin-ajax.php
  • Disallow: /wp-json/
  • Disallow: /login/
  • Disallow: /register/
  • Disallow: /account/
  • Disallow: /user/
  • Disallow: /members/
  • Disallow: /logout/
  • Disallow: /password-reset/
  • Disallow: /*?s=
  • Disallow: /search/
  • Disallow: /*?preview=
  • Disallow: /tag/src-rss/
  • Disallow: /tag/src-newsomatic/
  • Disallow: /hi/
  • Disallow: /te/
  • Disallow: /ta/
  • Disallow: /bn/
  • Disallow: /mr/
  • Disallow: /kn/
  • Disallow: /ml/
  • Disallow: /gu/
  • Allow: /wp-json/io/v1/
  • Allow: /llms-full/
  • Allow: /
• One Sitemap: https://indianopinion.org/sitemap.xml line; its children are listed in llms.txt.
• Usage terms: /.well-known/ai.txt. Attribution with a link to the article is asked for; the facts belong to the outlets credited with each brief.