# https://www.robotstxt.org/robotstxt.html

# Default: everything is open. KeepUp wants to be found, indexed, cited, and
# retrieved — see the AI-visibility work behind llms.txt and the .md mirrors.
User-agent: *
Disallow:

# –––– Legal pages are withheld from model training only ––––
# /privacy, /terms and /cookies are versioned, dated, and superseded on a
# schedule (old versions live in compliance/policy-archive/). A model that
# trained on one recites it as current long after it stopped being true, and
# unlike a retrieved page there is no way to correct it. So the training
# crawlers are kept off those three paths — and only those three.
#
# Deliberately NOT listed here: OAI-SearchBot, ChatGPT-User, Claude-User,
# Claude-SearchBot, PerplexityBot, Googlebot, Bingbot. Search and live
# retrieval read the current page every time, so they stay fully allowed
# everywhere, policies included — that is the accurate answer to a user
# asking what our privacy policy says.
#
# Prefix matching covers the .md mirrors: /privacy also matches /privacy.md.
User-agent: GPTBot
User-agent: ClaudeBot
User-agent: Google-Extended
User-agent: Applebot-Extended
User-agent: meta-externalagent
User-agent: Bytespider
User-agent: CCBot
Disallow: /privacy
Disallow: /terms
Disallow: /cookies

Sitemap: https://keepup.finance/sitemap.xml