User-agent: * # Public auth + thin utility pages (connect/login, register, forgot-password, # plus the legal / codes / contact / donate / mediakit pages) are kept OUT of # search via a per-page set in their # controllers — NOT via a crawl block. Googlebot must stay free to crawl them # to actually read that tag; a Disallow here would hide it and leave the URLs # lingering as bare links. Only crawler-traps and token action URLs are blocked. Disallow: /*/verify-email/* # Links from listings and campaigns (?ref=…, ?utm_…) stay crawlable so Google can follow them # to the page's canonical URL. The longest matching rule wins, so these beat the Disallow below # only when the query string starts with ref= or utm_; every other query string stays blocked. Allow: /*?ref= Allow: /*?utm_ # Dont ever remove this disallow Disallow: /*?* Sitemap: https://bitculator.com/sitemap/sitemap.xml Sitemap: https://bitculator.com/sitemap/base.xml