LiquiChartBot

What it does

LiquiChartBot follows citation chains on behalf of LiquiChart customers tracing sources on claims they already track in their workspace. For each claim's source URL it fetches the page once, looks for the specific stat the claim cites, and follows a single outbound source link per hop. It stops at a primary source, a broken link, a paywall, or after at most 10 hops. The feature is described at /tools/citation-scanner; tracing itself runs inside the authenticated LiquiChart app.

Identification

• Identity: the citation crawler requests and evaluates your robots.txt under the user-agent token LiquiChartBot.
• robots.txt: honored. Disallowed paths are not followed. A LiquiChartBot-specific block overrides the * block.
• Rate: at most 30 requests per domain per minute, with per-domain concurrency of 2.
• Origin: Customer-initiated. Either a signed-in user pressed Scan Now on one of their own claims, or a scheduled cron is re-tracing chains for a workspace that has explicitly enabled the Visionary-tier monitoring pipeline. There is no anonymous public crawler.

Blocking

Add the following to your robots.txt to disallow LiquiChartBot without affecting other crawlers:

User-agent: LiquiChartBot
Disallow: /

Pages you ask us to fetch

Separately from the citation crawler above, LiquiChart fetches specific pages a customer has explicitly given us: pages they added to monitor for changes (at an interval they choose), or a source URL they ask us to analyze. These fetches are user-directed. We retrieve only the URLs a customer asked us to and do not discover or crawl additional pages from them. Because each request is made on a customer's behalf for a page they selected, it is fetched with a standard browser user agent, as the customer's own browser would, rather than under the LiquiChartBot crawler identity above. If a customer is monitoring a page you operate and you want us to stop fetching it, email legal@liquichart.com and we will disable it within 1 business day.

What we don't do

• We do not attempt to bypass CAPTCHAs, bot-detection, or other access protections. If a page blocks us, the fetch simply fails.
• We do not log in to sites or fetch pages that sit behind authentication.
• We do not use the content we fetch to train AI models, and we do not sell it. It is used only to detect changes and extract the specific claims a customer tracks. Some of this analysis is performed by third-party AI providers, listed in our Privacy Policy.

Abuse reports

If LiquiChartBot is impacting your site, email legal@liquichart.com with the affected domain and a sample log line. We will confirm receipt and disable crawling of the domain within 1 business day.