← All insights
Wrong facts9 min readOwnlyReal Strategy Team

AI wrong information about a financial product: regulated risk

When AI misstates rates, cover, eligibility or medical claims: the risk for finance, insurance, healthcare and real estate brands, and the governance to manage it.

TESTWhich?, 40 consumer questions × 6 AI tools
ERRORWrong ISA allowance not corrected
SURFACESChatGPT · Copilot (Sept 2025)
RISKConsumer acts on a wrong financial fact
In short
  • AI tools regularly misstate rates, cover, eligibility and medical facts, and buyers in regulated categories act on those answers.
  • Regulators say their rules are technology-neutral: your own AI-assisted content and chatbots are held to the same standards as anything else you publish.
  • Manage it with an approved fact register, severity triage, compliance sign-off on source fixes and monthly re-testing.

When AI gives wrong information about a financial product, insurance policy, medicine or property, the risk is higher than a normal brand error because buyers act on it with money or health at stake. You cannot edit the AI answer, but regulators expect your own claims, pages and chatbots to be accurate whatever tool produced them. The response is governance: an approved fact register, severity triage, compliance sign-off on fixes, and regular re-testing.

This guide covers what the evidence shows, what regulators have said, and a governance model that fits regulated marketing. It is general information, not legal advice; involve your compliance and legal teams.

01How often do AI tools get regulated facts wrong?

Often enough to matter. In September 2025 the UK consumer group Which? put 40 questions on finance, legal, health and consumer rights to six AI tools. Scores ranged from 55% for Meta AI to 71% for Perplexity.[1] When a question contained a deliberately wrong ISA allowance of £25,000 instead of £20,000, ChatGPT and Copilot failed to correct it.[1]

Which? also found ChatGPT wrongly said travel insurance was mandatory for UK residents visiting Schengen states.[1] In health, a January 2026 Guardian investigation reported misleading AI Overview summaries on topics including liver blood test ranges, and Google then removed AI Overviews for some of those queries while saying the information was supported by high-quality sites.[2][3]

Which? scores for AI tools on 40 consumer questions (Sept 2025)
Perplexity
71 %
Gemini AI Overview
70 %
Gemini
69 %
Copilot
68 %
ChatGPT
64 %
Meta AI
55 %
Expert-rated accuracy, relevance, clarity, usefulness and ethical responsibility.[1]

Buyers trust these answers. Which? reported that 47% of UK adults who use AI for web searches trust the results to a great or reasonable extent, rising to 65% among frequent users.[1]

02Why is wrong AI information riskier in regulated industries?

Because the facts AI gets wrong are the ones regulators care most about. Rates, fees, cover limits, eligibility, side effects, permits and handover dates are both what buyers ask AI and what rules govern.

01Financial servicesAPRs, fees, ISA or tax limits, eligibility and risk warnings. A wrong figure can push a customer into an unsuitable product.
02InsuranceWhat is covered, exclusions, excess amounts and whether cover is mandatory. Errors surface at claim time.
03Healthcare and pharmaIndications, dosing, ranges and contraindications. Errors can delay care or encourage misuse.
04Real estatePrices, payment plans, handover dates, permits and residency claims. Buyers commit large sums on them.

03What have regulators said about AI and marketing claims?

No regulator we found makes a brand liable for what a third-party AI engine independently says. But they are consistent on two points: existing rules apply to content produced with AI, and firms answer for their own claims and channels.

RegulatorGuidanceWhat it means for marketing
FINRA (US)Regulatory Notice 24-09, June 2024: Rule 2210 content standards apply whether communications are generated by a human or a technology tool[4]AI-drafted content and chatbot replies need the same review as any communication
SEC (US)March 2024 "AI washing" actions against two advisers, $400,000 in combined penalties[5]Claims about your own use of AI must be accurate
FTC (US)Operation AI Comply, September 2024: "no AI exemption from the laws on the books"[6]Deceptive claims made with or about AI are treated like any other
FCA (UK)FG24/1, March 2024: promotions on all channels must be fair, clear and not misleading; firms are responsible for promotions they approve[7]Content you seed or approve on social and third-party channels is in scope

Courts have applied the same logic to company-run chatbots. In Moffatt v. Air Canada (February 2024), a British Columbia tribunal held the airline responsible for a refund policy its website chatbot invented, rejecting the argument that the chatbot was a separate entity.[8] If AI sits on your website or app, its answers are your answers.

Where your responsibility starts

Third-party AI engines summarize the web, including your own pages, PDFs and partner content. You control those sources and your own AI tools. That is where governance, evidence and fixes belong.

04Where do wrong AI answers about regulated products come from?

Trace before you fix. In regulated sectors, the cause is often an old document the firm itself published: a superseded rate sheet, a past policy wording PDF, a product page for a closed product, or a press release with last year's figures.

Other common sources include comparison sites and aggregators with stale data, broker or agent pages that paraphrase terms loosely, community threads, and same-name companies. Our correction workflow covers tracing in detail; in regulated sectors, record every trace step, because compliance may need to show what you knew and when.

05How do we make our own sources harder to misread?

Much of the fix is publishing discipline. State regulated facts in plain text on a canonical page, with the effective date and the conditions next to the figure, rather than only in a PDF, an image or a table without context. A summary model can easily lift "from 4.9%" without the qualifying sentence that follows it.

Keep one current version of each document. When rates or policy wordings change, update the canonical page, redirect or remove the old URL, and do not leave superseded PDFs indexed. Archive what compliance needs to keep in a location search engines cannot reach.

Finally, align partners. Brokers, agents, aggregators and distributors often republish your terms. Give them a single source to link to, and include accuracy of AI-visible content in partner reviews. A wrong figure on a high-authority partner site can outweigh your own page.

06What governance should a regulated brand put in place?

Start from your existing financial-promotions or medical-review process, and extend it to AI answers rather than creating a parallel one. Our guide to AI visibility governance covers roles in general; these steps add the regulated layer.

  1. 1
    Build an approved fact registerFoundation
    One owner-maintained list of regulated facts per product and market: rates, fees, limits, eligibility, warnings, with effective dates and approver.
  2. 2
    Test the questions buyers askMonthly
    Run prompts about each product across major AI engines and markets on a fixed cadence. Log answers against the register.
  3. 3
    Triage by severityWithin 24 hours
    Severity 1: wrong rate, cover, eligibility, safety or legal status. Severity 2: outdated but not harmful. Severity 3: tone or framing.
  4. 4
    Fix sources with sign-offPer issue
    Corrections to pages, PDFs and partner content go through compliance review like any promotion. Retire superseded documents.
  5. 5
    Prepare customer-facing linesSeverity 1
    Give service teams an approved response when customers cite a wrong AI answer, pointing to the official source.
  6. 6
    Keep the evidenceAlways
    Store screenshots, prompts, dates, sources traced, fixes shipped and re-test results in one log.
Do not fight wrong answers with unapproved content

A fast blog post or social reply "correcting" an AI error is itself a financial promotion or health claim in many jurisdictions. Route it through the same approval as any other content, even when it feels urgent.

07How should we handle a severity 1 error?

Treat it as an incident. Notify compliance and legal, capture evidence before anything changes, and check whether customers have acted on the wrong information through complaints, call notes or chat logs. Fix your own sources first, then file feedback with the platform and ask third parties to correct theirs; each platform's channel is covered in our guide to reporting incorrect information to AI platforms.

Illustrative example

A lender finds Gemini and ChatGPT quoting a personal-loan APR from 18 months ago. The trace leads to an indexed rate-sheet PDF and two comparison sites. Compliance approves an updated product page, the PDF is removed, the comparison sites are asked to update, and the prompts are re-tested weekly until both engines show the current rate.

After the fix, keep the incident open until re-tests across engines and markets show the corrected fact, then record the closing date. The time from detection to corrected answer is a useful measure to report to the risk committee.

08Does this apply to our own AI chatbot too?

Yes, and more directly. The Air Canada ruling and FINRA's notice both point the same way: your own AI assistant is a channel you answer for.[4][8] Ground it on the approved fact register, restrict it from generating rates or eligibility not in that register, log conversations, and include it in the same monthly test.

09Who should own AI accuracy in a regulated company?

Marketing usually sees the problem first, compliance owns the rules, and product owns the facts. One accountable owner must connect them, with a standing route into the approval chain. OwnlyReal works as that kind of embedded team: measuring what AI says across engines and markets, fixing sources at the root, and shipping changes through draft, brand, legal and regional sign-off, as described for enterprise teams.

Regulated AI accuracy checklist
Approved fact register per product and market, with owners and dates.
Monthly multi-engine test against the register.
Severity levels agreed with compliance.
Superseded rate sheets, policy wordings and PDFs retired.
Corrections routed through the normal promotions approval.
Service teams have an approved response for AI-cited errors.
Own chatbot grounded on the register and included in testing.
Evidence log retained for audit.
If AI answers misstate your rates, cover or claims, OwnlyReal can run testing, tracing and compliant fixes inside your approval chain.Book a call →

Questions people also ask

Is my company liable for what ChatGPT says about our financial products?

This depends on jurisdiction and facts; ask your legal team. Regulators focus on your own communications and channels, so make sure your published sources and chatbots are accurate.

Do financial promotion rules apply to AI-generated content?

Yes, in the cases we reviewed. FINRA says Rule 2210 standards apply whether communications are generated by a human or a technology tool, and the FCA expects promotions on all channels to be fair, clear and not misleading.

What should we do when AI gives a wrong interest rate for our product?

Treat it as a high-severity issue: capture evidence, trace the source, fix and retire outdated pages with compliance sign-off, report to the platform and re-test until it changes.

Are companies responsible for their own chatbot's answers?

In Moffatt v. Air Canada, a Canadian tribunal held the airline responsible for wrong information its website chatbot gave. Treat your own AI assistant as an official channel.

How often should regulated brands test AI answers?

Monthly for priority products and markets, and after rate changes, product launches or withdrawals. Re-test weekly while a severity 1 error is being fixed.

Want this checked for your brand, across markets and languages?
Book a call →

Own every answer.

Talk to our team about how OwnlyReal plugs into your marketing organization.

Book a call