AI news, problem solutions & tool picks
DigestX

Problem Solutions

ChatGPT made up my work numbers — and now my boss wants the workings

· 3 min read

Photo via Pexels

A market researcher used ChatGPT to analyse survey data for a client presentation. When her boss asked her to explain the calculations, she couldn't — the numbers were hallucinations. The story, posted on r/ChatGPT and shared widely on November 19, has drawn more than 2,300 replies, and it is the clearest version yet of a problem every workplace using AI will meet: the model hands you confident numbers, and nobody checks them until someone asks how they were made.

What happened

The post is titled, exactly, "URGENT - my girlfriend used chatGPT for her work. Now her boss wants her to explain the calculations. I think the calculations were a hallucination. What to do?" The poster's girlfriend works in market research. She used ChatGPT to analyse survey data and build Excel spreadsheets, which went into a presentation for a client. The outputs were fabricated. She did not check or understand them, and could not explain them when her boss asked. As Thomas Lancaster, who shared the thread on November 19, puts it, qualitative data appears to have been processed as if it were numeric, "in a way that anyone with even a basic knowledge of statistics would realise was wrong."

One detail matters for honesty: this is the discussion going around on November 19. The thread's own original posting date could not be verified, and no name, employer or client is given anywhere — none is invented here.

Why it happens

This is not a one-off glitch. In "Why Language Models Hallucinate", published in September 2025, OpenAI researchers argue that training and evaluation reward guessing over acknowledging uncertainty. On the SimpleQA benchmark, a model that abstained 52% of the time was wrong on 26% of questions; a model that almost never abstained — 1% of the time — was wrong on 75%. A model that guesses gives you an answer; a model that admits it doesn't know gives you a gap. The training rewards the answer.

Lancaster's own point is blunter: tools like ChatGPT "are not intelligent and they can't replace foundational knowledge" — and ChatGPT 5 "hides away so many of the underlying models and pipelines and removes user control", so the user never sees where the numbers came from. He also asks whether the researcher even had permission to upload the dataset to a generative AI tool — a question worth asking before the analysis starts, not after the presentation.

How to catch it before it reaches a client

First, constrain the model to your source only. Tell it "using only the figures in the attached report" and to mark anything the report does not cover as "Not in source". Second, make every number traceable: a percentage or currency figure you cannot trace back to a line in your own data is the top failure mode. Third, ask for the workings in the same prompt — methodology, formulas, and which rows or cells each number came from — so the analysis is replicable. Lancaster had ChatGPT 5 rebuild a replicable methodology from the thread's top comments; it worked, but was "more complex than necessary and only lightly checked". The workings are the point, not the tool.

Fourth, recompute the totals and percentages yourself in Excel and check they add up. Totals that don't add up, presented without hesitation, are a classic tell. Fifth, spot-check a sample against the raw data before presenting anything. Lancaster's rule: "everything needs to be carefully checked." Sixth, use search-grounded tools that cite sources — and open the citations. OpenAI itself says search results and citations can be incomplete, outdated, or incorrect. A citation is a pointer to check, not proof.

If the numbers already went out

Be honest and correct promptly — that is the whole framing of Lancaster's post, "Be Honest or Cover It Up?" Own the error, tell the boss and the client, redo the analysis properly and show the corrected workings. Some Reddit users in the thread encouraged lying. That advice is not worth following: a correction you make yourself is a mistake; one your client finds is a credibility problem.