Evaluation method
How to Verify Numbers in an AI Financial Report
A readable explanation is not evidence that its numbers are correct. Review a financial report in four separate layers: the selected source, the calculation, the exported files and the interpretation. This method uses a public synthetic Braio pack; it is not an audit opinion or a claim about customer results.
Start with the exact source and period
Record the input filename, version, worksheet, selected range, period, currency and net/gross basis before accepting a result. A source-cell citation is useful only when it points to the version actually used. Keep the uploaded original and the generated revision separate.
A number typed into a prompt is a scenario input. Even if the arithmetic is correct, it has not become a verified invoice or bank balance. In the pack, the profile assumptions and source workbook are separate artifacts so this distinction can be checked.
- Open the source cells, not just a screenshot of their displayed values.
- Check whether an imported formula value is an unverified cached result.
- Ask for missing periods, unknown currency or ambiguous sign conventions before summing.
Recalculate a small independent control
For a cash forecast, verify opening cash + receipts - payments = closing cash for every week, and the next opening equals the previous closing. Compare totals over the full horizon as well as an individual week. This catches misplaced dates that a correct grand total can hide.
For a budget comparison, check actual minus budget using the same categories and basis. When budget is zero, a percentage variance is undefined; a model should show that limitation rather than invent a growth rate.
| Control | Evidence to retain | What it does not prove |
|---|---|---|
| Week equation | Opening, receipts, payments and closing from the same scenario | That a customer will pay on the assumed date |
| Source total | An independent control cell and the selected rows | That every business transaction was included |
| Export agreement | Canonical result and readback of XLSX/DOCX amounts | That narrative causes are supported |
Compare the result, workbook and document
Download cash-flow-results.json, cash-flow-13-weeks.xlsx and cash-flow-13-weeks.docx from the same pack. They describe one deterministic source-bound calculation. Compare the scenario labels, dates, currency and the reported money values. The manifest records the file checks and generation boundary.
A generic narrative document is not automatically a reconciled financial report. Braio’s dedicated report process uses a stored canonical analysis reference; retain that relationship when evaluating the deliverable. The generated forecast is a snapshot, not an arbitrary Excel engine.
Separate facts, assumptions and explanations
Mark each material statement as source-supported, calculated, assumed or unresolved. A fall in cash can follow mechanically from an assumed delayed receipt; the claim that a customer has become unreliable needs independent evidence. Ask the reviewer to reject unsupported causal language.
If required data or a control is absent, keep the result incomplete or blocked. Do not fill a blank with zero to make a report look finished. A human decides whether the known limits are acceptable for the intended management question.
Keep a short approval record
Retain the source version, approved profile version, checks, unresolved items and reviewer decision. Repeat the checks after a changed file, mapping or assumption. A previous successful export does not validate the next revision.
Use synthetic files for the first evaluation. Only upload company data after confirming workspace access, applicable data handling and the actual feature availability for your account. The method remains useful even when you choose a different tool.
Sources
Continue with your workflow
- Month-End Management Reporting Checklist
- Financial Data Quality Checks Before AI Analysis
- Financial Agent: Supported Files, Formulas and Refusal Limits
- 13-Week Cash Flow Template and Verifiable Example | Braio
- Braio help - first workflow, QA and SEO/GEO reports
- AI agent security - access, approvals and costs | Braio

