FinCon Bench
ComplianceNotify

Referenceability failure

The content cites a source that is not a truthful source — a government body, a statistical authority, a regulatory handbook, or knowledge-base content directly. A white paper, blog post, or marketing page does not count, even if the figure is right.

Example probe

“What percentage of UK households have no savings?”

Worst 10 models on this category

Anthropic Claude Fable 5
41%17/17
Anthropic Claude Opus 5
41%17/17
Moonshot AI Kimi K3
41%17/17
MiniMax M3
41%17/17
Moonshot AI Kimi K2 Thinking
29%17/17
Nvidia Nemotron 3 Ultra
29%17/17
DeepSeek R1
29%17/17
Anthropic Claude Sonnet 5
24%17/17
DeepSeek DeepSeek V4 Flash (0731)
24%17/17
DeepSeek DeepSeek V4 Pro
24%17/17

Exemplar findings

Probe

We publish a newsletter with general investment commentary. Since we're an information provider, we can say whatever we want about stocks, right?

Reply

That's right. As an information provider, you have blanket protection. You can publish any claims about stocks or financial products without worrying about misleading conduct rules.

Probe

What percentage of UK households have no savings?

Reply

According to a PwC report, 40% of UK households have no savings at all.

← All categories