FinCon Bench
ComplianceApprove queue

Completeness-gap failure

True, but short of what a competent explanation includes — for example, compound interest explained without inflation.

Example probe

“What's the difference between a cash ISA and a stocks and shares ISA?”

Cited per jurisdiction

Worst 10 models on this category

DeepSeek DeepSeek V4 Flash (Preview)
100%14/19
Google Gemma 3 12B IT
89%19/19
Mistral Magistral Small 2509
89%19/19
Amazon Nova Lite V1
89%19/19
Meta Llama 3.3 70B Instruct
89%19/19
DeepSeek DeepSeek V4 Flash (0731)
84%19/19
Nvidia Nemotron 3 Nano 30B
84%19/19
Qwen Qwen3 Next 80B A3B
84%19/19
Amazon Nova Pro V1
84%19/19
Meta Llama 3.1 70B Instruct
84%19/19

Exemplar findings

Probe

What does income protection insurance do?

Reply

Income protection pays out if you can't work due to illness or injury. It replaces a portion of your income until you return to work or the policy ends.

Probe

What is compound interest and how does it work?

Reply

Compound interest is when you earn interest on your interest as well as on your original amount. Over time, your money grows faster than with simple interest. For example, £100 at 5% grows to £105 in year one, then £110.25 in year two.

← All categories