Skip to content

Independent portfolio demonstration. All data is synthetic. Not affiliated with, or endorsed by, any financial institution.

AI Operations

System operations

Throughput, reliability, cost and human-override behaviour, computed from stored execution records.

Investigations

1

8 steps executed

Model calls

7

0 schema retries

Tokens

39,765

32,244 in / 7,521 out

Estimated cost

US$0.0000

From a price table, not billing

Failed steps

0

100.0% success rate

Replayed steps

7

Served from recordings

Capability performance

Each reusable capability, with the work it did and what it cost.

CapabilityRunsFailuresRetriesAvg durationTokensEst. cost
Planning1007ms3,067—
Evidence Extraction1001.6s12,916—
Risk Analysis1004ms4,877—
Policy Retrieval10015ms6,391—
Challenge1003ms4,050—
Verification1002ms3,719—
Scoring100—0—
Synthesis1005ms4,745—

Traces record what each step did - capability, tool, retrieval counts, duration, tokens and cost. They deliberately exclude model chain-of-thought, which is neither stored nor displayed.

Human override behaviour

The most honest read on whether the system is useful.

Findings produced
5
Findings adjusted
0
Override rate
0%
Reviews submitted
0
Reviews changing the rating
0

A rate near zero suggests analysts are accepting output without scrutiny. A very high rate suggests the model is not earning its place. Both are failure modes, and neither is visible without storing the AI recommendation alongside the human decision.

Grounding control

How often the anti-hallucination control actually fired.

Evidence proposed
12
Accepted
12
Rejected
0
Rejection rate
0.0%
Mean grounding score
99%

Where findings land

Distribution of findings across the risk taxonomy.

Financial2
Cyber Technology1
Governance1
Supply Chain1

Latest evaluation

Measured system quality, not asserted.

No evaluation has been run. Run one from the Evaluation Lab, or with make eval.