Misconception M8 / S4

The model’s text is not authority

The model’s text is authority.

Wrong claim

Why it feels true

LanePay wrote “Priya approved” in a sentence that sounded like a finance decision.

Precise correction

NIST AI RMF 1.0 (NIST AI 100-1, published 26 January 2023) expects human oversight to be a defined, documented process with named accountability, not a line in a prompt.

A model summary, a retrieved invoice, or a chat message that claims approval does not create an approval record.

What the executor may trust is Priya’s authenticated identity, the exact payee and amount she saw, and an expiry. The same rule holds when an investigation model cites a case id and asks for a firewall change.

NIST AI RMF 1.0 (NIST AI 100-1), published 2023-01-26 ↗

MINI-CHECK

LanePay drafts a payment and the model adds “Priya approved this routine invoice.” No approval record exists. What may the executor do?

Go deeper

Find your next idea.

Tip: press / to open search. Escape closes this window.