H

Hallucination

When an AI confidently generates information that is factually wrong — the primary risk in any AI deployment without proper grounding.

What it is

Hallucination is when a large language model generates plausible-sounding but factually incorrect information. The model is not lying — it is predicting the most likely next tokens based on patterns in its training data. Without access to real-time facts, it fills gaps with statistically probable but wrong answers.

Why it matters

Hallucination is one of the biggest risks in enterprise AI. An agent that tells a customer their order shipped when it did not, or quotes the wrong figure, creates real business damage. Every production AI deployment needs anti-hallucination measures.

Key components

  • Training data gaps
  • Token prediction
  • Grounding as mitigation
  • Output validation

How it connects

Salesforce combats hallucination through grounding (connecting agents to real data via Data Cloud and Knowledge), the Trust Layer (which validates outputs), and citation tracking (which shows where answers came from).

Good to know

You cannot eliminate hallucination entirely — you can only reduce it. Grounding, guardrails, and human-in-the-loop review are all part of the solution. Test your agents with adversarial prompts before go-live.

Need Help Implementing This?

We specialize in putting AI and Agentforce to work for Salesforce customers. Let's talk about your use case.

Book Intro Call