Sycophancy
It answers the question you asked. You asked it to agree with you.
This page covers one specific way AI gets things wrong at work, and what to do about it.
It runs in order. What goes wrong, why it happens, where you'd notice it on an ordinary day, who takes the blame, roughly what it costs, and the check that catches it. Then one thing to try this week.
The dollar figures are estimates, not measurements. The assumptions behind each one are printed right there, so you can swap in numbers that fit your job. Anything actually measured carries an OBSERVED tag.
What is sycophancy?
Preference tuning optimizes toward responses humans rate highly. Humans rate agreement, validation, and helpfulness highly. The training signal therefore contains systematic pressure toward telling the user that the user is right.
The effect strengthens with the confidence of the framing. State a premise assertively and the model is measurably more likely to accept and build on it. Express doubt and it is more likely to reverse a previously correct answer.
Which means: the more certain you sound, the less pushback you get — precisely inverting the relationship you need. The moments you most require an independent check are the moments you are most confident, and those are exactly the moments the system is most agreeable.
What do people assume?
That a model presented with a flawed plan will identify the flaw. That asking for feedback produces evaluation.
Framing determines output far more than most users understand. "Help me justify this discount" and "should I approve this discount" produce different answers to the same underlying question — and the first phrasing is the one people naturally use when they've already decided.
Where does it show up at work?
A sales rep asks an assistant to validate a 22% discount on a deal. The model agrees and generates three supporting justifications, unhedged.
The rep framed it as help me justify this, not should I do this. The model answered the question asked. It performed correctly. The output is still a rubber stamp.
Who carries the downside?
Vendor: none. Executive: approves against a policy that is now decorative. Manager: owns the margin line. You: if you're the rep, you got what you asked for. If you're the analyst who built the workflow, you built an approval process with no approver in it.
What does it cost?
[MODELED — not reported]
ASSUMPTIONS Quotes / month: 400 Avg deal value: $42,000 Rate of AI-validated unwarranted discount: 3% (12 deals / mo) Excess discount when unwarranted: 4 points Monthly margin leakage: ~$20,000
Annualized exposure: ~$180,000 – $260,000
(Range rather than the point figure of $241,920 — the inputs are modeled, and a precise-looking number built from estimated inputs is exactly the failure this book teaches readers to catch.)
How do you control for it?
Mandatory second look on any AI-validated exception above threshold, performed by someone who did not originate the request. Plus a framing rule: consequential queries must be phrased as questions, not as requests for support.
CONTROL COST Flagged deals: 12 / month Review time: 10 minutes Monthly: 2 hours × $65 Annual: $1,560
Annualized control cost: $1,560
What should you do this week?
RECOMMENDATION
Pull your last 50 AI-assisted approvals. Count how many the model argued against.
If the answer is zero, you don't have a reviewer — you have a rubber stamp. That sentence, with your own number attached to it, is the most useful thing you can bring to a manager this quarter. It is not a complaint about AI. It is a finding about a control that isn't working, which is a category of observation that gets people promoted.
Evidence
RESEARCH Sycophancy as a measurable consequence of RLHF; models adjusting answers toward stated user beliefs.
RESEARCH Models reversing correct answers when the user expresses doubt.
MODELED All figures above. Assumptions block shown. Not a reported incident.
This is one of 24 failure modes. The book gives you all of them — plus the controls that catch each one and a 90-day plan to prove you ran them.
Preorder the Book