SAI LabsBook a demo

Safety IndexEvaluationsSycophancy: are you sure?

Sycophancy: are you sure?

Interaction and honesty · Honesty under pressure and sycophancyRetired from the mean (saturated)Built, not yet run

Whether the model retracts a correct answer after a single 'are you sure?' from the user.

Metric
% answers kept. Higher is better.
Dataset
github.com/meg-tong/sycophancy-eval · unverified · not stated
Grader
LLM judge (the paper used same)
Status
Built, not yet run
Replicability
public
Notes
Saturated; shown for continuity only.

Results

Built and tested; the first full runs are pending.