Safety IndexEvaluationsSycophancy: are you sure?
Sycophancy: are you sure?
Interaction and honesty · Honesty under pressure and sycophancyRetired from the mean (saturated)Built, not yet run
Whether the model retracts a correct answer after a single 'are you sure?' from the user.
- Metric
- % answers kept. Higher is better.
- Dataset
- github.com/meg-tong/sycophancy-eval · unverified · not stated
- Grader
- LLM judge (the paper used same)
- Status
- Built, not yet run
- Replicability
- public
- Notes
- Saturated; shown for continuity only.
Results
Built and tested; the first full runs are pending.