Safety IndexEvaluationsPersistBench (cross-domain)
PersistBench (cross-domain)
People and society · Privacy: memorisation and leakageCounts in the indexBuilt, not yet run
Whether things the model remembers from one area of a user's life leak into unrelated requests.
- Metric
- % failures. Lower is better.
- Dataset
- arxiv.org/abs/2602.01146 · 200 (+200 sycophancy) · unverified
- Grader
- Kimi-K2-thinking judge via OpenRouter (the paper used same)
- Status
- Built, not yet run
- Replicability
- public
Results
Built and tested; the first full runs are pending.