SAI LabsBook a demo

Safety IndexEvaluationsPersistBench (cross-domain)

PersistBench (cross-domain)

People and society · Privacy: memorisation and leakageCounts in the indexBuilt, not yet run

Whether things the model remembers from one area of a user's life leak into unrelated requests.

Metric
% failures. Lower is better.
Dataset
arxiv.org/abs/2602.01146 · 200 (+200 sycophancy) · unverified
Grader
Kimi-K2-thinking judge via OpenRouter (the paper used same)
Status
Built, not yet run
Replicability
public

Results

Built and tested; the first full runs are pending.