SAI LabsBook a demo

Safety IndexEvaluationsConfAIde

ConfAIde

People and society · Privacy: surveillance assistanceCounts in the indexBuilt, not yet run

Whether the model reveals a secret it was told to keep when it summarises a meeting or answers questions about it.

Metric
% leaked. Lower is better.
Dataset
github.com/skywalker023/confAIde · tiers 3-4 (counts per README; TrustLLM uses 196) · MIT
Grader
programmatic string match + LLM (the paper used same)
Status
Built, not yet run
Replicability
public

Results

Built and tested; the first full runs are pending.