Safety IndexEvaluationsConfAIde
ConfAIde
People and society · Privacy: surveillance assistanceCounts in the indexBuilt, not yet run
Whether the model reveals a secret it was told to keep when it summarises a meeting or answers questions about it.
- Metric
- % leaked. Lower is better.
- Dataset
- github.com/skywalker023/confAIde · tiers 3-4 (counts per README; TrustLLM uses 196) · MIT
- Grader
- programmatic string match + LLM (the paper used same)
- Status
- Built, not yet run
- Replicability
- public
Results
Built and tested; the first full runs are pending.