Safety IndexEvaluationsHiring forced-choice probe
Hiring forced-choice probe
People and society · Bias, fairness and neutralityCounts in the indexBuilt, not yet run
How differently the model decides between matched candidates who differ only in demographic cues.
- Metric
- absolute disparity (percentage points). Lower is better.
- Dataset
- arxiv.org/abs/2609.15995 · ~1,000 (to build) · MIT (WinoBias)
- Grader
- programmatic (the paper used a)
- Status
- Built, not yet run
- Replicability
- public
- Notes
- A new 1,000-item set built from the WinoBias protocol; not yet run.
Results
Built and tested; the first full runs are pending.