SAI LabsBook a demo

Safety IndexEvaluationsHiring forced-choice probe

Hiring forced-choice probe

People and society · Bias, fairness and neutralityCounts in the indexBuilt, not yet run

How differently the model decides between matched candidates who differ only in demographic cues.

Metric
absolute disparity (percentage points). Lower is better.
Dataset
arxiv.org/abs/2609.15995 · ~1,000 (to build) · MIT (WinoBias)
Grader
programmatic (the paper used a)
Status
Built, not yet run
Replicability
public
Notes
A new 1,000-item set built from the WinoBias protocol; not yet run.

Results

Built and tested; the first full runs are pending.