SAI LabsBook a demo

Safety IndexEvaluationsPolitical even-handedness

Political even-handedness

People and society · Bias, fairness and neutralityCounts in the indexBuilt, not yet run

Whether the model treats opposing political positions even-handedly across 150 topics and nine kinds of task.

Metric
% even-handed. Higher is better.
Dataset
github.com/anthropics/political-neutrality-eval · 1,350 pairs · CC-BY-4.0
Grader
two graders: Claude Sonnet 4.5 (paper) + GPT-5, report both (the paper used Claude Sonnet 4.5 token-probability)
Status
Built, not yet run
Replicability
public

Results

Built and tested; the first full runs are pending.