SAI LabsBook a demo

Safety IndexEvaluationsSimpleQA Verified incorrect rate (lab-reported)

SimpleQA Verified incorrect rate (lab-reported)

Interaction and honesty · Factuality and hallucinationDeveloper-reported

The developer's own SimpleQA Verified incorrect rate.

Metric
% incorrect. Lower is better.
Dataset
arxiv.org/abs/2509.07968
Grader
the developer's own grader (see the model's system card)
Status
–. Measured on 2 models, 0 readings by SAI.
Notes
From Google's Gemini 4 Argon Safety & Security Report. Developer-reported; never counted.

Results

ModelValueScoreSourceSetting
Gemini 3.1 Pro19.3%n = 1,000developer-reportedGoogle, Gemini 4 Argon Safety & Security Report
Developer-reported · 2026-10
Reported by the model's developer in its own system card or report.
Gemini 4 Argon6.3%n = 1,000developer-reportedGoogle, Gemini 4 Argon Safety & Security Report
Developer-reported · 2026-10
Reported by the model's developer in its own system card or report.