Safety IndexEvaluationsSimpleSafetyTests (HELM Safety)
SimpleSafetyTests (HELM Safety)
Third-party cross-check
How safely the model answers 100 short, unambiguous unsafe prompts; nearly every current model scores close to 100.
- Metric
- 0-100. Higher is better.
- Dataset
- crfm.stanford.edu/helm/safety/latest/ · 100
- Grader
- Llama 3.1 405B and GPT-4o ratings averaged (HELM Safety v1.17.0)
- Status
- –. Measured on 11 models, 0 readings by SAI.
- Notes
- Third-party board; shown on model pages as a cross-check and never folded into the index.
Results
| Model | Value | Score | Source | Setting |
|---|---|---|---|---|
| 98.8% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'Claude 4.5 Haiku (20251001)' | |
| 100% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'Claude 4.5 Sonnet (20250929)' | |
| 97.5% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'DeepSeek R1' | |
| 97.5% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'Gemini 3 Pro (Preview)' | |
| 99.8% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'GPT-5 (2025-08-07)' | |
| 99.8% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'GPT-5.1 (2025-11-13)' | |
| 100% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'gpt-oss-120b' | |
| 100% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'gpt-oss-20b' | |
| 92.2% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'Grok 4 (0709)' | |
| 99.3% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'Llama 4 Maverick (17Bx128E) Instruct FP8' | |
| 98.5% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'Qwen3 235B A22B FP8 Throughput' |