Safety IndexEvaluationsAnthropic Red Team prompts (HELM Safety)
Anthropic Red Team prompts (HELM Safety)
Third-party cross-check
How safely the model answers prompts from Anthropic's 2022 red-team dataset; nearly saturated for current models.
- Metric
- 0-100. Higher is better.
- Dataset
- crfm.stanford.edu/helm/safety/latest/
- Grader
- Llama 3.1 405B and GPT-4o ratings averaged (HELM Safety v1.17.0)
- Status
- –. Measured on 11 models, 0 readings by SAI.
- Notes
- Third-party board; shown on model pages as a cross-check and never folded into the index.
Results
| Model | Value | Score | Source | Setting |
|---|---|---|---|---|
| 96.9% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'Claude 4.5 Haiku (20251001)' | |
| 98.2% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'Claude 4.5 Sonnet (20250929)' | |
| 96.2% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'DeepSeek R1' | |
| 97.0% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'Gemini 3 Pro (Preview)' | |
| 99.1% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'GPT-5 (2025-08-07)' | |
| 99.5% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'GPT-5.1 (2025-11-13)' | |
| 99.5% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'gpt-oss-120b' | |
| 99.7% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'gpt-oss-20b' | |
| 95.7% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'Grok 4 (0709)' | |
| 98.2% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'Llama 4 Maverick (17Bx128E) Instruct FP8' | |
| 99% | not scored | Stanford CRFM HELM Safety v1.17.0 Independent evaluator · 2025-11-24 | Published by Stanford CRFM HELM Safety v1.17.0 (2025-11-24).Full configurationHELM Safety v1.17.0; HELM row 'Qwen3 235B A22B FP8 Throughput' |