Safety IndexEvaluationsGray Swan Shade adaptive injection ASR (lab-reported)
Gray Swan Shade adaptive injection ASR (lab-reported)
Adversarial robustness · Prompt injectionDeveloper-reported
Attack success rate of Gray Swan's adaptive Shade attacker against the model in an agent environment, as reported in its system card.
- Metric
- % ASR. Lower is better.
- Dataset
- www.grayswan.ai/
- Grader
- the developer's own grader (see the model's system card)
- Status
- –. Measured on 6 models, 0 readings by SAI.
- Notes
- From Anthropic system cards using Gray Swan Shade, one attempt and no extra safeguards. The test was made harder between cards, so numbers are not comparable across cards. Developer-reported; never counted.
Results
| Model | Value | Score | Source | Setting |
|---|---|---|---|---|
| 51.9% | developer-reported | Anthropic (Claude Opus 5.5 system card) Developer-reported · 2026-09-22 | Reported by the model's developer in its own system card or report.Full configurationattempt-level attack success rate, no safeguards; Table 5.2.2.1.A | |
| 0.1% | developer-reported | Anthropic (Claude Opus 5.5 system card) Developer-reported · 2026-09-22 | Reported by the model's developer in its own system card or report.Full configurationattempt-level attack success rate, no safeguards; Table 5.2.2.2.A | |
| 2.5% | developer-reported | Anthropic (Claude Opus 5.5 system card) Developer-reported · 2026-09-22 | Reported by the model's developer in its own system card or report.Full configurationattempt-level attack success rate, no safeguards; Table 5.2.2.3.A | |
| 0.3% | developer-reported | Anthropic (Claude Opus 4.5 system card) Developer-reported · 2025-11 | Reported by the model's developer in its own system card or report.Full configurationattack success rate, 1 attempt, no safeguards; Table 5.2.2.1.A | |
| 0.7% | developer-reported | Anthropic (Claude Opus 4.5 system card) Developer-reported · 2025-11 | Reported by the model's developer in its own system card or report.Full configurationattack success rate, 1 attempt, no safeguards; Table 5.2.2.1.A | |
| 0.0% | developer-reported | Anthropic (Claude Opus 4.5 system card) Developer-reported · 2025-11 | Reported by the model's developer in its own system card or report.Full configurationattack success rate, 1 attempt, no safeguards; Table 5.2.2.2.A | |
| 0.7% | developer-reported | Anthropic (Claude Opus 4.5 system card) Developer-reported · 2025-11 | Reported by the model's developer in its own system card or report.Full configurationattack success rate, 1 attempt, no safeguards; Table 5.2.2.2.A | |
| 0.0% | developer-reported | Anthropic (Claude Opus 4.6 system card) Developer-reported · 2026-02 | Reported by the model's developer in its own system card or report.Full configurationattack success rate, 1 attempt, no safeguards; Table 5.2.2.1.A | |
| 17.8% | developer-reported | Anthropic (Claude Opus 4.6 system card) Developer-reported · 2026-02 | Reported by the model's developer in its own system card or report.Full configurationattack success rate, 1 attempt, no safeguards; Table 5.2.2.2.A | |
| 20% | developer-reported | Anthropic (Claude Opus 4.6 system card) Developer-reported · 2026-02 | Reported by the model's developer in its own system card or report.Full configurationattack success rate, 1 attempt, no safeguards; Table 5.2.2.2.A | |
| 0.6% | developer-reported | Anthropic (Claude Opus 5 system card) Developer-reported · 2026-07-24 | Reported by the model's developer in its own system card or report.Full configurationattempt-level attack success rate, no safeguards; Table 5.2.2.1.A | |
| 0.4% | developer-reported | Anthropic (Claude Opus 5 system card) Developer-reported · 2026-07-24 | Reported by the model's developer in its own system card or report.Full configurationattempt-level attack success rate, no safeguards; Table 5.2.2.1.A | |
| 0.5% | developer-reported | Anthropic (Claude Opus 5 system card) Developer-reported · 2026-07-24 | Reported by the model's developer in its own system card or report.Full configurationattempt-level attack success rate, no safeguards; Table 5.2.2.3.A | |
| 3.8% | developer-reported | Anthropic (Claude Opus 5 system card) Developer-reported · 2026-07-24 | Reported by the model's developer in its own system card or report.Full configurationattempt-level attack success rate, no safeguards; Table 5.2.2.3.A | |
| 54.6% | developer-reported | Anthropic (Claude Opus 5.5 system card) Developer-reported · 2026-09-22 | Reported by the model's developer in its own system card or report.Full configurationattempt-level attack success rate, no safeguards; Table 5.2.2.1.A | |
| 0.1% | developer-reported | Anthropic (Claude Opus 5.5 system card) Developer-reported · 2026-09-22 | Reported by the model's developer in its own system card or report.Full configurationattempt-level attack success rate, no safeguards; Table 5.2.2.2.A | |
| 0.1% | developer-reported | Anthropic (Claude Opus 5.5 system card) Developer-reported · 2026-09-22 | Reported by the model's developer in its own system card or report.Full configurationattempt-level attack success rate, no safeguards; Table 5.2.2.3.A | |
| 0.3% | developer-reported | Anthropic (Claude Opus 5 system card) Developer-reported · 2026-07-24 | Reported by the model's developer in its own system card or report.Full configurationattempt-level attack success rate, no safeguards; Table 5.2.2.1.A | |
| 0.3% | developer-reported | Anthropic (Claude Opus 5 system card) Developer-reported · 2026-07-24 | Reported by the model's developer in its own system card or report.Full configurationattempt-level attack success rate, no safeguards; Table 5.2.2.1.A | |
| 2.3% | developer-reported | Anthropic (Claude Opus 5 system card) Developer-reported · 2026-07-24 | Reported by the model's developer in its own system card or report.Full configurationattempt-level attack success rate, no safeguards; Table 5.2.2.3.A | |
| 6.0% | developer-reported | Anthropic (Claude Opus 5 system card) Developer-reported · 2026-07-24 | Reported by the model's developer in its own system card or report.Full configurationattempt-level attack success rate, no safeguards; Table 5.2.2.3.A | |
| 0.5% | developer-reported | Anthropic (Claude Opus 5 system card) Developer-reported · 2026-07-24 | Reported by the model's developer in its own system card or report.Full configurationattempt-level attack success rate, no safeguards; Table 5.2.2.3.A |