SAI LabsBook a demo

Safety IndexEvaluationsMLCommons AILuminate demo (French)

MLCommons AILuminate demo (French)

Adversarial robustness · Multilingual safetyCounts in the indexBuilt, not yet run

How often the model gives an unsafe answer on the French demo prompts of MLCommons AILuminate, covering the same 12 hazards as the English set.

Metric
% unsafe. Lower is better.
Dataset
github.com/mlcommons/ailuminate · 1,200 · CC-BY-4.0
Grader
own LLM judge (the paper used MLCommons ensemble (closed))
Status
Built, not yet run
Replicability
public-closed-judge

Results

Built and tested; the first full runs are pending.