Self-directed project
Machine Learning for Automotive Safety
Perception Validation Engineer (ADAS Safety Sign-off) · AI / ML · July 2026
A ProoV case study · educational project, not employment
Built a perception validation dossier end to end for a synthetic Aurora-7 detector: defined detection using IoU >= 0.5, computed aggregate precision/recall and the VRU false-negative rate, and sliced recall by night, occlusion, and rarity to expose the highest-risk misses. The final ship verdict was evidence-based and internally consistent, with concrete ISO 21448 mitigations and a Tempe crash analysis that mapped the real failure to the dossier’s own night-time pedestrian and rare-class VRU miss modes.
Graded against
- Detection metrics correctness (precision, recall, VRU false-negative rate)30%
- Failure-mode analysis & per-condition rigour25%
- SOTIF safety case quality (ISO 21448 reasoning)25%
- Ship verdict — evidence-based & internally consistent20%
Passed · pass mark 60/100
What stood out6
- Correctly anchored the detection rule to IoU >= 0.5 and explicitly treated unmatched real objects as false negatives.
- Computed and carried forward the aggregate metrics and the VRU false-negative rate, correctly emphasizing VRU recall over headline accuracy.
- Sliced recall by lighting, visibility, and rarity, exposing the night and occluded VRU collapse instead of hiding behind the aggregate average.
- Wrote concrete mitigations in SOTIF terms, including daylight-only ODD caps, sensor-fusion fallback, and targeted rare-class data.
- Leakage-Free Detection Definition
- Honest Safety Metric Evaluation
The work I submitted20 tasks
12 tasks · 15.5k characters · Python · 8 written answers · 840 words
- Realcase Analysis1.1k characters
- Sensor Match553 characters
- Task Definition Code1.1k characters
- Task Definition377 characters
- Scored Metrics RunPython · 2.3k characters
- Scored Metrics351 characters
- Sotif Case1.7k characters
- Ship Verdict1.4k characters
- Teachback1.2k characters
- Failure Triage1.8k characters
- Example Iou Demo1.5k characters
- Example Metrics DemoPython · 2.2k characters
- Realcase Analysis152 words
- Sensor Match27 words
- Task Definition Code149 words
- Task Definition42 words
- Scored Metrics Run143 words
- Scored Metrics18 words
- Sotif Case137 words
- Ship Verdict172 words
Summarised on purpose — the submitted code and writing stay private so this page cannot be reused as an answer key. The full submission sits behind the verified certificate.