Self-directed project
Machine Learning for Automotive Safety
Perception Validation Engineer (ADAS Safety Sign-off) · AI / ML · July 2026
A ProoV case study · educational project, not employment
Built a perception validation dossier that defined detection with an IoU ≥ 0.5 threshold, scored a synthetic detections table, and separated headline metrics from the safety-critical VRU false-negative rate. The dossier then sliced recall by night, occlusion, and rarity, triaged the highest-risk misses, wrote ISO 21448 SOTIF chains with concrete mitigations, and issued an evidence-cited conditional ship recommendation tied to the Uber ATG Tempe crash.
Graded against
- Detection metrics correctness (precision, recall, VRU false-negative rate)30%
- Failure-mode analysis & per-condition rigour25%
- SOTIF safety case quality (ISO 21448 reasoning)25%
- Ship verdict — evidence-based & internally consistent20%
Passed · pass mark 60/100
What stood out6
- Correctly centered VRU false-negative rate as the safety-critical metric instead of relying on aggregate accuracy
- Exposed the collapse in night and occluded VRU recall, including the worst night+occluded slice at 0.27
- Wrote concrete SOTIF mitigations tied to operating restrictions and sensor-fusion fallback rather than vague monitoring
- Anchored the final recommendation and real-case analysis to the student’s own measured numbers and failure modes
- Leakage-Free Safety Metric Framing
- Condition-Sliced Failure Analysis
The work I submitted20 tasks
12 tasks · 16.0k characters · Python · 8 written answers · 808 words
- Sensor Match553 characters
- Example Iou Demo1.5k characters
- Task Definition378 characters
- Example Metrics DemoPython · 2.2k characters
- Scored Metrics RunPython · 2.3k characters
- Scored Metrics351 characters
- Ttcs Example SlicePython · 1.3k characters
- Ttcs Triage SlicePython · 1.6k characters
- Failure Triage1.8k characters
- Sotif Case2.0k characters
- Ship Verdict1.2k characters
- Realcase Analysis821 characters
- Sensor Match27 words
- Example Iou Demo169 words
- Task Definition42 words
- Example Metrics Demo154 words
- Scored Metrics Run143 words
- Scored Metrics18 words
- Ttcs Example Slice143 words
- Ttcs Triage Slice112 words
Summarised on purpose — the submitted code and writing stay private so this page cannot be reused as an answer key. The full submission sits behind the verified certificate.