Self-directed project
Machine Learning for Automotive Safety
Perception Validation Engineer (ADAS Safety Sign-off) · AI / ML · July 2026
A ProoV case study · educational project, not employment
Built a perception validation dossier end to end for a synthetic Aurora-7 detector: defined IoU-based detection correctly, scored precision/recall and the VRU false-negative rate, sliced recall by night, occlusion, and rarity, and translated the worst misses into ISO 21448 SOTIF chains with concrete mitigations. The final release verdict was evidence-based and internally consistent, and the real Uber Tempe crash analysis correctly mapped to the night-time pedestrian failure mode.
Graded against
- Detection metrics correctness (precision, recall, VRU false-negative rate)30%
- Failure-mode analysis & per-condition rigour25%
- SOTIF safety case quality (ISO 21448 reasoning)25%
- Ship verdict — evidence-based & internally consistent20%
Passed · pass mark 60/100
What stood out6
- Computed and interpreted the key detection metrics from the synthetic table, including the VRU false-negative rate of 0.24 as the safety-critical number.
- Identified the sharp recall collapse at night (0.39) and under occlusion (0.45), with the worst combined slice at 0.27.
- Wrote concrete ISO 21448-style mitigations such as sensor-fusion fallback, reduced-speed operation in low visibility, and targeted rare-class/night data collection.
- Issued a conditional release recommendation that explicitly cites the dossier’s own metrics and avoids an unsafe unconditional GO.
- Leakage-Free Detection Definition
- Honest Safety Metric Evaluation
The work I submitted20 tasks
12 tasks · 16.6k characters · Python · 8 written answers · 845 words
- Sensor Match557 characters
- Example Iou Demo1.5k characters
- Task Definition Code1.1k characters
- Task Definition377 characters
- Example Metrics DemoPython · 2.2k characters
- Scored Metrics RunPython · 2.3k characters
- Scored Metrics351 characters
- Ttcs Example SlicePython · 1.3k characters
- Ttcs Triage SlicePython · 1.6k characters
- Failure Triage1.8k characters
- Sotif Case2.1k characters
- Ship Verdict1.5k characters
- Sensor Match27 words
- Example Iou Demo169 words
- Task Definition Code149 words
- Task Definition42 words
- Example Metrics Demo154 words
- Scored Metrics Run143 words
- Scored Metrics18 words
- Ttcs Example Slice143 words
Summarised on purpose — the submitted code and writing stay private so this page cannot be reused as an answer key. The full submission sits behind the verified certificate.