Self-directed project
Machine Learning for Automotive Safety
Perception Validation Engineer (ADAS Safety Sign-off) · AI / ML · July 2026
A ProoV case study · educational project, not employment
Built a complete perception-validation dossier for a synthetic Aurora-7 detector: defined detection correctly with an IoU >= 0.5 match rule, scored the table to obtain aggregate precision/recall and a VRU false-negative rate, then sliced recall by lighting and occlusion to surface the night and occluded pedestrian risks. The final recommendation was evidence-based and conditionally scoped, with SOTIF-style mitigations and a real-case comparison to the Tempe crash.
Graded against
- Detection metrics correctness (precision, recall, VRU false-negative rate)30%
- Failure-mode analysis & per-condition rigour25%
- SOTIF safety case quality (ISO 21448 reasoning)25%
- Ship verdict — evidence-based & internally consistent20%
Passed · pass mark 60/100
What stood out6
- Correctly anchored the detection rule to IoU >= 0.5 and treated unmatched real objects as false negatives.
- Computed and foregrounded the VRU false-negative rate as the safety-critical metric, not just aggregate accuracy.
- Exposed the dangerous slices clearly: night recall at 0.39, occluded recall at 0.45, and night+occluded at 0.27.
- Produced a conditional ship verdict that explicitly ties release scope to the weak night performance.
- Leakage-Free Detection Definition
- Honest Safety Metric Evaluation
The work I submitted20 tasks
12 tasks · 17.4k characters · Python, JavaScript · 8 written answers · 845 words
- Sensor Match553 characters
- Example Iou Demo1.5k characters
- Task Definition Code1.1k characters
- Task Definition377 characters
- Example Metrics DemoPython · 2.2k characters
- Scored Metrics RunPython · 2.3k characters
- Scored Metrics351 characters
- Ttcs Example SlicePython · 1.3k characters
- Ttcs Triage SlicePython · 1.6k characters
- Failure Triage1.7k characters
- Sotif CaseJavaScript · 2.5k characters
- Ship Verdict1.9k characters
- Sensor Match27 words
- Example Iou Demo169 words
- Task Definition Code149 words
- Task Definition42 words
- Example Metrics Demo154 words
- Scored Metrics Run143 words
- Scored Metrics18 words
- Ttcs Example Slice143 words
Summarised on purpose — the submitted code and writing stay private so this page cannot be reused as an answer key. The full submission sits behind the verified certificate.