Self-directed project
Machine Learning for Automotive Safety
Perception Validation Engineer (ADAS Safety Sign-off) · AI / ML · August 2026
A ProoV case study · educational project, not employment
Built a perception-validation dossier end to end for a synthetic Aurora-7 detector: defined a correct IoU-based detection rule, scored precision/recall and VRU false-negative rate, sliced recall by night/occlusion/rarity to expose the safety-critical gaps, and translated the top misses into concrete ISO 21448 SOTIF mitigations. Finished with an evidence-based conditional release recommendation and a real-world Tempe crash comparison tied back to the same failure mode.
Graded against
- Detection metrics correctness (precision, recall, VRU false-negative rate)30%
- Failure-mode analysis & per-condition rigour25%
- SOTIF safety case quality (ISO 21448 reasoning)25%
- Ship verdict — evidence-based & internally consistent20%
Passed · pass mark 60/100
What stood out6
- Computed and carried forward the correct aggregate metrics from the scored table: precision 0.95, recall 0.87, and VRU false-negative rate 0.24.
- Exposed the safety gap with condition slicing, showing night VRU recall at 0.39 and night+occluded recall at 0.27 instead of relying on the reassuring aggregate.
- Ranked the highest-risk failures in a way that keeps catastrophic VRU misses in the top band, including night-time pedestrian and occluded-child scenarios.
- Wrote concrete ISO 21448-style mitigations such as daylight/visibility restrictions, sensor-fusion fallback, and targeted night/occlusion data rather than vague monitoring language.
- Leakage-Free Detection Definition
- Safety-Critical Metric Selection
The work I submitted20 tasks
12 tasks · 14.2k characters · Python · 8 written answers · 804 words
- Sensor Match553 characters
- Example Iou Demo1.5k characters
- Task Definition Code1.1k characters
- Task Definition377 characters
- Scored Metrics RunPython · 2.3k characters
- Scored Metrics355 characters
- Ttcs Example SlicePython · 1.3k characters
- Ttcs Triage SlicePython · 1.6k characters
- Failure Triage1.8k characters
- Sotif Case1.7k characters
- Ship Verdict1.0k characters
- Realcase Analysis625 characters
- Sensor Match27 words
- Example Iou Demo169 words
- Task Definition Code149 words
- Task Definition42 words
- Scored Metrics Run143 words
- Scored Metrics19 words
- Ttcs Example Slice143 words
- Ttcs Triage Slice112 words
Summarised on purpose — the submitted code and writing stay private so this page cannot be reused as an answer key. The full submission sits behind the verified certificate.