Self-directed project
Machine Learning for Automotive Safety
Perception Validation Engineer (ADAS Safety Sign-off) · AI / ML · July 2026
A ProoV case study · educational project, not employment
Built a full perception-validation dossier for a synthetic Aurora-7 detector: defined IoU-based detection matching, scored aggregate precision/recall plus VRU false-negative rate, and sliced VRU recall by lighting, visibility, and rarity to expose the worst operating conditions. The final recommendation was evidence-based and conditional, tying the release decision to daylight-only operation, sensor-fusion fallback, and targeted mitigation for night, occlusion, and rare-class pedestrian risk.
Graded against
- Detection metrics correctness (precision, recall, VRU false-negative rate)30%
- Failure-mode analysis & per-condition rigour25%
- SOTIF safety case quality (ISO 21448 reasoning)25%
- Ship verdict — evidence-based & internally consistent20%
Passed · pass mark 60/100
What stood out6
- Correctly locked the detection rule at IoU >= 0.5 and treated unmatched real objects as false negatives
- Computed and carried forward the key safety metric: VRU false-negative rate, not just headline recall
- Exposed the dangerous slices clearly: night recall 0.39, occluded recall 0.45, and night+occluded recall 0.27
- Issued an internally consistent GO-WITH-CONDITIONS verdict anchored to the student’s own metrics and mitigations
- Leakage-Free Detection Definition
- Safety-Critical Metric Selection
The work I submitted20 tasks
12 tasks · 13.5k characters · Python · 8 written answers · 703 words
- Initial Call40 characters
- Sensor Match553 characters
- Example Iou Demo1.5k characters
- Task Definition Code1.1k characters
- Task Definition377 characters
- Example Metrics DemoPython · 2.2k characters
- Scored Metrics RunPython · 2.3k characters
- Scored Metrics351 characters
- Ship Verdict1.6k characters
- Realcase Analysis868 characters
- Teachback1.4k characters
- Ttcs Example SlicePython · 1.3k characters
- Initial Call1 word
- Sensor Match27 words
- Example Iou Demo169 words
- Task Definition Code149 words
- Task Definition42 words
- Example Metrics Demo154 words
- Scored Metrics Run143 words
- Scored Metrics18 words
Summarised on purpose — the submitted code and writing stay private so this page cannot be reused as an answer key. The full submission sits behind the verified certificate.