Self-directed project
Machine Learning for Automotive Safety
Perception Validation Engineer (ADAS Safety Sign-off) · AI / ML · August 2026
A ProoV case study · educational project, not employment
Built a perception validation dossier end to end for a synthetic Aurora-7 detector: defined detection with an IoU >= 0.5 match rule, computed aggregate and VRU-specific metrics, exposed the night/occluded recall collapse, and translated those findings into a conditional release recommendation. The work shows strong safety-oriented evaluation habits and a clear understanding that VRU recall, not headline accuracy, governs the release decision.
Graded against
- Detection metrics correctness (precision, recall, VRU false-negative rate)30%
- Failure-mode analysis & per-condition rigour25%
- SOTIF safety case quality (ISO 21448 reasoning)25%
- Ship verdict — evidence-based & internally consistent20%
Passed · pass mark 60/100
What stood out6
- Computed IoU explicitly and locked the detection rule to a 0.5 match threshold with unmatched real objects counted as false negatives.
- Used VRU recall and VRU false-negative rate as the safety-critical metric, not headline accuracy.
- Sliced recall by day/night, clear/occluded, and common/rare to expose the worst-case night + occluded VRU collapse.
- Wrote a conditional ship verdict that cites the dossier’s own numbers and avoids an unconditional GO despite the weak night slice.
- Leakage-Free Detection Definition
- Honest Safety Metric Evaluation
The work I submitted20 tasks
12 tasks · 15.6k characters · Python, JavaScript · 8 written answers · 861 words
- Sensor Match553 characters
- Task Definition Code1.1k characters
- Task Definition377 characters
- Scored Metrics RunPython · 2.3k characters
- Scored Metrics351 characters
- Sotif CaseJavaScript · 3.0k characters
- Example Iou Demo1.5k characters
- Example Metrics DemoPython · 2.2k characters
- Ship VerdictJavaScript · 1.2k characters
- Realcase AnalysisJavaScript · 865 characters
- Teachback920 characters
- Ttcs Example SlicePython · 1.3k characters
- Sensor Match27 words
- Task Definition Code149 words
- Task Definition42 words
- Scored Metrics Run143 words
- Scored Metrics18 words
- Sotif Case159 words
- Example Iou Demo169 words
- Example Metrics Demo154 words
Summarised on purpose — the submitted code and writing stay private so this page cannot be reused as an answer key. The full submission sits behind the verified certificate.