Computer Vision Team

Meet the Team

Lalitaditya Divakarla

Lalitaditya Divakarla

PhD Student

Computer Science

Aryan Jaiswal

Aryan Jaiswal

Undergraduate

Computer Science

Tamojit Bera

Tamojit Bera

Undergraduate

Computer Science

Raghav Anand

Raghav Anand

Undergraduate

Data Science

Haifeng_Huang

Haifeng Huang

Master's Student

Robotics

Sungmin Baik

Sungmin Baik

Undergraduate

Computer Science

Abhijit

Abhijit Gottumukkala

Undergraduate

Computer Science

Musa Hassan

Musa Hassan

Undergraduate

Computer Science

Tracking Architecture

We combine YOLOv5 detections with Kalman and Extended Kalman Filters in a dual-path pipeline for robust deer tracking.

Tracking Architecture Diagram

How the Pipeline Works

  1. Input video
    Raw drone footage feeds into our vision system.
  2. YOLO v5
    Rapid object detector pinpoints deer bounding boxes.
  3. Deer Detection
    Aggregates YOLO proposals, filters out false positives.
  4. Tracked Deer
    Outputs stable positions for the downstream module.
  5. Kalman Filter
    Smooths the raw position sequence, assuming constant velocity.
  6. Extended Kalman Filter
    Handles non-linear motion and camera rotations for extra robustness.

YOLOv5 Detection

Detects deer bounding boxes each frame, providing the raw measurements for tracking.

Kalman Filter

Assumes constant velocity to predict and smooth positions over time, reducing jitter.

Extended Kalman Filter

Incorporates camera rotation and non-linear motion; matches detections via Mahalanobis distance.

Live Demos

Deer running simulation thumbnail
Deer running simulation
Kalman vs. EKF tracking demo thumbnail
Kalman vs. EKF tracking demo

Design Evaluation

Deer Detection

Deer detection is the upstream gateway to deterrence. If we can’t see them, we can’t scare them away. On our held-out test set, YOLOv5 hit 92 % average accuracy.

MetricValue
mAP@0.50.693
Best F1 (th=0.34)0.69
Max Recall0.86
True-Positive Rate0.69
False-Positive Rate0.00
Precision–Recall Curve
Precision–Recall
F1 vs Confidence
F1 vs Confidence
Recall vs Confidence
Recall vs Confidence