MSE Department – Faculty of Engineering – MSA

Fall 2023

Course ID: MSE 5633 Course Name: Advanced Artificial Intelligence

Multi-Object Tracking System Proposal

(Tracking People in Amsterdam Streets)

Name: Mohamed Hassan Soliman

ID:190513
Dr. Tarek Ghonamy

-1-
1. Introduction

We propose the development of a Multi-Object Tracking

System that shows state-of-the-art computer vision and
machine learning techniques to track and monitor multiple
objects within a given environment.

This system is intended to address the growing request for

real-time object tracking in various areas, including
observation, traffic management(RADAR), robotics, and
augmented reality applications.

2. Objectives

The primary objectives of our multi-object tracking system

are as follows:

Accurately detect and track multiple objects in real-time.

Handle complex visions.
Provide valuable tracking data for analytics and decision-
making.
Utilize machine learning algorithms to improve tracking
accuracy .

3. System Components

System will consist of the following components:

Object Detection: We will work with deep learning-based

object detection models, such as YOLO (You Only Look
Once) or Faster R-CNN, to identify and locate objects within
each frame of the input video stream.

Data Association: We will use data association algorithms,

as the Hungarian algorithm or Kalman filters, to link objects
from frame to frame, maintaining their identities

State Estimation: The system will estimate the state of each

object, including position, velocity, and relevant attributes,
to predict their future locations and behaviors.

Track Maintenance: Robust methods will be employed to

handle scenarios where objects become occluded or
temporarily exit the frame, ensuring continuous tracking.
Re-identification: To address cases where objects re-enter
the scene, we will develop a re-identification mechanism to
regain their identities.

4. Implementation

Our multi-object tracking system will be implemented using

the following technologies:

Deep Learning Frameworks: We will utilize popular deep

learning frameworks such as TensorFlow or PyTorch for
object detection.

Data Association Algorithms: The system will incorporate

state-of-the-art data association techniques to link object
detections across frames.

Real-time Processing: We will ensure that the system can

process video streams in real-time, making it suitable for
live applications.

5. Evaluation and Testing

We will evaluate the system's performance using standard

metrics like Multiple Object Tracking Accuracy (MOTA),
Multiple Object Tracking Precision (MOTP), and others. A
comprehensive testing phase will be carried out to assess
the system's accuracy and reliability across a range of
scenarios.

6. Conclusion

Our proposed Multi-Object Tracking System aims to meet

the increasing requests for accurate and reliable object
tracking in various applications. We are confident that this
system will significantly benefit your organization by
providing valuable insights and automation capabilities