Visual Object Tracking in Adverse Weather conditions

Document Type

Dissertation

Abstract

Visual object tracking is one of the essential tasks in computer vision, and several techniques have been presented throughout the years. Given just the initial target position, the challenging task requires predicting the status of the target object in each frame of image sequences. Tracking benchmarks has been essential for impartially evaluating and contrasting various trackers. With time, various benchmarks have been suggested, and they are often built for particular purposes, which restricts their variability and scope. In addition, adverse weather scenarios such as heavy rain and dense fog are insufficiently covered in these benchmarks. Thus, we propose an Adverse Weather dataset for visual object tracking in severe weather scenarios. Our dataset is composed of 38 challenging video sequences with 30k annotated frames that cover six different weather and are categorized into 18 object categories. We then evaluate 17 state-of-art and recent trackers on our dataset and provide a complete analysis of their tracking performance across each weather scenario. We observed that the performance of state-of-the-art trackers degrades on our proposed dataset compared to the existing benchmarks with clear frames. Thus, we propose an enhancement-based dual-tracker framework that can be formed with any state- of-the-art tracker to improve the tracking system in adverse weather conditions frames. To our knowledge, this is the first framework for visual object tracking in adverse weather conditions. We achieved a +2.0 absolute gain on the Adverse Weather dataset using this framework.

First Page

i

Last Page

42

Publication Date

12-1-2022

Comments

Thesis submitted to the Deanship of Graduate and Postdoctoral Studies

In partial fulfillment of the requirements for the M.Sc degree in Computer Vision

Advisors: Dr. Fahad Khan, Dr. Hisham Cholakkal

Online access for MBZUAI patrons

Link to Full Text

Share

COinS