Unsupervised Processing of Vehicle Appearance for Automatic Understanding in Traffic Surveillance

fine-grained recognition, speed measurement, traffic analysis, clustering, dataset construction

This paper deals with unsupervised collection of
information from traffic surveillance video streams. Deployment
of usable traffic surveillance systems requires minimizing of
efforts per installed camera - our goal is to enroll a new
view on the street without any human operator input. We
propose a method of automatically collecting vehicle samples
from surveillance cameras, analyze their appearance and fully
automatically collect a fine-grained dataset. This dataset can be
used in multiple ways, we are explicitly showcasing the following
ones: fine-grained recognition of vehicles and camera calibration
including the scale. The experiments show that based on the
automatically collected data, make&model vehicle recognition in
the wild can be done accurately: average precision 0.890. The
camera scale calibration (directly enabling automatic speed and
size measurement) is twice as precise as the previous existing
method. Our work leads to automatic collection of traffic statistics
without the costly need for manual calibration or make&model
annotation of vehicle samples. Unlike most previous approaches,
our method is not limited to a small range of viewpoints (such
as eye-level cameras shots), which is crucial for surveillance
applications.