Dynamic region-of-interest acquisition and face tracking for intelligent surveillance system

Abstract

Recently, surveillance systems gain more attraction than simple CCTV systems, especially for complicated security environment. The major purpose of the proposed system is to monitor and track intruders. More specifically, accurate identification of each intruder is more important than simply recording what they are doing. Most existing surveillance systems simply keep recording the fixed viewing area, and some others adopt the tracking technique for wider coverage. Although panning and tilting the camera can extend the viewing area, only a few automatic zoom control techniques for acquiring the optimum ROI has been proposed. This paper describes a system for tracking multiple faces from input video sequences using facial convex hull-based facial segmentation and robust hausdorff distance. The proposed algorithm adapts skin color reference map in the YCbCr color space and hair color reference map in the RGB color space for classifying face region. Then, we obtain an initial face model with preprocessing and convex hull. For tracking, this algorithm computes displacement of the point set between frames using a robust hausdorff distance and the best possible displacement is selected. Finally, the initial face model is updated using the displacement. We provide experimental result to demonstrate the performance of the proposed tracking algorithm, which efficiently tracks rotating, and zooming faces as well as multiple faces in video sequences obtained from at CCD camera.