Crowd saliency prediction with optimal feature combinations

Kun Ma, Guangyu Gao*, Gangyi Ding, Chi Harold Liu, Erwu Liu

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Citations (Scopus)

Abstract

Crowd saliency prediction refers to predicting where people look at in crowd scene. Humans have remarkable ability to rapidly direct their gaze to select visual information of interest when looking at a visual scene. Until now, research efforts are still focused on that which type of feature is representative for crowd saliency, and which type of learning model is the robust one for crowd saliency prediction. In this paper, we propose a Random Forest (RF) based crowd saliency prediction approach with optimal feature combination, i.e., the Feature Combination Selection for Crowd Saliency (FCSCS) framework. More specifically, we first define two representative crowd saliency features: FaceSizeDiff and FacePoseDiff. Next, we adopt the Random Forest (RF) algorithm to construct our saliency learning model. Then, we evaluate the performance of crowd saliency prediction classifiers with different feature combinations (fifteen combinations in our experiments). Those selected features include low-level features (i.e., color, intensity, orientation), four existing crowd features (i.e., face size, face density, frontal face, profile face) and two new defined features (i.e., FaceSizeDiff and FacePoseDiff). Finally, we obtain the optimal feature combination that is most suitable for crowd saliency prediction. We conduct extensive experiments and empirical evaluation to demonstrate the satisfactory performance of our approach.

Original languageEnglish
Title of host publication2016 8th International Conference on Wireless Communications and Signal Processing, WCSP 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781509028603
DOIs
Publication statusPublished - 21 Nov 2016
Event8th International Conference on Wireless Communications and Signal Processing, WCSP 2016 - Yangzhou, China
Duration: 13 Oct 201615 Oct 2016

Publication series

Name2016 8th International Conference on Wireless Communications and Signal Processing, WCSP 2016

Conference

Conference8th International Conference on Wireless Communications and Signal Processing, WCSP 2016
Country/TerritoryChina
CityYangzhou
Period13/10/1615/10/16

Fingerprint

Dive into the research topics of 'Crowd saliency prediction with optimal feature combinations'. Together they form a unique fingerprint.

Cite this

Ma, K., Gao, G., Ding, G., Liu, C. H., & Liu, E. (2016). Crowd saliency prediction with optimal feature combinations. In 2016 8th International Conference on Wireless Communications and Signal Processing, WCSP 2016 Article 7752552 (2016 8th International Conference on Wireless Communications and Signal Processing, WCSP 2016). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/WCSP.2016.7752552