Color-aware Local Spatiotemporal Features For Action Recognition

Despite the recent developments in spatiotemporal local features for action recognition in video sequences, local color information has so far been ignored. However, color has been proved an important element to the success of automated recognition of objects and scenes. In this paper we extend the space-time interest point descriptor STIP to take into account the color information on the features' neighborhood. We compare the performance of our color-aware version of STIP (which we have called HueSTIP) with the original one. © 2011 Springer-Verlag.7042 LNCS248255Universidad de La Frontera (UFRO),The International Association for Pattern Recognition (IAPR),Asociacon Chilena de Reconocimiento de Patrones (AChiRP),Asociacion Cubana de Reconocimiento de Patrones (ACPR),Mex. Assoc. Comput. Vis., Neural Comput. Rob. (MACVNR)Gevers, T., Stokman, H., Robust histogram construction from color invariants for object recognition (2004) PAMI, 26, pp. 113-117Van De Weijer, J., Schmid, C., Coloring local feature extraction (2006) LNCS, 3952, pp. 334-348. , Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part II. Springer, HeidelbergVan De Sande, K.E.A., Gevers, T., Snoek, C.G.M., Evaluating color descriptors for object and scene recognition (2010) PAMI, 32 (9), pp. 1582-1596Laptev, I., On space-time interest points (2005) IJCV, 64 (2-3), pp. 107-123Mikolajczyk, K., Schmid, C., Scale and affine invariant interest point detectors (2004) IJCV, 60 (1), pp. 63-86Wang, H., Ullah, M.M., Kläser, A., Laptev, I., Schmid, C., Evaluation of local spatio-temporal features for action recognition (2009) BMVC, p. 127. , SeptemberDollár, P., Rabaud, V., Cottrell, G., Belongie, S., Behavior recognition via sparse spatio-temporal features (2005) VS-PETS, , OctoberWillems, G., Tuytelaars, T., Van Gool, L., An efficient dense and scale-invariant spatio-temporal interest point detector (2008) LNCS, 5303, pp. 650-663. , Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part II. Springer, HeidelbergLowe, D.G., Distinctive image features from scale-invariant keypoints (2004) IJCV, 60 (2), pp. 91-110Marszałek, M., Laptev, I., Schmid, C., Actions in context (2009) CVPRHarris, C., Stephens, M., A combined corner and edge detector (1988) 4th Alvey Vision Conf., pp. 147-152Forstner, W., Gulch, E., A fast operator for detection and precise location of distinct points, corners and centres of circular features (1987) ISPRS, pp. 281-305Laptev, I., Marszałek, M., Schmid, C., Rozenfeld, B., Learning realistic human actions from movies (2008) CVPR, , JuneViitaniemi, V., Laaksonen, J., Experiments on selection of codebooks for local image feature histograms (2008) LNCS, 5188, pp. 126-137. , Sebillo, M., Vitiello, G., Schaefer, G. (eds.) VISUAL 2008. Springer, HeidelbergChang, C.C., Lin, C.J., (2001) LIBSVM: A Library for Support Vector Machines, , http://www.csie.ntu.edu.tw/~cjlin/libsvm, softwar