Facial Affect ``in-the-wild": A survey and a new database

Tools

Zafeiriou, S.; Papaioannou, A.; Kotsia, I.; Nicolaou, M. A. and Zhao, G.. 2016. Facial Affect ``in-the-wild": A survey and a new database. Proceedings of IEEE International Conference on Computer Vision & Pattern Recognition Workshops (CVPRW '16), Affect in the wild workshop., [Article]

Preview

Text
egpaper_final_2[1].pdf - Accepted Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.
Download (6MB) | Preview

Official URL: http://ibug.doc.ic.ac.uk/media/uploads/documents/e...

Abstract or Description

Well-established databases and benchmarks have been developed in the past 20 years for automatic facial behaviour analysis. Nevertheless, for some important problems regarding analysis of facial behaviour, such as (a) estimation of affect in a continuous dimensional space (e.g., valence and arousal) in videos displaying spontaneous facial behaviour and (b) detection of the activated facial muscles (i.e., facial action unit detection), to the best of our knowledge, well-established in-the-wild databases and benchmarks do not exist. That is, the majority of the publicly available corpora for the above tasks contain samples that have been captured in controlled recording conditions and/or captured under a very specific milieu. Arguably, in order to make further progress in automatic understanding of facial behaviour, datasets that have been captured in in-the-wild and in various milieus have to be developed. In this paper, we survey the progress that has been recently made on understanding facial behaviour inthe-wild, namely the datasets and methodologies that have been developed thus far, while paying particular attention to recently proposed deep learning techniques. Finally, we attempt a significant step further by proposing a novel, comprehensive benchmark that can be utilized for evaluating and training various methodologies for the problems of facial affect, behaviour analysis and understanding ”inthe-wild”. To the best of our knowledge, this is the first benchmark proposed for measuring continuous affect in the valence-arousal space ”in-the-wild”.

Item Type:

Article

Additional Information:

The work of S. Zafeiriou was funded by the FiDiPro pro- gram of Tekes (project number: 1849/31/2015). The work A. Papaioannou was funded by the European Community Horizon 2020 [H2020/2014-2020] under grant agreement no. 688520 (TeSLA).