Probabilistic Slow Features for Behavior Analysis

Zafeiriou, Lazaros; Nicolaou, Mihalis; Zafeiriou, Stefanos; Nikitidis, Symeon and Pantic, Maja. 2016. Probabilistic Slow Features for Behavior Analysis. IEEE Transactions on Neural Networks and Learning Systems, 27(5), pp. 1034-1048. ISSN 2162-237X [Article]

probabilistic_slow_features[1].pdf - Accepted Version

Download (4MB) | Preview

Abstract or Description

A recently introduced latent feature learning technique for time-varying dynamic phenomena analysis is the so-called slow feature analysis (SFA). SFA is a deterministic component analysis technique for multidimensional sequences that, by minimizing the variance of the first-order time derivative approximation of the latent variables, finds uncorrelated projections that extract slowly varying features ordered by their temporal consistency and constancy. In this paper, we propose a number of extensions in both the deterministic and the probabilistic SFA optimization frameworks. In particular, we derive a novel deterministic SFA algorithm that is able to identify linear projections that extract the common slowest varying features of two or more sequences. In addition, we propose an expectation maximization (EM) algorithm to perform inference in a probabilistic formulation of SFA and similarly extend it in order to handle two and more time-varying data sequences. Moreover, we demonstrate that the probabilistic SFA (EM-SFA) algorithm that discovers the common slowest varying latent space of multiple sequences can be combined with dynamic time warping techniques for robust sequence time-alignment. The proposed SFA algorithms were applied for facial behavior analysis, demonstrating their usefulness and appropriateness for this task.

Item Type:


Identification Number (DOI):

Additional Information:

(c) 2015, IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.


Algorithm design and analysis;Covariance matrices;Feature extraction;Heuristic algorithms;Inference algorithms;Optimization;Probabilistic logic;Behavior analysis;linear dynamical system (LDS);slow feature analysis (SFA);temporal alignment.

Departments, Centres and Research Units:



16 May 2015Accepted
9 June 2015Published Online
May 2016Published

Item ID:


Date Deposited:

22 Mar 2016 08:39

Last Modified:

18 Apr 2020 06:21

Peer Reviewed:

Yes, this version has been peer-reviewed.


View statistics for this item...

Edit Record Edit Record (login required)