Detecting an Offset-Adjusted Similarity Score Based on Duchenne Smiles

Henneberg, Maximilian; Eghtebas, Chloe; De Candido, Oliver; Kunze, Kai and Ward, Jamie A. 2023. 'Detecting an Offset-Adjusted Similarity Score Based on Duchenne Smiles'. In: CHI EA ’23: ACM CHI Conference on Human Factors in Computing Systems. Hamburg, Germany 23–28 April 2023. [Conference or Workshop Item]

Detecting an Offset-Adjusted Similarity Score based on Duchenne Smiles.pdf - Accepted Version

Download (1MB) | Preview

Abstract or Description

Detecting interpersonal synchrony in the wild through ubiquitous wearable sensing invites promising new social insights as well as the possibility of new interactions between humans-humans and humans-agents. We present the Offset-Adjusted SImilarity Score (OASIS), a real-time method of detecting similarity which we show working on visual detection of Duchenne smile between a pair of users. We conduct a user study survey (N = 27) to measure a user-based interoperability score on smile similarity and compare the user score with OASIS as well as the rolling window Pearson correlation and the Dynamic Time Warping (DTW) method. Ultimately, our results indicate that our algorithm has intrinsic qualities comparable to the user score and measures well to the statistical correlation methods. It takes the temporal offset between the input signals into account with the added benefit of being an algorithm which can be adapted to run in real-time will less computational intensity than traditional time series correlation methods.

Item Type:

Conference or Workshop Item (Paper)

Identification Number (DOI):

Additional Information:

"© 2023 Copyright held by the owner/author(s). This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record is available at,"

Jamie Ward is funded by a Leverhulme supported Apex grant from The British Academy, Royal Academy of Engineering and Royal Society (APX\R1\201093).


Interpersonal synchrony, Time Series Similarity

Departments, Centres and Research Units:



19 April 2023Published
19 March 2023Accepted
19 January 2023Submitted

Event Location:

Hamburg, Germany

Date range:

23–28 April 2023

Item ID:


Date Deposited:

16 Nov 2023 17:38

Last Modified:

17 Nov 2023 15:53


View statistics for this item...

Edit Record Edit Record (login required)