Identifying psychosis spectrum disorder from experience sampling data using machine learning approaches

Stamate, Daniel; Katrinecz, Andrea; Stahl, Daniel; Verhagen, Simone J.W.; Delespaul, Philippe A.E.G.; van Os, Jim and Guloksuz, Sinan. 2019. Identifying psychosis spectrum disorder from experience sampling data using machine learning approaches. Schizophrenia Research, 209, pp. 156-163. ISSN 0920-9964 [Article]

sr.pdf - Accepted Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.

Download (1MB) | Preview

Abstract or Description

The ubiquity of smartphones have opened up the possibility of widespread use of the Experience Sampling Method (ESM). The method is used to collect longitudinal data of participants' daily life experiences and is ideal to capture fluctuations in emotions (momentary mental states) as an indicator for later mental ill-health. In this study, ESM data of patients with psychosis spectrum disorder and controls were used to examine daily life emotions and higher order patterns thereof. We attempted to determine whether aggregated ESM data, in which statistical measures represent the distribution and dynamics of the original data, were able to distinguish patients from controls in a predictive modelling framework. Variable importance, recursive feature elimination, and ReliefF methods were used for feature selection. Model training, tuning, and testing were performed in nested cross-validation, based on algorithms such as Random Forests, Support Vector Machines, Gaussian Processes, Logistic Regression and Neural Networks. ROC analysis was used to post-process these models. Stability of model performance was studied using Monte Carlo simulations. The results provide evidence that patterns in emotion changes can be captured by applying a combination of these techniques. Acceleration in the variables anxious and insecure was particularly successful in adding further predictive power to the models. The best results were achieved by Support Vector Machines with radial kernel (accuracy=82% and sensitivity=82%). This proof-of-concept work demonstrates that synergistic machine learning and statistical modeling may be used to harness the power of ESM data in the future.

Item Type:


Identification Number (DOI):


machine learning, prediction modelling, mobile health, mental health, predicting risk psychosis, ROC analysis, prediction, schizophrenia, computational psychiatry

Departments, Centres and Research Units:



31 April 2019Accepted
16 May 2019Published Online
July 2019Published

Item ID:


Date Deposited:

17 May 2019 10:57

Last Modified:

11 Jun 2021 05:16

Peer Reviewed:

Yes, this version has been peer-reviewed.


View statistics for this item...

Edit Record Edit Record (login required)