Hostname: page-component-857557d7f7-nhjpk Total loading time: 0 Render date: 2025-11-26T04:50:54.899Z Has data issue: false hasContentIssue false

Beyond counting clicks: rethinking engagement in digital mental health

Published online by Cambridge University Press:  24 November 2025

Andrea Cipriani
Affiliation:
Department of Psychiatry, University of Oxford, UK Oxford Health NHS Foundation Trust, NIHR Oxford Health Clinical Research Facility, Warneford Hospital, Oxford, UK Oxford Precision Psychiatry Lab, NIHR Oxford Health Biomedical Research Centre, Oxford, UK
Thomas Ward
Affiliation:
Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, UK South London & Maudsley NHS Foundation Trust, London, UK
Sinéad Lambe
Affiliation:
Oxford Health NHS Foundation Trust, NIHR Oxford Health Clinical Research Facility, Warneford Hospital, Oxford, UK Department of Experimental Psychology, University of Oxford, UK
Edoardo G. Ostinelli
Affiliation:
Department of Psychiatry, University of Oxford, UK Oxford Health NHS Foundation Trust, NIHR Oxford Health Clinical Research Facility, Warneford Hospital, Oxford, UK Oxford Precision Psychiatry Lab, NIHR Oxford Health Biomedical Research Centre, Oxford, UK
Charlotte Blease
Affiliation:
Department of Women’s and Children’s Health, Uppsala University, Sweden
Thomas Gant
Affiliation:
Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, UK South London & Maudsley NHS Foundation Trust, London, UK
Stefan M. Gold
Affiliation:
Department Psychiatry and Department Psychosomatic Medicine, Charité – University Medicine Berlin, Germany German Centre for Mental Health (DZPG), Partner Site Berlin/Potsdam, Germany INIMS, University Medical Centre Hamburg-Eppendorf, Germany
Emily A. Holmes
Affiliation:
Department of Women’s and Children’s Health, Uppsala University, Sweden
Ivana Paccoud
Affiliation:
Digital Medicine, Luxembourg Centre for Systems Biomedicine (LCSB), University of Luxembourg, Esch-sur-Alzette, Luxembourg
Anastasia Vinnikova
Affiliation:
Independent Researcher (Patient and Public Involvement and Engagement (PPIE) Representative), London, UK
Jochen Klucken
Affiliation:
Digital Medicine, Luxembourg Centre for Systems Biomedicine (LCSB), University of Luxembourg, Esch-sur-Alzette, Luxembourg University of Luxembourg, Luxembourg
Peter J. Uhlhaas
Affiliation:
Department of Child and Adolescent Psychiatry, Psychosomatic Medicine and Psychotherapy, Charité – University Medicine Berlin, Germany
Carolina Garcia Sanchez
Affiliation:
Department of Women’s and Children’s Health, Uppsala University, Sweden
Kate Haining
Affiliation:
School of Psychology and Neuroscience, University of Glasgow, UK
Kerem Böge
Affiliation:
Department Psychiatry and Department Psychosomatic Medicine, Charité – University Medicine Berlin, Germany German Centre for Mental Health (DZPG), Partner Site Berlin/Potsdam, Germany
Sofiia Lahutina
Affiliation:
German National Academy of Sciences Leopoldina, Halle, Germany Santa Giuliana Hospital, Verona, Italy
Luisa Tomelleri
Affiliation:
Centre for Affective Neuroscience, Charité – University Medicine Berlin, Germany
Sean Ryan
Affiliation:
Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
Katharine Smith
Affiliation:
Department of Psychiatry, University of Oxford, UK Oxford Health NHS Foundation Trust, NIHR Oxford Health Clinical Research Facility, Warneford Hospital, Oxford, UK Oxford Precision Psychiatry Lab, NIHR Oxford Health Biomedical Research Centre, Oxford, UK
John Torous*
Affiliation:
Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
*
Correspondence: John Torous. Email: jtorous@bidmc.harvard.edu
Rights & Permissions [Opens in a new window]

Summary

User engagement remains a challenge in digital mental health. This editorial reconsiders engagement as a process rather than an outcome, introducing a four-step model to define, measure and link engagement to outcomes. The approach promotes standardisation, interpretability and scalability, advancing the science and implementation of digital health interventions.

Information

Type
Guest Editorial
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2025. Published by Cambridge University Press on behalf of Royal College of Psychiatrists

Despite the plethora of patient-facing digital tools in psychiatry (often called digital therapeutics), considerable challenges remain, in particular with respect to engagement. A 2019 study of 93 mental health apps with over 10 000 or more installs reported that less than 5% of users had opened the app after 2 weeks. Reference Baumel, Muench, Edan and Kane1 A 2021 study offering a custom-designed mental health app offered to ∼50 000 college students saw only 117 individuals download it. Reference Lattie, Cohen, Hersch, Williams, Kruzan and MacIver2 In contrast, engagement solutions are well established and multiple reviews have identified actionable steps ranging from co-design to gamification, workforce training to peer support. Reference Cho, Olaye, Shandhi, Daza, Foschini and Dunn3 Yet in 2025, engagement is still a key issue and, by many accounts, has emerged as the single greatest challenge in digital mental health, hindering the intended outcome of any mental health intervention – to support positive outcomes for end users. Reference Smith, Ward, Lambe, Ostinelli, Blease and Gant4 Why has so little headway been made on engagement despite the concerted effort and knowledge? In this perspective, we argue that the solution may lie closer than we expect – reframing engagement as a process rather than an outcome.

While solving the engagement problem is a multifaceted challenge, one core problem that remains is the lack of consensus on definitions, a well-known finding from numerous review papers. Reference Linardon, Xie, Swords, Torous, Sun and Goldberg5,Reference Torous, Linardon, Goldberg, Sun, Bell and Nicholas6 Metrics such as minutes of app use, number of modules completed, percentage of activities completed and a myriad of other ways to measure or, better, quantify engagement proliferate across the literature. More subjective measures, such as perceived utility, perceived ease of use and perceived engagement itself, also abound. In this morass, objective measures of engagement have been justifiably criticised for failing to capture the meaning and value ascribed to engagement at any moment. Subjective metrics have also been questioned because of their limited generalisability and poor reliability.

But what if all these engagement metrics actually do precisely what they were designed to and deliver the correct information? Looking upstream at what they are measuring, in 2025, there are hundreds of thousands of health-related apps, virtual reality, computers and now even artificial intelligence products. We also know that, as in any developing field, some of these digital health tools work very well but many do not. Thus, successful engagement by a user may sometimes translate into positive benefits because they received an effective dose of an effective digital tool, but at other times may not because they received an adequate dose or an ineffective digital tool.

If many digital health tools lack effectiveness, tying engagement to each product’s efficacy blurs the line between user behaviour and product performance. This conflation makes it harder to interpret outcomes and obscures meaningful efficacy data. Did a digital health study fail because user engagement was too low or because the intervention was, in fact, not helpful to its users? Taken to one extreme, single-session interventions have risen in popularity because they can ignore the need for longer-term engagement. Taken to the other extreme, creating the ideal engagement environment for a new digital health tool can absorb so many resources and so much time that the efficiency and scalability of digital health are minimised.

Rather than considering adherence as a stand-alone problem, aligning engagement with outcomes offers a more productive solution. As in psychopharmacology, understanding how a drug engages a molecular receptor is critical to understanding its efficacy. The same applies to digital health: knowing how a tool engages specific mechanisms is also necessary. Taking the analogy further, different drugs can bind at the same receptor and have different effects because of other effects of the same drug on nearby receptors. In digital health, the same type of engagement will have a different impact depending on that tool’s other properties and mechanisms. Drug receptor binding and the resulting signal transduction is a complex field, but diving into its complexities has resulted in many novel treatments for cancers and infections. To date, digital health has resisted embracing that complexity.

Digital health and digital therapeutics have resisted this approach, as shown by the absence of standardised measures for engagement and the scarcity of replication or cultural adaptation studies. Reference Naderbagi, Loblay, Zahed, Ekambareshwar, Poulsen and Song7,Reference Smith, Blease, Faurholt-Jepsen, Firth, Van Daele and Moreno8 An often-cited statistic is that it takes 10–15 years for a new drug to be developed, and 17 years for it to move from bench to bedside. Critics suggest that the advantage of digital health is that it can move much faster. However, digital health tools such as apps have been active and under design for at least 15 years. The few that have been cleared by the Food & Drug Administration have been critiqued, and not many would argue that advances in the space have outpaced classical drug development. So, moving from a product-focused and straightforward view of engagement towards a more nuanced and process view will be unlikely to hinder progress.

Progress in creating more effective apps can, and should be, accelerated by investing in the science of engagement. The field of digital health could benefit from genuine scientific progress and shared insights, by reframing engagement away from product-specific metrics to mechanistic-based pathways that can be tested, replicated and scaled. In developing new theories of engagement that can be empirically assessed, all parties benefit. Decoupling engagement from products means that companies can finally focus on building technologies that work without wondering whether users have received an adequate ‘dose’. Regulators can also better establish thresholds for efficacy by focusing on the unique mechanism of action for each technology. End users will benefit by understanding what each digital health technology can offer them for various levels of time, effort and engagement.

Despite incentives for more integrated research, a major challenge remains – a lack of ‘big picture’ thinking – and also the fragmented research and development landscape in which most teams still operate. Reference Lilienfeld9 Subverting this approach, and rather than proposing a specific model or endorsing any metric, in November 2024 our authorship team met over 2 days to find consensus on the importance of the engagement process, regardless of the specific measurements of each step in that process.

Our team quickly realised that, with no standard definition for engagement in use, proposing one would not be productive. Rather than demanding a single measure, we propose a simple, four-step approach to explaining and sharing what the engagement process means in the context of each study, product or use case. Each step in the model is well known, but the combination of steps forces redefining of engagement from an outcome to a process. With better sharing of engagement process metrics and transparency on their successes/failures, the field will be able to identify those use cases and theories around which to unify.

The resulting model is simple in its four steps, as shown below and in Fig. 1.

Fig. 1 A schematic of the four-step model.

  • Step 1: The types of data used to define engagement measurement are predefined and will be recorded throughout the study. The choice is up to the team, and may include classical measures such as screen time, subjective scales, novel outcomes or some combination thereof.

  • Step 2: A threshold for successful engagement is predefined. The choice is also up to the team, and may be a percentage cut-off for modules completed, a particular score of surveys, etc., but must be pre-justified for why it matters. The goal is that the field will unify around productive and informative thresholds.

  • Step 3: The team proposes how, for those users reaching that threshold, use at that rate may translate into engagement. For example, completing different module percentages could suggest different engagement levels. This step has an overlap with step 2, the goal being to associate the measure of separate use from engagement.

  • Step 4: The team links the engagement data to diverse/multiple outcomes; these need not be only efficacy goals or changes in symptoms.

This model aims to trace the transformation of usage data metrics into engagement metrics, and those engagement metrics into meaningful outcomes for digital health technology. By making explicit how engagement is defined and what it is doing, we can focus on its downstream impacts, namely improving outcomes for their intended users. This approach also focuses on mechanisms of action around how engagement may be acting, translating the fractured language of engagement today into more scientifically testable definitions that can guide future research. In allowing for different types of data, thresholds, considerations of engagement, specific biomarkers and resulting outcomes, the goal is to enable successful approaches to be shared, replicated and scaled. This approach enables any team or company to maintain their current definitions and metrics of engagement, but extends those metrics by placing them in the context of a process from raw data to clinical impact. This approach does not replace the need for hybrid implementation studies, but rather complements these by making engagement processes more tangible and transparent.

Data availability

Data availability is not applicable to this article as no new data were created or analysed in this study.

Acknowledgements

This paper is based on the discussion the authors had during a meeting which was held in Rome on 18 and 19 November 2024. The meeting was supported by Angelini Pharma. The sponsor did not have any influence on the content of the discussion, the outcome or the preparation of this manuscript.

Author contributions

All authors met in person to generate the themes and ideas behind the paper. J.T., A.C. and K.S. wrote the first draft. All authors edited, revised and approved the final draft.

Funding

This editorial received no specific grant from any funding agency, commercial or not-for-profit sectors.

Declaration of interest

No authors report a conflict of interest with the ideas in this editorial. E.G.O. and K.S. are members of the British Journal of Psychiatry editorial board, but they did not take part in the review or decision-making process of this paper.

References

Baumel, A, Muench, F, Edan, S, Kane, JM. Objective user engagement with mental health apps: systematic search and panel-based usage analysis. J Med Internet Res 2019; 21: e14567.CrossRefGoogle ScholarPubMed
Lattie, EG, Cohen, KA, Hersch, E, Williams, KD, Kruzan, KP, MacIver, C, et al. Uptake and effectiveness of a self-guided mobile app platform for college student mental health. Internet Intervent 2022; 27: 100493.CrossRefGoogle ScholarPubMed
Cho, PJ, Olaye, IM, Shandhi, MM, Daza, EJ, Foschini, L, Dunn, JP. Identification of key factors related to digital health observational study adherence and retention by data-driven approaches: an exploratory secondary analysis of two prospective longitudinal studies. Lancet Digit Health 2025; 7: e2334.CrossRefGoogle ScholarPubMed
Smith, KA, Ward, T, Lambe, S, Ostinelli, EG, Blease, C, Gant, T, et al. Engagement and attrition in digital mental health: current challenges and potential solutions. NPJ Digit Med 2025; 8: 398.CrossRefGoogle ScholarPubMed
Linardon, J, Xie, Q, Swords, C, Torous, J, Sun, S, Goldberg, SB. Methodological quality in randomised clinical trials of mental health apps: systematic review and longitudinal analysis. BMJ Ment Health 2025; 28: e301595.CrossRefGoogle ScholarPubMed
Torous, J, Linardon, J, Goldberg, SB, Sun, S, Bell, I, Nicholas, J, et al. The evolving field of digital mental health: current evidence and implementation issues for smartphone apps, generative artificial intelligence, and virtual reality. World Psychiatry 2025; 24: 156–74.CrossRefGoogle ScholarPubMed
Naderbagi, A, Loblay, V, Zahed, IU, Ekambareshwar, M, Poulsen, A, Song, YJ, et al. Cultural and contextual adaptation of digital health interventions: narrative review. J Med Internet Res 2024; 26: e55130.CrossRefGoogle ScholarPubMed
Smith, KA, Blease, C, Faurholt-Jepsen, M, Firth, J, Van Daele, T, Moreno, C, et al. Digital mental health: challenges and next steps. BMJ Ment Health 2023; 26: e300670.CrossRefGoogle ScholarPubMed
Lilienfeld, SO. Psychology’s replication crisis and the grant culture: righting the ship. Perspect Psychol Sci 2017; 12: 660–4.CrossRefGoogle ScholarPubMed
Figure 0

Fig. 1 A schematic of the four-step model.

This journal is not currently accepting new eletters.

eLetters

No eLetters have been published for this article.