How to Assess the Quality and Impact of Digital Health Tools by C Jakob et. al

Digital health tools, such as apps, websites, and wearable devices, have the potential to improve health outcomes, reduce costs, and enhance patient experience. However, not all digital health tools are created equal. Some may be ineffective, unsafe, or even harmful. How can we identify the best digital health tools for our needs and contexts?

A recent study published in npj Digital Medicine proposes a comprehensive and practical framework to assess the quality and impact of patient-facing digital health tools. The framework was developed and validated by an international and multidisciplinary expert panel, using a modified Delphi process. The framework consists of 46 criteria that cover both the technical and social aspects of digital health tools, as well as the contextual factors that influence their adoption and implementation.

The 46 criteria are classified into two categories: foundational and contextual. The foundational criteria focus on evaluating the digital health tool itself, regardless of the context in which it is used. They are grouped into nine clusters, such as technical aspects, clinical utility and safety, usability and human centricity, data management, and endorsement. The contextual criteria focus on evaluating the factors that vary depending on the context the tool is being evaluated for, such as data-protection compliance, interoperability and data integration, cultural requirements, affordability, cost-benefit, and implementability.

The framework is designed to be flexible and adaptable to different use cases and scenarios. For example, the framework can be used by clinicians, patients, payers, policymakers, investors, or tech providers to make informed decisions about which digital health tools to use, endorse, reimburse, invest in, or partner with. The framework can also be used to evaluate different types of digital health tools, such as self-management tools, remote monitoring tools, or decision support tools. Moreover, the framework can be tailored to different risk levels, user preferences, and assessment purposes.

The framework is not meant to be a one-size-fits-all solution, but rather a guide and a reference for conducting a comprehensive and rigorous assessment of digital health tools. The authors acknowledge that the framework may not capture all the possible criteria and dimensions that are relevant for digital health assessment, and that it may evolve over time as the field advances. Therefore, they invite feedback and collaboration from the digital health community to refine and improve the framework.

The study is part of an overarching research project that is jointly sponsored by F. Hoffmann-La Roche Ltd., KPT insurance, and Innosuisse (the Swiss Innovation Agency). The project aims to develop a practical toolbox for assessing digital health tools, based on the validated framework. The toolbox will include a web-based platform, a mobile app, and a chatbot that will help users conduct and report digital health assessments in an easy and user-friendly way.

If you are interested in learning more about the framework and the project, you can access the full article here: https://doi.org/10.1038/s41746-023-00982-w

You can also visit the project website here: https://ehealth-criteria-toolbox.net/

We hope that this framework and the upcoming toolbox will help you find and use the best digital health tools for your health and well-being.

‍