key: cord-0782766-56605x0r
authors: Aungst, Timothy; Seed, Sheila; Gobin, Nurisha; Jung, Rosa
title: The good, the bad, and the poorly designed: The mobile app stores are not a user-friendly experience for health and medical purposes
date: 2022-04-05
journal: Digit Health
DOI: 10.1177/20552076221090038
sha: 9830cacd0c08d1ac02845fcfc374b2660013e876
doc_id: 782766
cord_uid: 56605x0r

The utilization of mobile health applications to help manage health conditions have grown in utilization within the past decade. However, the application stores (i.e. Google and Apple) are not designed in a user-friendly manner that allows consumers to identify high-quality health and medical-related mobile applications. Researchers have been interested in identifying applications that may be recommended for patient care but have found the ability to quantify and assess these applications to be difficult due to the current layout and organization of applications. We explain here in this brief communication our own research experience in the identification of mobile health applications on the application stores, along with trends noted in other mobile health research, and make suggestions on how the application store experience could be improved for both patients and health professionals. These include collaboration between developers, medical professionals and organizations, and technology companies to facilitate a better means of categorizing health applications for patient use, alongside other current endeavors being pursued such as application review organizations and the creation of digital health formulary databases.

With over 85% of US adults owning a smartphone and one-in-five using a health tracker (e.g. smart watch or fitness tracker) we are witnessing an ever-growing dependance on the internet and mobile health (mHealth) applications (apps) to gather and track health information. [1] [2] [3] The coronavirus disease 2019 (COVID-19) pandemic has seen a growth in the utilization of these health apps, and a 40% increase in the use of mental health-related apps representing the social need for health services that are not readily accessed in person. 4 While the benefit of digital health technology has been found to be beneficial and creates new modalities for care, the consumerization of digital health solutions allows for possible exploitation or confusion. With over 300,000 health-related apps across both the Apple App Store and Google Play Store and over 10,000 behavioral health apps as an example, the ability for users to self-identify apps for utilization is overwhelming. 5 Researchers and clinicians have, over the past decade, attempted to alleviate this problem by conducting research into apps within different medical specialties to identify and evaluate apps for patient care. [6] [7] [8] [9] [10] [11] [12] [13] [14] [15] [16] [17] [18] [19] However, this work, while highly academic in nature, has revealed uncertainties in the mHealth space related to how to find quality mobile apps for health endeavors. To navigate these app stores and identify and appraise health apps is daunting and demonstrates the unfeasibility of providing an accessible repository for patients wishing to find apps on their own. We wish to bring this to attention, and this brief communication highlights our own experiences, and those of the larger medical community, and suggests a mechanism to help improve the app store experience.

Issues with searching the mobile app stores: researcher experiences and patient limitations

The current iteration of the Apple App Store and Google Play Store presents a user interface that is predicated on users perusing apps at their own leisure or having a preidentified app to download, such as a link provided by a company website. The experience of navigating these stores is mixed, as there is no systemic means of indexing or finding apps on the store, aside from preset categories (e.g. games, entertainment, productivity) or using general search terms.

Our own experience has demonstrated the frustrating nature of trying to find medically related apps with the current store design. We have endeavored to identify and assess the number of mobile apps available on the Apple and Google app stores related to the area of Travel Medicine. 20, 21 A previous investigation of ours evaluated the Apple App Store in 2015 and identified 897 apps with MeSH terms related to Travel Medicine (e.g. malaria, travel vaccinations). 22 Of those, only 44 apps were deemed relevant to travel medicine. Since that time, we expanded our search into the Google Play Store (2018), where we identified 3740 apps related to Travel Medicine. We examined each of the 3638 apps (after removing duplicates) to determine which were medically relevant, which proved to be a tedious process. In addition, we reevaluated the Apple App Store and found a change in the mechanism of how apps were organized in 3 years since our initial research. After analysis of the apps, we found a large percentage to be completely unrelated to the search term and had no medical relevance. For example, in one search, the MeSH term "Malaria Plasmodium Vivax" generated apps with no medical implication.

While our difficulties may stem from the narrow field and availability of apps focused on Travel Medicine, it has been a trend noted in other studies identifying and evaluating apps in other therapeutic areas, as can be seen in Table 1 . Researchers continue to search through hundreds to thousands of apps just to identify a small percentage worth evaluating. Examining the studies in Table 1 , it was common for investigators to review hundreds of apps only to select a small sample to utilize in their assessment. While this is not an all-inclusive list of research in the medical app space, their methodology can be applied across any specialty. This entails spending time going through each store to evaluate apps based on using search terminology related to said medical specialty and evaluating in-store descriptions to determine relevance. While those researchers have commented on the limitations and struggles of searching app stores and identification of apps, they do not list the labor and time that is dedicated for a team to conduct these searches. Even among our small team of researchers, the time invested has been significant, which includes factoring in time spent searching, collecting information, navigating developers' websites, documenting app data, and finally screening them; and this does not even include the time dedicated to evaluating the individual apps screened for clinical utilization.

In comparison to the methodological dilemma facing researchers hoping to identify and review mobile health apps related to a therapeutic area, it can be extrapolated that the patient experience must be equally as problematic.

Taking into account issues such as limited app descriptions, app costs, and medical literacy, it can be surmised to be a daunting experience for patients just to determine what app to download and try. 15, 23, 24 A limited number of studies have investigated such patient experiences and have found that while there is a high interest in using apps in their health, there remains a question on long-term utilization. [25] [26] [27] [28] [29] This may be best encapsulated by the fact that users of apps tend to stop using apps after only several days or weeks, which may represent the trialing period patients spend exploring an app before deciding to move onto another one. For patients to self-discover apps to manage their health and determine the best fit is a burden that has yet to be addressed and may be an impediment to large-scale adoption at this time.

What can be done to improve the current mobile health app marketplace?

Currently, there is no gold standard in the best approach to guide patients on what health apps to use for their care. Researchers and clinicians have offered sporadic recommendations, though these are limited in scope and usability for the time period when their research was performed. Based upon the author's knowledge, several approaches have been implemented or are under investigation, as outlined in Table 2 , which may have a more scalable impact. These are not new ideas, and past endeavors have had their failures. These models may be a viable means due to the numerous apps available at this time. [30] [31] [32] While the current emphasis has been placed on nonprofits or organizations to navigate the mobile app marketplace and identify and evaluate apps, we believe that other actions can be taken by tech companies and developers to amend some of the issues identified. An important point to make is that it is not feasible for these tech companies to recommend apps for patients for medical solutions, which is better left to a provider who knows their patient. As such, tech companies will likely remain the "host" for the repository of apps, but it should not exclude them from responsibility. 100 apps total in both iOS and Android 25 free and 25 paid in each operating system Three apps were excluded from the study due to their non-medical nature. One app was not selected due to its high price and two others were excluded because they were essentially a mini store of apps. Imposing stricter filters and restrictions on apps generated from search terms could eliminate as much of the "junk" apps as possible. For example, an advanced search function would be beneficial for patients searching for specific apps within certain medical categories (e.g. heart disease, diabetes, mental health) or features (e.g. symptom tracker, telehealth feature). A tagging system for specialties or medical purposes could also be accomplished, similar to how the app store breaks down games into different types (e.g. sports, strategy). Lastly, a means to report potentially inappropriate medical apps may be a means to help the encumbered system and reduce the number of low-quality or dubious health apps available. This can help remove many junk apps and allow better curation. Lastly, transparency on how medical apps are reviewed or uploaded to the store may help foster a better process to avoid problematic apps from being available. This was seen in the COVID-19 pandemic where apps were removed from the store by Apple and Google based on concerns on the accuracy of information presented to the public, though the process may have been nebulous and uncertain if this will continue in the future. 33 We would recommend collaboration between app stores, developers, and medical organizations that may serve as a means to mitigate such issues and help improve the overall experience. In this way, we are ensuring that users not only have accurate information on hand but also it eliminates the difficulty of finding accurate information no matter what type of app store they are using. This becomes even more paramount that the app store evolves in this process, given the large push within digital health to foster the growth of the nascent digital medicine and digital therapeutics space. 34 Taking into consideration that many products are now undergoing clinical research to demonstrate their effectiveness in disease management and treatment, they stand above the current myriad apps focused on general health and wellness. [35] [36] [37] How then could a patient identify an app that may help with their sleep versus treat insomnia for instance? Factoring in those, providers are now prescribing such apps and payors are covering them for patient care, allowing an easier process of access to these apps is needed. If nothing less, tech companies that partner with other health organizations with a vested interest in digital health may allow some expertise to craft a means of delineating how to categorize apps for better patient access. If not, providers and patients will ultimately have to turn to other organizations to provide a means of determining app categorization and tools to navigate the app store. This in turn could be a fragmented approach with some companies or groups only covering certain areas (e.g. psychology, endocrinology) and thus pose a barrier to those patients with multiple co-morbidities.

Mobile app stores are now the primary means for patients to access digital health products and services. However, app stores are inherently designed poorly and limit the effectiveness of patients and clinicians to actively identify and utilize such apps without using outside resources. These limitations will continue to hamper digital health endeavors, especially as a push for evidence-based prescribable apps come to the fore. Alternative mechanisms for providers to recommend for patients will likely make large strives unless changes are made to the medical app environment. This can be rectified by better collaboration amongst multiple stakeholders to improve design and utilization for current and future patient needs.

Guarantor: TDA ORCID iD: Timothy Aungst https://orcid.org/0000-0002-6914-0218 Table 2 . Frameworks to provide providers with high-quality mobile health apps.

Evaluation Websites Online websites run by clinicians or related health professionals that review mobile health apps based on their internal editorial processes iMedicalApps.com, Digital.Health

Organizations that select and review apps to disseminate to others. May be sponsored by medical organization or separate business entity. May work directly within an electronic health record (EHR) platform for "prescription" by a patient provider. Services often provided to outside organizations for a fee.

Express Scripts*, Orcha Health, App Script by IQVIA Xealth, Rx.Health National Formulary A national organization focused on identifying and evaluating apps for their providers to recommend.

Formal Guidelines Collaboration between medical societies and others to create a framework for best practices to review medical apps.

Task forces part of medical or health organizations seeking to evaluate mobile medical apps within certain conditions or medical specialties.

World Health Organizations, American Psychiatric Association *Work still in process.

Mobile Fact Sheet. Pew research center. Last updated

About one in five Americans use a smart watch or fitness tracker. Pew Research Center

Studying health-related internet and mobile device use using web logs and smartphone records

COVID-19: Digital Health Trends & Opportunities for 2021

By the numbers: ratings and utilization of behavioral health mobile applications

A crosssectional study of prominent US Mobile health applications: evaluating the current landscape

Ehealth tools for the selftesting of visual acuity: a scoping review

Behavior change content, understandability, and actionability of chronic condition self-management apps available in France: systematic search and evaluation

Mobile apps in rheumatology: review and analysis using the Mobile application rating scale (MARS)

Mobile health applications for atrial fibrillation: a readability and quality assessment

Using science to sell apps: evaluation of mental health app store quality claims

Mobile applications for pain management: an app analysis for clinical usage

Mobile health tools for the management of chronic respiratory diseases

Evaluation of Mobile apps targeted to parents of infants in the neonatal intensive care unit: systematic app review

Patients' and Nephrologists' evaluation of patient-facing smartphone apps for CKD

Mobile applications in neurosurgery: a systematic review, quality audit, and survey of Canadian neurosurgery residents

Mobile apps for the care management of chronic kidney and End-stage renal diseases: systematic search in app stores and evaluation

Characteristics and quality of genetics and genomics mobile apps: a systematic review

Medical correctness and user friendliness of available apps for cardiopulmonary resuscitation: systematic search combined with guideline adherence and usability evaluation

Travel medicine: what's Involved? When to refer?

Identification and review of mobile applications for travel medicine practitioners and patients

Patient perspective of smartphone-based apps for CKD self-care

Users' acceptability of a mobile application for persons with type 2 diabetes: a qualitative study

Adoption of Mobile apps for depression and anxiety: cross-sectional survey study on patient interest and barriers to engagement

The use of smartphone health apps and other mobile health (mHealth) technologies in dietetic practice: a three country study

Effectiveness of Mobile health application use to improve health behavior changes: a systematic review of randomized controlled trials

Mobile health divide between clinicians and patients in cancer care: results from a cross-sectional international survey

Effect of self-monitoring on long-term patient engagement with mobile health applications

The rise and fall of happtique, mHealth's First app prescribing platform. HIStalk Connect

Un'appy times -the challenges facing the NHS app. Digitalhealth. February

Apple is rejecting coronavirus apps that aren't from health organizations, app makers say

The Digital Therapeutics Alliance

Decision makers need an approach to determine digital therapeutic product quality, access, and appropriate use

The impact of digital therapeutics on current health technology assessment frameworks. Front Digit Health

Changing face of healthcare: digital therapeutics in the management of diabetes