key: cord-1053550-4aitb807
authors: Hyland, Colby J.; Guo, Ruby; Dhawan, Ravi; Kaur, Manraj N.; Bain, Paul A.; Edelen, Maria O.; Pusic, Andrea L.
title: Implementing patient-reported outcomes in routine clinical care for diverse and underrepresented patients in the United States
date: 2022-03-07
journal: J Patient Rep Outcomes
DOI: 10.1186/s41687-022-00428-z
sha: 9c270f083c40489b9931556ce00dbae9db25c5f0
doc_id: 1053550
cord_uid: 4aitb807

BACKGROUND: Patient-reported outcomes (PROs) are used increasingly in routine clinical care and inform policies, reimbursements, and quality improvement. Less is known regarding PRO implementation in routine clinical care for diverse and underrepresented patient populations. OBJECTIVE: This review aims to identify studies of PRO implementation in diverse and underrepresented patient populations, elucidate representation of clinical specialties, assess implementation outcomes, and synthesize patient needs, concerns, and preferences. METHODS: MEDLINE, Embase, Web of Science, CINAHL, and PsycINFO were searched September 2021 for studies aiming to study PRO implementation in diverse and underrepresented patient populations within the United States. Studies were screened and data extracted by three independent reviewers. Implementation outcomes were assessed according to Proctor et al. taxonomy. A descriptive analysis of data was conducted. RESULTS: The search yielded 8,687 records, and 28 studies met inclusion criteria. The majority were observational cohort studies (n = 21, 75%) and conducted in primary care (n = 10, 36%). Most studies included majority female (n = 19, 68%) and non-White populations (n = 15, 54%), while fewer reported socioeconomic (n = 11, 39%) or insurance status (n = 9, 32.1%). Most studies assessed implementation outcomes of feasibility (n = 27, 96%) and acceptability (n = 19, 68%); costs (n = 3, 11%), penetration (n = 1, 4%), and sustainability (n = 1, 4%) were infrequently assessed. CONCLUSION: PRO implementation in routine clinical care for diverse and underrepresented patient populations is generally feasible and acceptable. Research is lacking in key clinical specialties. Further work is needed to understand how health disparities drive PRO implementation outcomes. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s41687-022-00428-z.

Patient-reported outcomes (PROs) allow clinicians and researchers to better understand patients' perceptions of their health, goals, treatment, and healthcare experiences across different domains, such as physical, mental, and social well-being [1, 2] . Patient-reported outcome measures (PROMs) are tools used to measure PROs in various disease contexts. Ideally PROMs are rigorously tested and validated. While many PROMs were developed for use in clinical trials [3] , the use of PROMs in routine clinical care has become more widespread and has been shown to improve symptom control, supportive care measures, patient satisfaction, and health outcomes [4, 5] . In addition, there is increasing demand from healthcare payors, regulators, and administrators to incorporate PROs into routine clinical care for quality improvement and reimbursement purposes [6, 7] .

Several logistical challenges regarding the implementation of PRO data collection into routine clinical practice have been noted, such as selection of appropriate and relevant PROMs, adequate staffing and data resources, patient compliance, and non-integration with electronic health records [6, [8] [9] [10] . However, an additional concern is ensuring equitable PRO implementation, such that PROs capture diverse and underrepresented patient populations [6, 11] .

Given the current landscape of biomedical research, where less than 2% of 10,000 clinical trials included sufficient numbers of minority participants in one 2015 report [12] , for example, it is unlikely that PRO implementation research would be immune to these issues of health equity and healthcare disparities in clinical research. PRO implementation in routine clinical care has been documented to have low adoption nationwide [13] , which may further impede efforts to capture diverse populations. Additionally, reporting of certain factors such as race and ethnicity in clinical trials has not been widespread [14] .

Routine PRO data collection is therefore likely predominant in White, higher socioeconomic, and Englishspeaking populations [15] . This is further supported by a systematic review of PRO implementation in routine care for patients with breast cancer, in which only 2 of 34 identified studies targeted minority patient populations [16] and a study of PRO implementation in integrative medicine, in which the majority of patients were White and had commercial insurance [17] . In addition, clinical PRO implementation studies have identified disparate response rates for many diverse and underrepresented populations across clinical specialties [18] [19] [20] [21] .

The lack of participation of certain patient populations in PRO data collection is concerning in light of a growing body of evidence demonstrating disparities in PROs among diverse and underrepresented patient populations. For example, PROs were significantly associated with race, education, and neighborhood poverty in a study of hip and knee arthroplasty [22] , and lower income families experienced higher symptom burden and worse quality of life in a pediatric oncology study [23] . As the demand for PRO implementation in routine clinical care grows, it will therefore be critical to collect PROs from diverse and underrepresented patient populations to ensure representative sampling and reduce health disparities [24] .

However, there is presently a limited understanding of the landscape of PRO implementation in these populations. This study therefore aims to review the literature to determine what is presently known regarding implementation of PROs in routine clinical care for diverse and underrepresented populations. The primary aim of this review is to characterize PRO implementation in routine clinical care, in terms of patient populations studied and clinical specialties that have evaluated PRO implementation. The secondary aims of this review are to analyze implementation outcomes and populationspecific concerns, needs, and preferences regarding PRO collection. We believe that the review will advance our Plain English summary Patient-reported outcomes (PROs) allow doctors and researchers to understand the patient perspective, such as how they are doing physically, mentally, or socially. When used, PROs can improve health and increase satisfaction of patients. Many clinics and hospitals are interested in using PROs in everyday care. Doctors, hospitals, and insurance companies are also using information from PROs to decide if the care they give is good quality. Unfortunately, certain groups of patients, such as racial and ethnic minorities and patients with low income, report worse PROs. Because of these differences, it will be important to make sure that PROs are being collected from all people, but not much is known regarding how this has been done. This study demonstrates what is known so far with regard to using PROs in everyday clinical care for these diverse patient groups. Findings from this study show that PROs can be successfully collected, but more work is needed in certain medical fields, and some types of patients have specific needs, concerns, or preferences with regard to PRO collection.

Given the lack of knowledge regarding available evidence and breadth of coverage of PRO implementation in diverse and underrepresented populations across clinical specialties, a scoping review methodology was adopted for this study. Per guidance by Munn et al. [25] , a scoping review enables determination of the studies available and overall focus of a research area, aligning with this study's aims to identify the landscape of available studies, populations and clinical specialties represented, and implementation outcomes evaluated to date. The review was conducted in accordance with the Joanna Briggs Institute (JBI) methodology for scoping reviews [26] .

Studies were identified by searching the following electronic databases: MEDLINE (Ovid), Embase (Elsevier), Web of Science Core Collection (Clarivate Analytics), Cumulative Index to Nursing and Allied Health Literature (CINAHL: EBSCO), and PsycINFO (EBSCO). Searches were conducted between September 23 and 27, 2021. No date restriction was applied. The terms used to search each database were informed by previously published systematic reviews investigating PRO implementation in routine clinical care [16, 27, 28] , as opposed to PROs used as evaluative assessments only for interventions in clinical trials, and relevant MeSH terms related to health disparities or diverse and underrepresented populations known to be affected by healthcare disparities [29] . The search was designed and conducted by a medical librarian with expertise in systematic and scoping reviews (PAB). Search strategy for the included databases is provided in the Additional file 1: Table S1 .

Studies were compiled into the Covidence (Veritas Health Innovation) citation manager. First, abstracts and titles were screened by three independent reviewers (CJH, RG, RD) using inclusion and exclusion criteria. Full texts were then reviewed by three independent reviewers (CJH, RG, RD) to determine whether studies met inclusion criteria. Disagreements at each phase were resolved through discussion among the three reviewers.

Inclusion criteria were studies that (1) assessed PRO implementation in routine clinical care, (2) had a specific and explicit aim of studying PRO implementation in diverse or underrepresented populations, such as racial or ethnic minorities, sexual and gender minorities, elderly or geriatric populations ≥ 65 years of age, and populations with diverse literacy, educational, socioeconomic or geographic (rural or urban) status, (3) used a validated PROM, and (4) English language. Studies were limited to those conducted in the United States because diverse and underrepresented populations are in part defined by the specific historical, economic, and cultural contexts of their country of origin, as detailed in a previously published review [30] . In addition, certain sociodemographic factors such as insurance status and results concerning routine clinical care and PRO collection would be more generalizable to the unique healthcare system within the United States. Studies that focused on the development, creation, and/or validation of PROMs; use of PROMs as an outcome measure for some other primary intervention; and case reports, study protocols, editorials, dissertations, conference abstracts, and these were excluded. Citations within review articles from the search were manually reviewed to identify additional primary studies that met inclusion criteria. Results of the search as well as inclusion and exclusion of studies are reported according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses for Scoping Reviews (PRISMA-ScR) flow diagram (Fig. 1 ) [31] .

Data from relevant studies were extracted into an a priori defined form by three reviewers (CJH, RG, RD), including study aims, sample size and demographics, geographic location of study settings, type of study setting, clinical specialty, validated PROM used, study limitations, if technology was used and type, and implementation outcomes. Implementation outcomes were categorized according to previously defined conceptual distinctions for implementation research: acceptability, adoption, appropriateness, costs, feasibility, fidelity, penetration, and sustainability [32] . These categorizations have been further refined for evaluation of technological interventions in healthcare [33] and have been used in previously published reviews of PRO implementation [28] . The quality and level of evidence (1-7) of studies were determined based on previously developed criteria by Melnyk et al., where level 1 corresponds to the highest quality evidence (systematic reviews, meta-analyses of randomized controlled trials, etc.) [34, 35] .

The electronic database search yielded 8,687 records, and 1 record was identified through a review article known to study authors [16] . After duplicates were removed, the titles and abstracts of 4,452 records were each screened in duplicate according to pre-defined inclusion criteria (agreement > 95%). After screening these records, a total of 76 full-text articles were reviewed, of which 55 were excluded. Manual review of bibliographies from review articles identified in the search yielded an additional 7 studies that met inclusion criteria. A total of 28 studies were included in the analysis (Fig. 1 ).

The aims, quality, and general characteristics of studies are included in Table 1 . Most studies were observational cohort studies with level 4 evidence (n = 21, 75%), followed by level 2 randomized controlled studies (n = 5, 17.9%), and level 6 qualitative studies (n = 2, 7.1%). Sample sizes within studies ranged from 10 [36] to 6454 [37] . Primary care was the most common specialty represented (n = 10, 35.7%) [11, 36, [38] [39] [40] [41] [42] [43] [44] [45] , followed by oncology (n = 4, 21.4%) [46] [47] [48] [49] [50] [51] , of which two studies were specific to breast oncology [46, 47] and two studies were specific to urologic/radiation oncology [49, 50] . Remaining specialties included rheumatology [52] [53] [54] [55] (n = 4, 14.3%), psychology/psychiatry [56] [57] [58] (n = 3, 10.7%), and one study each (3.6%) for neurology [37] , geriatrics [59] , trauma [60] , home health care [61] , and orthopedic hand surgery [62] .

The demographics and characteristics of study populations are detailed in Table 2 . Most included a study population that was majority female (n = 19, 67.9%) compared to majority male (n = 3, 10.7%). Some studies reported multiple samples with variable gender majorities (n = 4, 14.3%) or did not report gender (n = 2, 7.1%). Most studies (n = 15, 53.6%) included majority non-White populations and reported educational attainment and/or literacy (n = 19, 67.9%). In contrast, most studies did not report income or employment status (n = 17, 60.7%) or insurance status (n = 19, 67.9%). For studies that reported participants' age, the age range among studies was 26.7 to 75.9 years. The majority of studies (n = 23, 82.1%) used electronic PRO (ePRO) data collection.

Implementation outcomes are detailed in Table 3 . Most studies evaluated feasibility (n = 27, 96.4%), followed by acceptability (n = 19, 67.9%), adoption (n = 18, Shipp et al. [62] n/a n/a n/a n/a n/a n/a Fewer assessed time needed to complete PRO assessments (n = 7, 25%) or impact on clinic workflows, such as the need for staff assistance in PRO completion or work burden (n = 7, 25%). Of those assessing adoption, few reported patients' intention to try the studied PRO collection method again or in another setting (n = 3, 10.7%) and one reported clinicians' intention to adopt new PRO technology in practice [53] . Of the three studies that assessed costs, none assessed cost-effectiveness. With regard to the one study assessing penetration and sustainability, the number of providers interfacing with the PRO system increased over time and the program was able to be maintained over a 5-year study period [40] .

Overall concerns, needs, and preferences were abstracted from studies and detailed in Table 4 . Among the concerns were disparities in PRO completion among racial and ethnic minorities [11, 38, 50, 62] , Spanish-speaking patients [11] , populations with low income/employment status and low educational or health literacy [62] , and elderly or geriatric populations [11, 38, 62] . Needs among populations included additional help in completing surveys among patients with low income/education [55] and a suggestion for a tutorial video for ePRO use among elderly patients [59] . Preferences among populations included a higher likelihood of Black patients selecting automated telephone over web-based surveys [49, 50] , conflicting results of Spanish-speaking patients preferring face-to-face interviews vs. electronic data collection [43] [44] [45] , symptom report display using bar graphs with "emojis" for low health literacy, majority Black patients [41] , and preference for using a finger over stylus for tablet-based PRO collection in elderly patients [61] .

This review synthesizes studies to date that have explicitly aimed to evaluate PRO implementation in routine clinical care for diverse and underrepresented patient populations in the United States across all clinical specialties, thereby taking an important step in furthering our understanding in this area. Given growing demands for routine clinical PRO collection, this review specifically evaluated study quality, demographics, implementation outcomes, and patient perspectives in order to inform existing and emerging PRO programs as well as to identify areas requiring further research. This review demonstrated that relatively few highquality studies such as randomized-controlled trials have been conducted. In addition, studies are not representative of all clinical specialties and skew predominately toward primary care settings. In particular, there was a paucity of studies conducted in surgical, obstetric, and pediatric settings. While this may be partly explained by pre-existing disparities in access to and quality of care in these settings [63] [64] [65] [66] , it will be important to study PRO implementation across the entirety of the healthcare spectrum with particular attention to those presently unrepresented in research to date.

In recent years, several health information technology interventions have been developed to better facilitate electronic PRO (ePRO) implementation, such as web-based platforms, tablets, and mobile applications. While concerns have been raised, given that there are disparities in smartphone and tablet computer ownership as well as internet access [67] , our study highlights that ePRO collection is widely acceptable and feasible among diverse and underrepresented patient populations. While some studies suggested that face-to-face PRO collection may be preferred by certain populations (e.g., primarily Spanishspeaking individuals [43, 44] ), another study conducted in a similar population demonstrated preference for computerized data collection [45] . Moreover, these studies were published over 20 years ago and may not be representative of populations today that have had more time to adjust to new technologies. This is supported by recent research showing that reliance on smartphones for internet access has become increasingly more common among Americans with lower socioeconomic status as well as racial and ethnic minority populations [67] . However, relying on ePROs alone may not be sufficient to maintain equitable PRO collection, as evidenced by one report demonstrating profound racial and ethnic disparities when transitioning from tablet-based to web-based PRO collection [68] . Our study highlights several key findings regarding the unique needs and concerns of populations in various clinical settings using ePROs, such as inclusion of bar graphs with "emojis" for symptom reports [41] or touchscreens with visual and audio components, for example [48] . This not only emphasizes the need for further research in these populations, but also suggests that programs would likely benefit from specifically tailoring ePROs to the populations they serve. 

Concerns: Older patients less likely than younger patients (mean 57) to be able to complete a touch-screen enabled computer-assisted self-interview [38] Older patients less likely than patients aged 18-64 to complete PROMs [11] Late responses to web-based PRO platform associated with older age [62] Among elderly patients using smartphone-based PROs, there was a discrepancy between perceived vs. actual survey completion adherence [57] Needs: Self-administered web-based collection system for elderly patients required little assistance from staff [56] Older, majority Black, low-income hemodialysis patients found iPad-based PROs easy to use, but desired a tutorial video [59] Preferences: Older patients in home health care settings found tablet-based PRO collection easy to use with a preference for using finger over stylus [61] Other: Smartphone-based PROs successful among elderly patients [57] Sexual and gender minority populations Concerns: n/a Needs: n/a Preferences: ePRO collection was appreciated by a > 50% LGBTQ clinic population [40] Other: ePRO collection made participants of a > 50% LGBTQ clinic population feel that they more direct participants in their care [40] Notably, the least studied implementation outcomes in studies to date were penetration and sustainability. While it is still helpful to understand elements of PRO implementation such as acceptability and feasibility in the shortterm, it is evident that less is known regarding longer-term and institution-wide outcomes of these interventions. This is problematic, given that PRO implementation programs can require additional staffing and data resources [8, 10] , which may be prohibitive for low-resourced settings where many diverse and underrepresented populations receive care, especially outside of short-term, intensive study settings. As evidenced by the 5-year study period in the one study in this review with sustainability and penetration outcomes [40] , another potential barrier to studying these outcomes is the time needed for longer, prospective studies. Bolstering partnerships between higher-resourced academic centers with existing PRO programs and lowerresourced settings may therefore provide one solution.

Moreover, cost was another infrequently assessed outcome. Consequently, cost-effectiveness data of PRO implementation was largely missing. Alongside staffing and data resource concerns, the cost of PRO implementation may preclude implementation in resource-constrained settings where many diverse and underrepresented populations receive care. While one study reported on the ability to maintain long-term costs [40] , the financial requirements and impacts of PRO implementation for diverse and underrepresented populations remains largely to be determined. Nonetheless, the reduction of healthcare disparities itself has been estimated to substantially reduce healthcare spending [69, 70] . With the aim of reducing disparities through these implementation programs, cost data will also be helpful in further characterizing the cost-effectiveness and healthcare value of routine PRO collection.

While the studies within this analysis elucidated important findings within underrepresented patient populations, it is important to note that more work is needed to elucidate which specific determinants of health within populations drive certain outcomes as well as the way in which identities and social determinants intersect [71] . Most studies, for example, reported racial and ethnic demographics of their study sample, however much fewer reported income, employment, and insurance status. This is problematic, given that racial or ethnic minority outcomes may be confounded by other unreported social factors, such as low income or unemployment. In addition, results and data analysis were often stratified by race or ethnic minority status alone, without delving deeper into the specific social determinants of health (i.e. transportation, perceived and actual racism, work environments). As such, future work evaluating implementation within these populations should more deeply investigate how social determinants of health drive disparate acceptability, adoption, or feasibility outcomes, for example.

Our study had some limitations. First, studies were limited to the United States in order to increase generalizability of results, given that diverse and underrepresented populations are defined in part by the history, demographics, culture, and economy of their country of origin. Although international studies such as those investigating routine PRO collection in rural Australia [72] , use of robots for routine PRO collection among elderly adults in the Netherlands [73] , and ePRO collection among a diverse, urban clinic population living with HIV in Canada [74] may have relevant and generalizable findings for clinical environments in the United States, we deemed these beyond the scope of this review. However, the narrower scope of this review allowed for greater specificity of findings for certain populations, such as Black Americans and non-English-speaking populations, within the unique context of PRO programs in the United States. Second, we only included studies that had a specific and explicit aim of studying PRO implementation in a diverse and/or underrepresented population. There is a possibility that studies investigating clinical PRO implementation more broadly had potentially relevant incidental findings for these populations, however this review importantly highlights studies that fill critical gaps in the literature by intentionally aiming to study these populations. In addition, this review studied diverse populations known to be affected by healthcare disparities in the United States. Third, our study focused on the implementation of already developed and validated PROMs. Addressing disparities in PRO data collection will also require equitable PROM development, testing, and validation within diverse and underrepresented populations before implementation occurs [15] .

As existing healthcare systems expand and new systems develop PRO data collection programs, it will be imperative to ensure that PRO data collection is not only representative of all patients but also equitable in its implementation in routine clinical care [15] . While this study highlights several important considerations for PRO implementation in diverse and underrepresented populations, it simultaneously calls attention to the paucity of research in this area to date. Future studies of PRO implementation will be needed across the healthcare spectrum in order to address existing disparities and promote health equity alike.

Abbreviations PRO: Patient-reported outcome; PROM: Patient-reported outcome measure; CINAHL: Cumulative Index to Nursing and Allied Health Literature; ePRO: Electronic patient-reported outcome; PRISMA-ScR: Preferred Reporting Items for Systematic Reviews and Meta-analyses for Scoping Reviews.

Impact of patient-reported outcome measures on routine practice: a structured review

Incorporating patient-reported outcomes into health care to engage patients and enhance care

Patientreported outcomes (PROs): the significance of using humanistic measures in clinical trial and clinical practice

Does providing feedback on patientreported outcomes to healthcare professionals result in better outcomes for patients? A systematic review

What is the value of the routine use of patientreported outcome measures toward improvement of patient outcomes, processes of care, and health service outcomes in cancer care? A systematic review of controlled trials

Patient reported outcomes measures in gynecologic oncology: a primer for clinical use, part I

The role of patient-reported outcome measures in value-based payment reform

Implementing patient-reported outcomes assessment in clinical practice: a review of the options and considerations

Use of patient-reported outcome measures in quality oncology practice initiative-registered practices: results of a national survey

Barriers and benefits to the use of patientreported outcome measures in routine clinical care: a qualitative study

Implementation of the PROMIS-29 in routine care for people with diabetes: challenges and opportunities

Diversity in clinical and biomedical research: a promise yet to be fulfilled

Patient-reported outcomes -harnessing patients' voices to improve clinical care

Reporting and analyzing race and ethnicity in orthopaedic clinical trials: a systematic review

Prioritizing health equity in patient-reported outcome measurement to improve surgical care

Implementing patient-reported outcome measures in clinical breast cancer care: a systematic review

Rationale for routine collection of patient reported outcomes during integrative medicine consultation visits

Nonresponse bias in survey research: lessons from a prospective study of breast reconstruction

Implementing electronic health record-integrated screening of patient-reported symptoms and supportive care needs in a comprehensive cancer center

Assessing disease experience across the life span for individuals with osteogenesis imperfecta: challenges and opportunities for patient-reported outcomes (PROs) measurement: a pilot study

Centralized patient-reported outcome data collection in transplantation is feasible and clinically meaningful

Social determinants of health and patient-reported outcomes following total hip and knee arthroplasty in veterans

The relationship between household income and patient-reported symptom distress and quality of life in children with advanced cancer: a report from the PediQUEST study

What are health disparities and health equity? We need to be clear

Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach

JBI manual for evidence synthesis

Patient-reported outcomes in routine cancer clinical practice: a scoping review of use, impact on health outcomes, and implementation factors

A review of PROM implementation in surgical practice

Department of Health and Human Services (2021) Disparities HealthyPeople

Healthcare disparities in laryngology: a scoping review

PRISMA Extension for Scoping Reviews (PRISMA-ScR): checklist and explanation

Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda

Measuring the implementation of behavioral intervention technologies: recharacterization of established outcomes

Melnyk levels of evidence

Evidence-based practice in nursing & healthcare: a guide to best practice

Design and comprehension testing of tailored asthma control infographics for adults with persistent asthma

Association between patient experience with patient-reported outcome measurements and overall satisfaction with care in neurology

Health perceptions and symptom burden in primary care: measuring health using audio computer-assisted selfinterviews

Changes in patient-reported outcome measures with a technology-supported behavioral lifestyle intervention among patients with type 2 diabetes: pilot randomized controlled clinical trial

Capturing relevant patient data in clinical encounters through integration of an electronic patient-reported outcome system into routine primary care in a Boston community health center: development and implementation study

Patient preferences for visualization of longitudinal patient-reported outcomes data

Usability of commercially available mobile applications for diverse patients

Bilingual computerized speech-recognition screening for clinical depression: evaluating a cellular telephone prototype

A bilingual telephone-enabled speech recognition application for screening depression symptoms

Automated screening for depression: toward culturally and linguistically appropriate uses of computerized speech recognition

THRIVE intervention development: using participatory action research principles to guide a mHealth app-based intervention to improve oncology care

Automated pain intervention for underserved minority women with breast cancer

The talking touchscreen: a new approach to outcomes assessment in low literacy

Racial differences in user experiences and perceived value of electronic symptom monitoring in a cohort of black and white bladder and prostate cancer patients

Feasibility and delivery of patient-reported outcomes in clinical practice among racially diverse bladder and prostate cancer patients

Using a geriatric oncology assessment to link with services (GOAL)

Feasibility, validity, and reliability of the 10-item patient reported outcomes measurement information system global health short form in outpatients with systemic lupus erythematosus

Patient and clinician perspectives on a patient-facing dashboard that visualizes patient reported outcomes in rheumatoid arthritis

Validity and responsiveness of a 10-item patientreported measure of physical function in a rheumatoid arthritis clinic population

Limited health literacy and patient confusion about rheumatoid arthritis patient global assessments and model disease states

Feasibility and validation of a web-based platform for the self-administered patient collection of demographics, health status, anxiety, depression, and cognition in community dwelling elderly

Feasibility and acceptability of smartphone assessment in older adults with cognitive and emotional difficulties

A clinical trial comparing interviewer and computer-assisted assessment among clients with severe mental illness

Rapid electronic capturing of patient-reported outcome measures in older adults with end-stage renal disease: a feasibility study

The feasibility and acceptability of mobile health monitoring for real-time assessment of traumatic injury outcomes

Feasibility testing of health information technology: enabled patient-reported outcome measurement in the home health setting

Disparities limit the effect and benefit of a web-based clinic intake system

Access to common laparoscopic general surgical procedures: do racial disparities exist?

Disparities in access to autologous breast reconstruction

Quality of care and disparities in obstetrics

The impact of social determinants of health on children with asthma

Mobile fact sheet

Digital disparities: lessons learned from a patient reported outcomes program during the COVID-19 pandemic

Estimating the economic burden of racial health inequalities in the United States

The economic benefits of reducing racial disparities in health: the case of minnesota

The social determinants of health: it's time to consider the causes of the causes

Does routine psychological screening of newly diagnosed rural cancer patients lead to better patient outcomes? Results of a pilot study

Robot for health data acquisition among older adults: a pilot randomised controlled cross-over trial

Feasibility of implementing a same-day electronic screening tool for clinical assessment to measure patient-reported outcomes for eliciting actionable information on adherence to HIV medication and related factors in a busy Canadian urban HIV clinic

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations

Not applicable.

 Table 4 Overall concerns, needs, and preferences of populations identified in the review

Concerns: Non-Hispanic Black patients less likely than Hispanic, non-Hispanic White, and non-Hispanic Asian patients to be able to complete a touch-screen enabled computer-assisted self-interview [38] Non-Hispanic black patients more likely and Hispanic patients who preferred Spanish less likely to complete PROMs than Non-Hispanic White patients who speak English [11] Late responses to web-based PRO platform associated with racial/ethnic minorites [62] Black patients less likely than White patients to complete tablet-based PRO [50] Low income, limited health literacy, majority Black patients had more difficulty with PRO data retrieval than data completion within commercially available mobile apps on iPhones and Androids [42] Needs: n/a Preferences: No race-based preferences for web-based app content or features [46] Black patients were more likely than White patients to select automated telephone surveys, although web-based delivery was most common overall; Black patients had greater difficulty understanding questions and the summary report than White patients [49] Higher proportion of Black vs. White patients preferred telephone-based survey formats [50] Other: Mobile health PROs and health monitoring successful among low income, majority Black trauma survivors [60] Mobile health PROs successful among rural, traditionally underserved, majority Black patients with diabetes [39] Non-White patients were more satisfied than White patients with their care as a result of PROM collection [37] Interactive voice response system deemed feasible and improved symptom severity among majority unemployed African American and Latina patients [47] Non-English-speaking populationsConcerns: Spanish-language groups found longitudinal PRO outcome data more difficult to understand than English-language groups [53] Hispanic patients who preferred Spanish less likely than Hispanic patients who preferred English to complete PROMs [11] Needs: Spanish-language groups did not anticipate challenges using a dashboard with an interpreter [53] Preferences: Infographics well-received and comprehended by English-and Spanish-speaking populations [36] Spanish-speaking population less likely to prefer a computer-telephone-based PRO method than English-speaking population [43] The majority of Spanish-speakers preferred face-to-face interviewing [44] Other: n/a

Late responses to web-based PRO platform associated with low income [62] Half of a low SES, low education population found PROs confusing [55] Low income, limited health literacy, majority Black patients had more difficulty with PRO data retrieval than data completion within commercially available mobile apps on iPhones and Androids [42] Needs: Half of a low SES, low education population wanted help completing surveys [55] Preferences: n/a Other: Low income patients had more favorable experiences with PROM collection than patients within the top 3 quartiles of income [37] PRO collection with EHR upload feasible in a low-resource clinical setting with a 25% Native American population [51] Interactive voice response symptom deemed feasible and improved symptom severity among majority unemployed African American and Latina patients [47] Populations with low educational or health literacy

Low health literacy patients more likely to find PRO outcome dashboard and longitudinal data difficult to understand than patients with higher health literacy [53] Late responses to web-based PRO platform associated with lower education [62] Low income, limited health literacy, majority Black patients had more difficulty with PRO data retrieval than data completion within commercially available mobile apps on iPhones and Androids [42] Needs: n/a Preferences: A bar graph combined with emojis was the most preferred PRO symptom display format among low health literacy, majority Black patients [41] Computer-based interview was preferred over in-person interview for patients with psychiatric disorders known to be impacted by low literacy [58] Other: Completion rates and time needed to complete surveys on a touchscreen-based display similar between patients with low and high literacy [48] 

The online version contains supplementary material available at https:// doi. org/ 10. 1186/ s41687-022-00428-z.Additional file 1: Table S1 . Search strategy by databases included in the review.Additional file 2: Table S2 . Details of the specific implementation outcomes by studies included in the review.

All authors listed contributed substantially to the manuscript. CJH was involved in manuscript conception, literature review, data analysis, and manuscript writing. RG and RD were involved in literature review and data analysis. MNK was involved in manuscript writing and revision. PAB was involved in literature search methodology. MOE and ALP were involved in manuscript conception, writing, and revision. All authors approved the final version of the