key: cord-0747995-915dunz9
authors: Almalky, Ahmad M; Alhaidar, Fatima A
title: Patients’ Satisfaction With Telepsychiatry Services at a University Hospital in Riyadh During the COVID-19 Pandemic
date: 2021-08-19
journal: Cureus
DOI: 10.7759/cureus.17307
sha: 8fecc0c803109586e205623771a46596860c87b4
doc_id: 747995
cord_uid: 915dunz9

Background and objective Telepsychiatry uses electronic communication and various technologies to provide psychiatric care by a psychiatrist in one location to a patient in another location. It was originally created to meet the mental health needs of patients in rural, remote, and inaccessible areas. This study aimed to assess the satisfaction level with telepsychiatry from patients' perspectives and to study whether the satisfaction levels influence the patients' decision to use the service in the future. Methodology This was a cross-sectional survey study conducted at King Khalid University Hospital in Riyadh, Saudi Arabia. The study included psychiatric patients with complete medical records who were followed up through the telepsychiatry program over the phone due to the restriction and regulation implemented by the government in the wake of the coronavirus disease 2019 (COVID-19) pandemic. The data were collected via a questionnaire designed on a Google Form. Initially, the sample size was set at 337 psychiatric patients, but only 141 patients agreed to be included. The SPSS Statistics program (IBM, Armonk, NY) was used to analyze the data. Results Patients were generally satisfied with the telepsychiatry services; 80.1%, 95.7%, and 96.5% of the participants were satisfied with the structure, process, and outcome, respectively, and 94.3% of the patients reported a sense of overall satisfaction. The study did not find any relationship between satisfaction and demographic characteristics. Patients highly valued some aspects during the service use, such as comfort, privacy, easy access, carefulness, and skillfulness of the clinicians. Of the respondents, 24.1% agreed and 24.8% strongly agreed when asked if they would use the service in the future. Conclusion Patients had generally positive satisfaction levels toward telepsychiatry service, and many reported that they would like to continue using it in the future. However, further studies are needed to assess whether patient perception will change over time after the COVID-19 pandemic.

Telepsychiatry involves the use of electronic communication and various technologies to provide psychiatric care by a psychiatrist in one location to a patient in a different location virtually, either through voice or video sessions [1] . Telepsychiatry was originally created to meet the mental health needs of patients in rural, remote, and inaccessible areas [2, 3] . Moreover, evidence shows that the use of telepsychiatry has helped to overcome many previous issues including shortages of mental health clinicians [4] , social stigma attributed to treatment in a mental health setting, as well as in the context of a pandemic such as the one caused by coronavirus disease 2019 (COVID-19) [5] [6] [7] . As the use of telepsychiatry in healthcare has dramatically increased in the past decade, it has attracted significant attention from researchers and psychiatrists [8] . In light of this, it has become an element of key importance to have a proper understanding as to how satisfied the patients actually are with the service they receive from the telepsychiatry approach [8, 9] . Furthermore, a rapidly growing number of studies in several medical fields have observed that patients' attitudes play a critical role in healthcare outcomes [10, 11] . This highlights the need for more research to understand patients' satisfaction levels with the telepsychiatry service.

In general, published studies about telepsychiatry are limited and consist of small sample sizes [12, 13] . In addition, the current level of evidence is insufficient to provide generalizable results [14, 15] . And, the current level of evidence regarding patients' satisfaction with the use of telepsychiatry in Saudi Arabia remains very limited. Therefore, we conducted this cross-sectional study to assess the satisfaction level with telepsychiatry from patients' perspectives and to examine whether satisfaction levels affect the patients' well-being.

This was a cross-sectional survey conducted at King Khalid University Hospital in Riyadh, Saudi Arabia. The study included a cohort of psychiatric patients with complete medical records who were followed up through the telepsychiatry program over the phone owing to the restrictions and curfew implemented by the government at King Khalid University Hospital due to the ongoing COVID-19 pandemic. This study involved the distribution of online questionnaires on Google Forms, which were designed by the researcher and piloted before the actual data collection.

The Telepsychiatry Care Satisfaction Questionnaire (TCSQ) was formulated from two previously validated surveys [16, 17] . First, the Psychiatric Care Satisfaction Questionnaire (PCSQ), which was validated and used in previous research [16] . Secondly, the Telehealth Satisfaction Scale (TeSS), which is a 10-question scale survey that was used in a study research regarding telehealth satisfaction [17] . The TCSQ questionnaire was reconstructed to assess the views of psychiatric patients about the healthcare providers that are directly involved in their treatment plan. These views included the structure of the program, the process that was carried out, and its outcomes. This questionnaire comprised 26 items in total, of which seven items were used for collecting demographic data. The TCSQ employs a five-point Likert scale (strongly agree, agree, uncertain, disagree, and strongly disagree). Each question was given a score ranging from 1 to 5; higher scores imply satisfaction with that questionnaire item. The TCSQ statements are both negative and positive, direct, and indirect. Feedback from three different psychiatrists was taken to further validate the questionnaire. Furthermore, in order to validate the language part of the questionnaire, it was translated into Arabic and back to English by an independent translator. Afterward, the translated questionnaire was translated back to English and was checked for accuracy because of the possibility that some rephrasing might be lost in translation due to the sophistication of the Arabic language.

All individuals who were enrolled in the telepsychiatry program were contacted and informed about the process of the current survey-based study. All patients who gave informed consent to be part of the study were included. The participants were contacted by phone to explain the study objectives, and then a link to the questionnaire was sent to them by Whatsapp to answer the survey. The inclusion criteria were as follows: documented psychiatry cases who were followed up at King Khalid University Hospital, patients with full medical records, patients who were compliant with the assigned treatment plans and sessions, and patients who were willing to take part in our survey-based study. On the other hand, new psychiatric cases, patients who did not follow up, patients with incomplete medical records, and patients who were unwilling to participate in our survey study were excluded. There was no restriction on age or medical conditions as the guardians were asked to fill in the survey on behalf of the patients. Written consents were collected by getting the participants to check a box on the Google Form link, which had information about the study objective and assurance of complete confidentiality of the provided data as well as a guarantee to not collect personal information.

Initially, a pilot study was conducted to assess the validity and reliability of the developed questionnaire among 10% of the overall sample through a simple randomization process. Cronbach's alpha coefficient was utilized to find the reliability for each instrument. The alpha coefficient was high for the instruments with a value of 0.832. Following the validation of the questionnaire, we asked all included participants to fill in the online questionnaire. Individuals who were not able to fill the online questionnaire were asked to complete the study surveys through a telephone-based interview. The study was approved by the Institutional Review Board (IRB)-Ethics Committee of King Khalid University Hospital. Furthermore, those who were 18 years and younger or mentally impaired to provide consent on their own had their questionnaires filled in with the help of their guardians/parents and the consent was obtained from their legal guardians. The youngest patient included in the study was six years old and the oldest was 85 years old. The researcher used the SPSS Statistics program version 25 (IBM, Armonk, NY) for data entry and analysis. The first stage of data entry involved constructing the entry base and coding of variables, followed by actual data entry. At the analysis stage, data cleaning and data management for the variables of interest were performed. A five-point Likert scale was used, and the points awarded ranged from 1 point for "strongly disagreeing" to 5 points for "strongly agreeing." A reverse coding was done for the reverse statements. A collective score was used to calculate the satisfaction score by the summation of all statements. The middle point was considered as the cut-off point between the "satisfied" and "not satisfied" categories. Descriptive analysis including figures and frequency tables were used to describe the main features of the data. The Chi-square test was used to examine the relationship between satisfaction categories and other variables. The confidence interval was considered at 95%, and a p-value <0.05 was considered statistically significant. Table 1 shows the demographic characteristics of patients. A total of 141 participants were included in the study. Out of those, 56% were females, 95.7% were Saudi, 43.3% had a bachelor's degree, 85.8% resided in Riyadh, 61% were unemployed, and 48.2% were married. The mean age of the participants was 39.39 years. 

Regarding the response on the telepsychiatry service, about 65.3% of patients were satisfied and strongly satisfied with the duration of the visits, 63.4% were comfortable using the telepsychiatry service, 56.7% of patients were at ease about reaching the telepsychiatry department, 52.1% were satisfied with how the department acted in case the patient was out of reach, and only 32.2% thought that doctors needed more training to conduct a voice session. About 46.8% and 38.3% of the patients were satisfied and strongly satisfied that the psychiatrist gave them enough space to listen to their problems and concerns, respectively. Moreover, 42.6% were satisfied and 36.2% were strongly satisfied that the psychiatrist explained the treatment plan well. Also, 37.6% were satisfied and 36.2% were strongly satisfied with the quality of the audio communication. Almost half of the respondents (42.6%) were satisfied and 34% were strongly satisfied with the thoroughness, carefulness, and skillfulness of the clinicians. In addition, less than a third of the respondents (24.1%) were satisfied and 27% were strongly satisfied regarding the ease in discussing matters with a call rather than an outpatient appointment. In contrast, 30.5% were dissatisfied and 43.3% were strongly dissatisfied with the use of technical terms that patients do not understand. Regarding the privacy of the care, 35.5% of patients agreed and almost half of them (48.2%) strongly agreed that it was satisfactory, while 38.3% agreed and 33.3% strongly agreed that using telepsychiatry service will help more patients in the future ( Table 2) . Also, 39% and 27% of the patients agreed and strongly agreed, respectively, that they were satisfied with the rate of follow-up they received from the telepsychiatry team. Moreover, 41.1% agreed and 20.6% strongly agreed with the view that there are more things regarding telepsychiatry with regard to the case that can be improved ( Table 2 ). Around 28% agreed that it was easy to receive their prescription and pills using the online prescription tools while 32.6% of the patients strongly agreed with the same statement. On the ease of visiting the hospital for laboratory work on an appointment basis, 28.4% agreed and 32.6% strongly agreed on that fact. Lastly, a low percentage of patients (15.6%) agreed that it was difficult to see the doctor in person when needed while 28.4% strongly agreed on that matter ( On further analysis, there was no statistically significant relationship between patients' satisfaction with the service structure and patients' demographic characteristics (Table 3) . Furthermore, there was no statistically significant relationship between patients' satisfaction with the service process and patients' demographic characteristics ( Table 4) , and there was no statistically significant relationship between patients' satisfaction with the service outcome and patients' demographics (Table 5) . Similarly, there was no statistically significant relationship between patients' general satisfaction with the service and patients' demographic characteristics ( However, regarding the relationship between satisfaction categories and the views of the patients about their desire to continue using the telepsychiatry service in the future, statistically significant differences were found in satisfaction levels with respect to all items (structure, process, outcome, and general satisfaction), as well as the patients' preference to use the service in the future, as all p-values were less than 0.05 ( 

Among the patients who participated in the telepsychiatry service, the majority (94.3%) were satisfied with the quality of the healthcare they received. The patients' satisfaction was in line with the existing literature that found patients' satisfaction with the care quality and clinical outcomes following telehealth visits superior to those of traditional medical setting visits [18] [19] [20] . Our study did not find any differences in satisfaction levels with respect to patients' demographic characteristics. This result is consistent with previous related studies that failed to show differences in patients' satisfaction scores pertaining to their demographics. However, lack of medical insurance was a significant predictor for previous preferences for telehealth service [19] , while the distance from patients' homes was not measured in the current study due to the pandemic rules. The study revealed that patients were satisfied with the duration of the session they received, comfortability, ease of reaching to the telepsychiatry setting, quality, carefulness, appointment, and privacy. Consistent with our findings, a previous related study has shown the satisfaction level of patients with telepsychiatry services to be positive [21] . Another study showed that 63.6% of patients either agreed or strongly agreed that remote treatment sessions (telephone or video) have been just as helpful as in-person sessions [22] . Also, it showed good satisfaction levels among the psychiatric patients with the appointment confidentiality, privacy, and comfortability of telepsychiatry services. In addition, it showed that improved access to care increases the patients' satisfaction with the service [23] .

About half of the participants either agreed or strongly agreed to continue using the telepsychiatry service in the future, and patients' satisfaction score was associated with their willingness to use the service in the future. In a similar study, 64.2% of the participants either agreed or strongly agreed with the statement that they would consider using telepsychiatry sessions in the future [22] . Hence, this perception may be driven by certain specific aspects, which may include limited closeness to the medical staff, lack of ability to note the body language, nonverbal cues, and physical signs of the disease [24] . However, movement restrictions associated with the COVID-19 pandemic have made the medical setting visits less interesting to the patients, which may overestimate the real satisfaction scores. The study showed a statistically significant relationship between patients' satisfaction levels and patients' preference to continue using the service in the future.

Limitations of the study include a relatively small sample size that was not representative of the general population. Furthermore, the online sessions were done during lockdown periods, and hence the respondents may have a biased opinion about normalizing the process given the ongoing pandemic. However, longitudinal studies should be conducted to validate these results once the COVID-19 pandemic ends.

A large segment of the patient population was satisfied with the telephonic consultative services. Patients considered privacy, confidentiality, comfortability, ease of reach to the service, appointment, and carefulness of the healthcare providers to be the best attributes regarding the telepsychiatry service, with about half of the participants expressing the desire to use it in the future. However, further research should be conducted in order to confirm and validate these findings once the COVID-19 pandemic ends.

Human subjects: Consent was obtained or waived by all participants in this study. King Khalid University Hospital IRB issued approval 20/0540/IRB. The ethical approval was obtained from the IRB of King Khalid University Hospital in Riyadh, KSA. Animal subjects: All authors have confirmed that this study did not involve animal subjects or tissue. Conflicts of interest: In compliance with the ICMJE uniform disclosure form, all authors declare the following: Payment/services info: All authors have declared that no financial support was received from any organization for the submitted work. Financial relationships: All authors have declared that they have no financial relationships at present or within the previous three years with any organizations that might have an interest in the submitted work. Other relationships: All authors have declared that there are no other relationships or activities that could appear to have influenced the submitted work.

Telepsychiatry: an overview for psychiatrists

Telemental health: videoconferencing in mental health services

Telepsychiatry: promise, potential, and challenges

American Association for Emergency Psychiatry recommendations to address psychiatric staff shortages in emergency settings

Mental health-related stigma in health care and mental health-care settings

The use of telepsychiatry during COVID-19 and beyond

Telepsychiatry and the coronavirus disease 2019 pandemic-current and future outcomes of the rapid virtualization of psychiatric care

Recent advances in telepsychiatry: an updated review

Telehealth and patient satisfaction: a systematic review and narrative analysis

Patient-perceived involvement and satisfaction in Parkinson's disease: effect on therapy decisions and quality of life

A systematic review of factors associated with service user satisfaction with psychiatric inpatient services

Systematic review of studies of patient satisfaction with telemedicine

Outcomes and methods in telemedicine evaluation

Assessment of patients' acceptance of and satisfaction with teledermatology

Telemedicine and patient satisfaction: current status and future directions

The Psychiatric Care Satisfaction Questionnaire: a reliability and validity study

The telehealth satisfaction scale: reliability, validity, and satisfaction with telehealth in a rural memory clinic population

Patient satisfaction from ENT telephone consultations during the coronavirus disease 2019 pandemic (Epub ahead of print)

Shrank WH: Patients' satisfaction with and preference for telehealth visits

Oral and maxillofacial surgery patient satisfaction with telephone consultations during the COVID-19 pandemic

Satisfaction of a new telephone consultation service for prenatal and postnatal health care

Patient attitudes toward telepsychiatry during the COVID-19 pandemic: a nationwide, multisite survey

Comparing costs and quality of care at retail clinics with that of other medical settings for 3 common illnesses

Barriers to use of telepsychiatry: clinicians as gatekeepers

The author would like to thank Dr. Fatima Abdulrahman Mohammad Alhaidar, Professor at the College of Medicine, KSU & Consultant Child & Adolescent Psychiatrist, King Khalid University Hospital (KKUH) for the guidance and effort in helping to finish this article.