key: cord-0024344-itaz9fvr
authors: Alam, Laima; Khan, Jawad; Alam, Mafaza; Faraid, Varqa; Ajmal, Fahad; Bahadur, Laila
title: Residents’ perspective on the quality of postgraduate training programs in Pakistan – the good, the bad and the ugly
date: 2021
journal: Pak J Med Sci
DOI: 10.12669/pjms.37.7.4297
sha: a34c46c7c95034b6a18e0ace0fd99efa6ea34770
doc_id: 24344
cord_uid: itaz9fvr

OBJECTIVES: To assess the satisfaction of trainees towards different attributes of their training programs. METHODS: This cross-sectional survey was carried out by enrolling trainee doctors currently working in Medical, Surgical, Dental and Allied specialties of the country by sending a validated and piloted questionnaire through email. Data collection was done from 1(st) to 31(st) January 2021 after taking ethical approval from the concerned authorities. Data was analysed using SPSS v. 19.0. RESULTS: A total of 516 completed responses were received from 15 major cities of the country. The overall perceived satisfaction towards clinical skills (42%), teaching skills (31.4%), personal growth and development (23.6%), research (21%) and supervisor’s role (44.2%) were considerably low with the most common causes for non-satisfaction being poor work-life balance (59%), financial instability (54.5%), poor research facilities (53%), poor career guidance (44%) and poor skill development (42.4%) in descending order. Senior years of residency, government and private set-ups, less than four and greater than 13 residents on average with less than three supervisors per department, excessive duty hours and financial instability in-lieu of not doing locums were statistically related to poor satisfaction across majority of the facets of residency as well the overall satisfaction towards training programs. CONCLUSION: There is a tremendous scope for improvement in the recognized and partially acknowledged attributes of our training programs. Yearly feedback surveys involving residents is essential for enlightening the authorities and mitigating the trainees’ grievances.

The objective of medical residency programs has moved from the bare minimal standard attainment to an elaborate system of continuous improvement with frequent appraisals and evaluations for validation. 1 Accreditation of a highly robust residency program involves work environment, academics and its balance with service, evaluations , mentorship and the qualities of the supervisors. 2 Frequent scientific evaluation of training programs has long been advocated to ensure safe and productive environment for the residents that in turn affects performance and adequate patient care. 3 Every medical education program, be it undergraduate or post-graduate, requires a system of continuous analysis, policy making and reassessing the improvements brought about by the implemented strategies. 4 Unfortunately, there is a serious dearth of such quintessential research in our country, leading to uneven quality of training with rising stress, maladaptive coping strategies and feeling of abandonment in majority of the trainee doctors. An extensive literature review showed that only a few studies were conducted to identify unrecognized deficiencies of our training programs and that too were either geographically limited to a single centre, city or a province or a single specialty, 3, [5] [6] [7] leading to results that could not be generalized.

This nation-wide cross-sectional survey was designed to measure the level of satisfaction of our residents working in varied set-ups towards various facets of residency that were not previously studied locally. The relation of multiple demographic variables with satisfaction scores was also studied in detail.

This cross-sectional survey was carried out by enrolling trainee doctors working in different cities of Pakistan through convenience sampling after acquiring ethical approval from the concerned department (A/01/21/13, dated January 1, 2021). The survey was completed in one month i.e.; from 1 st January 2021 to 31 st January 2021 by enrolling trainee doctors currently working in Medical, Surgical, Dental and Allied specialties of the country. Trainees from basic medical sciences, non-trainee doctors and those with less than six months experience were all excluded.

The questionnaire was developed by LA, MA and JK after a thorough literature review [5] [6] [7] [8] and was reviewed by two medical education experts for content validity. The survey was piloted among 10 post-graduate residents before putting it to test. The questionnaire encompassed perceived satisfaction towards six main facets of residency programs including clinical skills, teaching, personal growth and development, research, supervisor's role and environment of the training institute. 9 The perceived quality was scored using Likert five-point scale ranging from strongly agree (1) to strongly disagree (5) . Questions regarding each domain of the residency programs were followed by a Yes/No question in order to enable the participants to select their over-all satisfaction regarding that domain. The sample size was calculated with margin of error set at 4.5%, confidence level at 95% and an anticipated frequency (response distribution) of 50% using OpenEpi sample size calculator. The questionnaire was sent through email, a reminder was given to the participants after one week of no response and the candidates were dropped who failed to respond after another seven days. 10 Statistical Analysis: To measure the internal consistency of the instrument, Cronbach's alpha was calculated which produced a value of 0.95. Qualitative data was expressed as frequencies and percentages. Relation of non-satisfaction with socio-demographic variables was seen using multinomial logistic regression. A value of <0.05 was considered statistically significant. All analysis was done using SPSS V. 19 .

A total of 516 completed responses were received (from 15 major cities of the country representing all the provinces as shown in Fig.1 ) out of 960 emails sent, making a response rate of 53.7%. Male participants (65.7%) with a median age of 24-30years (63%) getting trained at government (47%) followed by army set-up (34.4%) showed maximum participation. An average of 26-30 working days (51.7%) with 4-6 on-calls (28%), 1-3 long-days (22.7%) and 1-2 weekends-on-call (70%) was the rota per month for majority of the trainees (Table-I) .

The scores of perceived satisfaction using a fivepoint scale for different facets of training is shown in Table- II. The overall perceived satisfaction towards clinical skills (42%), teaching skills (31.4%), personal growth and development (23.6%), research (21%) and supervisor's role (44.2%) were considerably low with the most common causes for non-satisfaction being poor work-life balance (59%), financial instability (54.5%), poor research facilities (53%), poor career guidance (44%) and poor skill development (42.4%) in descending order (Fig.2 ).

Quality of post-graduate training programs Senior years of residency, government and private set-ups, less than four and greater than 13 residents on average with less than three supervisors per department, excessive duty hours and financial instability in-lieu of not doing locums were statistically significant in relation to poor satisfaction across majority of the facets of residency as well the overall satisfaction towards training programs (Table-III) .

An extensive analysis of our residency programs by Biggs JS in 2008 pointed out several shortcomings including the lack of stipend for full time residents, poor career guidance with poor clinical skills procurement, disregard towards the laidout curriculum, too many trainee doctors with too few mentors to supervise, lack of research and adequate hospital facilities and a serious dearth of evaluation of the residency programs. 11 Although there is a clear national interest in training of doctors, hardly any improvement has been observed over more than a decade.

Job satisfaction is intrinsically linked to engagement and recognition, financial compensation (in the form of pay scale) and worklife balance, 12 all of which were unfortunately reported to be infringed in this study. About 27% of the trainees iterated a monthly salary of less than Rs. 30,000 (187 USD) and 37% less than Rs. 50,000 (314 USD) with 89% of the trainees reporting no financial compensation for extra duty hours. The financial constraints can be easily deduced from the fact that 56% of the trainees were married and had, on average, three or more dependents with only 37% managing to supplement their salary with locums.

Poor research skills and non-availability of funding or protected research hours were common for all the residents irrespective of the hospital set-up and is the facet that scored the lowest in terms of satisfaction in this study. Our residency programs need to bring about changes to help equip the trainees with agility to encourage lifelong learning and to foster research culture. 13 Revalidations for the supervisors and assessment of the training were not available for many of the residency programs in our study. An adequately trained supervisor is integral for an effective clinical program and learner's autonomy and it is the responsibility of the College of Physicians and Surgeons of Pakistan to prepare their faculty for this role. 14 Despite all the hurdles and resource limitations, the supervisors are doing their best to provide quality training and their role was the only facet in the current study that showed maximum satisfaction in comparison. Moreover, 29-34% of the trainees reported workplace harassment either involving themselves or a colleague with only 23% of the institutions providing disciplinary committees to deal with these allegations. A study by Hu Y et al demonstrated that 59.4% of medical trainees had experienced at least one form of harassment or discrimination during their training with consultants being the most common perpretrator. 15 The authors believe the percentage of work-place harassment might be under-reported due to the stigma attached to disclosure and, more importantly, many of our trainees usually don't know what constitutes workplace harassment and bullying. 16 There is a need for stringent policies and cultural change at our set-ups to provide a healthy progressive environment.

There was a common trend seen regarding nonsatisfaction across all the facets of training that included working in public set-ups, greater number of residents per department versus lower number of supervisors for mentoring, excessive duty hours and financial instability in relation to not doing locums. The trainees working in army set-ups showed higher levels of satisfaction and reported better clinical skills with greater contentment towards supervisors' role in their residency programs. On the contrary, >5 supervisors in a department were considered to be adversely affecting the clinical skills, likely because of less opportunity provided for hands-on and advanced skill procurement. Junior trainees were not happy with their supervisors whereas senior trainees showed a relatively higher non-satisfaction towards their clinical and teaching skills development, findings similar to a study conducted on Greek residents. 17 Female trainees conveyed a statistically significant non-satisfaction towards their clinical and teaching skills which has been studied extensively in the past showing gender based discrimination in residency and practice. 18 Male residents were not happy with their personal growth and development and the over-all nonsatisfaction was related to < 4 or > 13 residents per department with < 3 supervisors, higher residency year (likely secondary to the realization that the program failed a trainee's initial expectations) 17 and financial constraints through multinomial regression analysis.

It was interesting to see that for some of the survey questions the neutral response was as high as 34.3%, a trend observed in a similar local study. 5 It has been seen that choosing a neutral option provides an easy out for the participants who are less willing to express their opinion or when they are reluctant to voice a socially disagreeable sentiment. 19 This aloofness might be one of the biggest confounders responsible for the lack of prompting for conceivable policies and an imperative change.

Resident doctors' burnout in lieu of poor organizational systems is one of the most notorious factors for eroding their wellness and affecting the patients' quality of care and general satisfaction. 20 Reflection, leadership, continuous monitoring and assessment with residents' feedback are paramount for a cohesive and robust curriculum that has the ability to encourage and support life-long learning.

The only limitation of the study is simple convenience sampling.

The link between quality and accreditation of residency programs: the surveyors' perceptions

Accreditation systems for Postgraduate Medical Education: a comparison of five countries

Residents' perceptions of their working conditions during residency training at PIMS

Effectiveness of educational interventions in improving clinical competence of residents in an internal medicine residency program in Pakistan

Postgraduate medical education: residents rating the quality of their training

A Questionnaire-Based Survey of Physical Medicine and Rehabilitation Residency Training in Pakistan

Quality of post graduate medical training in public and private tertiary care hospitals of Karachi

Quality assurance (QA) programme review. Internal research report

Impact of COVID-19 pandemic on the residency programs of the country: A multicentre study

Amid COVID-19 pandemic, are non-COVID patients left in the lurch?

Postgraduate medical training in Pakistan: observations and recommendations

Burnout and job satisfaction among family medicine residency coordinators: results from a national survey

Knowledge, attitude, practice, and barriers toward research among medical students: A cross-sectional questionnaire-based survey

New Supervision Standards: Discussion and Justification

Discrimination, Abuse, Harassment, and Burnout in Surgical Residency Training

Why Does Workplace Harassment Go Unreported? -HR Daily Advisor

A nationwide survey of training satisfaction and employment prospects among Greek gastroenterology fellows

Perceptions of gender-based discrimination during surgical training and practice

The Effects of the Neutral Response Option on the Extremeness of Participant Responses. Incite

Monitoring the organizational wellness of a physician residency program: A quality improvement process

There is a tremendous scope for improvement in the recognized and partially acknowledged attributes of our training programs. Regular monitoring of the training programs along with repeated validation of the supervising mentors is mandatory for improved outcomes. Yearly feedback surveys involving residents is essential for enlightening the authorities and mitigating the trainees' grievances.