|
|
| ||||||||||||||||||||||
• Introduction • Research methods and design • SLMTA programme • Expenditure analysis • Theoretical estimate of expenditures • Projected financial costs of national expansion • Results • Discussion • Limitations • Conclusion • Acknowledgements • Competing interests • Authors’ contributions • CDC disclaimer • References |
||||||||||||||||||||||
Background: In 2010, the Zimbabwe Ministry of Health and Child Welfare (MoHCW) adopted the Strengthening Laboratory Management Toward Accreditation (SLMTA) programme as a tool for laboratory quality systems strengthening. Objectives: To evaluate the financial costs of SLMTA implementation using two models (external facilitators; and internal local or MoHCW facilitators) from the perspective of the implementing partner and to estimate resources needed to scale up the programme nationally in all 10 provinces. Methods: The average expenditure per laboratory was calculated based on accounting records; calculations included implementing partner expenses but excluded in-kind contributions and salaries of local facilitators and trainees. We also estimated theoretical financial costs, keeping all contextual variables constant across the two models. Resource needs for future national expansion were estimated based on a two-phase implementation plan, in which 12 laboratories in each of five provinces would implement SLMTA per phase; for the internal facilitator model, 20 facilitators would be trained at the beginning of each phase. Results: The average expenditure to implement SLMTA in 11 laboratories using external facilitators was approximately US$5800 per laboratory; expenditure in 19 laboratories using internal facilitators was approximately $6000 per laboratory. The theoretical financial cost of implementing a 12-laboratory SLMTA cohort keeping all contextual variables constant would be approximately $58 000 using external facilitators; or $15 000 using internal facilitators, plus $86 000 to train 20 facilitators. The financial cost for subsequent SLMTA cohorts using the previously-trained internal facilitators would be approximately $15 000, yielding a break-even point of 2 cohorts, at $116 000 for either model. Estimated resources required for national implementation in 120 laboratories would therefore be $580 000 using external facilitators ($58 000 per province) and $322 000 using internal facilitators ($86 000 for facilitator training in each of two phases plus $15 000 for SLMTA implementation in each province). Conclusion: Investing in training of internal facilitators will result in substantial savings over the scale-up of the programme. Our study provides information to assist policy makers to develop strategic plans for investing in laboratory strengthening.
Public health laboratories play a central role in disease detection, prevention and control. High-quality diagnostics and monitoring are critical to ensure better patient outcomes. In response, developing countries have started paying more attention to efforts to expand laboratory capacity, strengthen laboratory systems and improve laboratory quality.1 The Strengthening Laboratory Management Toward Accreditation (SLMTA) programme was launched in 20092and has since been implemented in 47 countries in Africa, Southeast Asia, the Caribbean and Latin America.3 The programme has demonstrated measurable improvement in laboratories as a result of an approach that incorporates improvement projects and structured supervisory visits, allowing extension of learning beyond the classroom.4 Zimbabwe is a resource-limited country with an annual per capita health expenditure of US$16,5 well below the World Health Organization’s recommended minimum of $34.6 Inadequate numbers of well-trained laboratory staff and lack of training on laboratory quality management systems are major challenges facing the laboratory system in Zimbabwe.1,7 To address these gaps, the US President’s Emergency Plan for AIDS Relief (PEPFAR), through the US Centers for Disease Control and Prevention (CDC), in 2010 made available a five-year grant to the Zimbabwe Ministry of Health and Child Welfare (MoHCW). This funding was earmarked for strengthening laboratory systems through a cooperative agreement with the Zimbabwe National Quality Assurance Program Trust (ZINQAP), a local not-for-profit organisation which focuses on laboratory quality assurance issues in Zimbabwe. In 2010, the MoHCW’s Department of Laboratory Services embarked on a five-year strategic plan, one objective of which was to implement quality management systems.8 The Laboratory Services Directorate adopted SLMTA as a tool for laboratory quality systems strengthening and engaged ZINQAP as the programme provider. Evaluation of financial costs, or expenditures, of implementing the SLMTA programme is essential in order to guide policy makers and prioritise scarce resources.9 Cost analysis is a critical tool in understanding the value of programmes and projecting budgets for scale up.10 The aim of this study is to provide a partial financial expenditure analysis of the SLMTA programme in Zimbabwe from the programme provider’s perspective, with a focus on expenditure comparison between using external (international) versus internal (country-based MoHCW) facilitators. These two models have substantial upfront and ongoing cost implications and Zimbabwe has used both in its SLMTA implementation and expansion. We evaluate the financial costs of SLMTA implementation using both external and internal facilitators and project the financial costs of scaling up the programme nationally.
SLMTA programme Details of SLMTA programme implementation have been described elsewhere.2 To date, the SLMTA programme in Zimbabwe has been implemented in three cohorts; only cohorts I (implemented in 2010–2011) and III (implemented in 2012–2013) are included in this analysis. Cohort II was conducted using a different model and detailed cost data were not available. The SLMTA programme in Zimbabwe included four components: (1) baseline audits conducted by ZINQAP staff; (2) three SLMTA workshops of four days each; (3) supervision of the implementation of improvement projects following each workshop; and (4) exit audits. Mentorship, which is often incorporated into SLMTA implementation, was not conducted for these two cohorts during the training because of financial constraints and availability of staff. Two implementation models were used – one with external workshop facilitators and auditors; and the other with internal workshop facilitators and auditors following extensive training. For cohort I, 11 laboratories were trained using an external facilitator based in Uganda, along with three local facilitators. The exit audit was conducted by three external auditors from Uganda, Lesotho and Botswana. Cohort III used four internal facilitators who were trained in a 13-day training-of-trainers course followed by a six-day auditor training. The exit audit was also conducted by these internal facilitators. This cohort included 19 laboratories (13 in Zimbabwe and six in Namibia). Expenditure analysis A partial expenditure analysis was conducted of the implementation of the SLMTA programme, using both external and internal facilitators. We evaluated the expenditures from a programme perspective, including only direct costs borne by ZINQAP, the programme provider, whilst excluding in-kind contributions and salaries of local facilitators and trainees. Expenditures were collected using a detailed inventory (payment vouchers and general ledger) of all resources associated with the SLMTA programme and the training of local facilitators. Expenditures were tallied for each of the four programme components and then categorised into training equipment, training (facilities and materials), trainers and supervisors (transport; accommodation and per diem; and fees) and participants (transport; accommodation and per diem). For cohort III, expenditures for supervision and auditing of the six laboratories from Namibia were not available. We therefore estimated costs as though they had been in-country, using an inflation factor based on average expenditures for these activities for the Zimbabwean laboratories. We also calculated the cost of training local facilitators in training-of-trainers and auditing courses. These expenditures were entered into CostIt software version 4.5 (World Health Organization 2007) and analysed in the financial analysis mode. CostIt is software designed to record and analyse economic and financial data. All expenditures are expressed in US dollars, which has been the official national currency of Zimbabwe since 2009. We used a ‘top-down’ cost accounting approach, which starts with total expenditures and then divides by the number of trained individuals and the number of laboratories to yield the average cost per trained individual and average cost per trained laboratory, respectively. Theoretical estimate of expenditures Expenditures of the two cohorts had considerable inherent variability resulting from contextual factors. For example, the rental cost of the training facility varied from workshop to workshop because of seasonality and fluctuations in the economy. Also, for cohort I, ZINQAP paid per diems to participants, whilst for cohort III, no participant per diem was paid because of budget constraints. To better compare the two models, we estimated SLMTA implementation costs based on a theoretical scenario, keeping all contextual variables constant across the two models. Contextual variables included facility rental fees, training materials, number of laboratories and participants. Expenditure assumptions for this model were based on the expert estimation of ZINQAP programme implementers, using lessons learned from conducting the two previous cohorts and a normative budgeting approach. Projected financial costs of national expansion Outputs for the two models based on theoretical financial costs when holding constant contextual variables were used to project the cost of scaling up the SLMTA programme nationally. We based these estimates on a two-phase implementation plan in which half of the 10 provinces in Zimbabwe would implement SLMTA in each phase. SLMTA would be rolled out in a series of five cohorts (one per province) of 12 laboratories each, for a total of 60 laboratories per phase. For the internal facilitator model, one facilitator training would be held per phase, training four people per province to conduct the SLMTA programme locally. Time required to implement a phase will depend on resources available; we therefore did not specify a timeframe.
The total expenditures for implementation of the SLMTA programme in 11 laboratories using external facilitators were approximately $64 000 (Table 1). The total expenditures in 19 laboratories using internal facilitators were approximately $28 000, plus $84 000 for facilitator training. This yields an average cost per laboratory of approximately $5800 using external facilitators and $5900 using internal facilitators ($3200 and $4700 per person trained, respectively).
When keeping all contextual variables constant across the two models, the theoretical financial cost of implementing SLMTA in 12 laboratories using external facilitators would be approximately $58 000, whilst the theoretical cost of implementing SLMTA in the same 12 laboratories using internal facilitators would be approximately $15 000, plus $86 000 to train 20 facilitators (Table 2). The estimated financial cost to implement subsequent SLMTA cohorts would remain $58 000 per cohort using external facilitators and would be approximately $15 000 per cohort using the previously-trained internal facilitators, yielding a break-even point of 2 cohorts, at $116 000 for either model.
In the external facilitator model, the majority of the financial costs would be spent on SLMTA workshops (59%) and exit audits (37%) (Figure 1a). For the internal facilitator model, the majority of the cost for the first SLMTA cohort would be spent on conducting the facilitator training (85%), with approximately 12% being spent on conducting workshops. For subsequent cohorts with internal facilitators, the majority of the financial cost would go toward the workshops (83%), with approximately 9% for supervision.
Examining expenditures by expenditure category, the majority of the cost of the external facilitator model would be fees for trainers and supervisors (78%), whilst the remainder would be spent on training (22%) (Figure 1b). For the first cohort using the internal facilitator model, financial costs would be divided fairly evenly between participant expenses (44%), training (30%) and trainers and supervisors (22%). In subsequent cohorts using internal facilitators, training costs would account for the majority of expenditures (83%), with trainers and supervisor expenses accounting for the remaining 17%. The projected financial cost of scaling up the SLMTA programme nationally is shown in Figure 2. Implementation in 120 laboratories (12 in each of the 10 provinces) would cost approximately $580 000 using the external facilitator model and $322 000 using the internal facilitator model. The initial investment of training 20 internal facilitators ($86 000) will pay for itself by the second SLMTA cohort, after which the programme will benefit from a cost saving of $43 000 (74%) per cohort for the remainder of the cycle.
This is the first detailed expenditure analysis of SLMTA implementation to be published. We found that programme expenditures to implement SLMTA were less than $6000 per laboratory. Yao et al. have shown that SLMTA implementation results in substantial improvements in laboratory quality.3 Collectively, Zimbabwe’s cohort I laboratories conduct more than 1.5 million tests each year and their median audit scores more than doubled from pre- to post-SLMTA.3 Given the dramatic improvements and relatively low financial cost of SLMTA implementation found in the current study, it can be argued that SLMTA is well worth the investment in time and resources. Whilst the estimated financial cost to implement a single SLMTA cohort is lower using external facilitators, the upfront investment of training local facilitators pays for itself by the second cohort, resulting in a 44% cost savings over national scale up of the programme. In addition, training local laboratorians to be SLMTA facilitators builds long-term indigenous capacity of the laboratory programme, enabling these individuals to conduct in-country laboratory audits, assist laboratory staff in other activities and improve the overall quality of laboratory management throughout the country. In this case, it is critical to minimise staff turnover between the training and SLMTA implementation so as to ensure a return on investment. Some strategies may include an agreement between the MoHCW and supervisors not to reassign the trainers for a period of 2 years; financial incentives to the participants upon completion of the SLMTA programme; and binding contracts in which the participant agrees to remain on the job for a specified period or until the conclusion of SLMTA implementation in their province. Bringing in external facilitators requires high transport costs as well as facilitators’ fees. Because we assumed that the internal facilitators would be employed by MoHCW and work within their own provinces, these costs would be minimised. We found that the financial costs of SLMTA implementation are sensitive to participant and trainer travel and per diems. In cohort I, when participants were provided accommodation and per diem, this cost was nearly 40% of the entire financial cost of SLMTA implementation. Hence, decentralising the SLMTA programme to each province, minimising necessary travel for participants, will reduce costs substantially. A study in Cameroon also found that decentralised SLMTA training enables more laboratory staff to be trained, increasing local capacity and sustainability.11 Use of internal facilitators will make decentralisation more feasible, as facilitators can be selected strategically from a wide geographic distribution. SLMTA is often coupled with on-site mentorship in a variety of models so as to boost improvements even further.12 Our analysis did not include mentorship costs, because mentorship was not incorporated in the SLMTA programme for these two cohorts. Bringing in external mentors would increase the cost of the programme substantially; however, given that internal facilitators can receive mentorship training, they could also be used in this capacity to reduce costs and have a positive impact on programme implementation. Limitations This study is subject to some limitations. Firstly, several expenses associated with SLMTA implementation, such as overhead costs, vehicles and salaries, were provided in kind and thus not included in this analysis. Our results may therefore underestimate the financial cost of implementing SLMTA in other settings. Also not included was the cost of conducting improvement projects within the laboratories, as this was financed by the individual laboratories; however, SLMTA is designed to focus on management behaviours and participants are encouraged to identify solutions to problems within their existing resources. Expenditures were reported as incurred at the time of implementation, not adjusted for inflation or annuitised over years of useful life. Because inflation has varied widely over the past decade in Zimbabwe,13 we did not attempt to adjust for it, but based estimates on approximate costs in 2013–2014. Secondly, there is a level of uncertainty inherent in the assumptions of our theoretical models. However, the resulting financial cost estimates were fairly close to the actual financial costs experienced by the programme, suggesting that they may indeed be realistic. Finally, this analysis is not meant to be an exhaustive assessment of all potential models, but rather a comparison of two models that have been used in Zimbabwe. Additional studies are needed to identify the most cost-effective models for various situations and to conduct an overall economic evaluation of the SLMTA programme. Countries considering the implementation of SLMTA will need to examine the expected costs of each of the various components of programme implementation, taking into account local parameters and potential support from partners. Conclusion Our study suggests that national scale up of the SLMTA programme in Zimbabwe would cost approximately $322 000. Countries considering SLMTA implementation should weigh the pros and cons of investing in training of internal staff to act as programme facilitators. In Zimbabwe, investing in training of local facilitators will result in a nearly 50% decrease in the costs of national expansion, as well as develop in-country capacity of laboratory managers and mentors, supporting programme sustainability.
We would like to acknowledge the ZINQAP Finance Office staff for their support and sharing data. This research has been supported by PEPFAR through the CDC. Competing interests The authors declare that they have no financial or personal relationship(s) that may have inappropriately influenced them in writing this article. Authors’ contributions E.S. (ZINQAP) designed the study, collected and analysed data and wrote the manuscript. P.N. (ZINQAP), R.S.1 (MoHCW), D.M. (MoHCW), P.H.K. (CDC, Zimbabwe) and S.N.Z.1 (ZINQAP) implemented the programme and revised the manuscript. A.M. (ZINQAP) reviewed the manuscript and assisted in the data analysis. E.T.L. (CDC, United States) designed the study and substantially revised the manuscript. CDC disclaimer The findings and conclusions in this paper are those of the authors and do not necessarily represent the official position of the CDC.
1. Nkengasong JN, Nsubuga P, Nwanyanwu O, et al. Laboratory systems and services are critical in global health: Time to end the neglect? Am J Clin Pathol. 2010;134(3):368–373. http://dx.doi.org/10.1309/AJCPMPSINQ9BRMU6 2. Yao K, McKinney B, Murphy A, et al. Improving quality management systems of laboratories in developing countries: An innovative approach to accelerate laboratory accreditation. Am J Clin Pathol. 2010;134(3):401–409. 3. Yao K, Luman ET, SLMTA Collaborating Authors. Evidence from 617 laboratories in 47 countries for SLMTA-driven improvement in quality management systems. Afr J Lab Med. 2014;3(2), Art. #262, 11 pages. http://dx.doi.org/10.4102/ajlm.v3i2.262 4. Yao K, Maruta T, Luman ET, Nkengasong JN. The SLMTA programme: Transforming the laboratory landscape in developing countries. Afr J Lab Med. 2014;3(2), Art. #194, 8 pages. http://dx.doi.org/10.4102/ajlm.v3i2.194 5. Community Working Group on Health in Zimbabwe. Post health budget analysis 2013. Harare; 2013 (Unpublished). 6.Commission on Macroeconomics and Health. Macroeconomics and health: investing in health for economic development. Report of the Commission on Macroeconomics and Health (Chaired by Jeffrey D. Sachs) [document on the Internet]. c2001. [cited 2014 Sep 26]. Available from: http://whqlibdoc.who.int/publications/2001/924154550x.pdf 7. Birx D, De Souza M, Nkengasong JN. Laboratory challenges in the scaling up of HIV, TB, and malaria programs: The interaction of health and laboratory systems, clinical research, and service delivery. Am J Clin Pathol. 2009;131(6):849–851. http://dx.doi.org/10.1309/AJCPGH89QDSWFONS 8. Zimbabwe Ministry of Health and Child Welfare. Laboratory service National Strategic plan 2010–2014. Harare; 2010 (Unpublished). 9. De Allegri M, Marschall P, Flessa S, et al. Comparative cost analysis of insecticide-treated net delivery strategies: Sales supported by social marketing and free distribution through antenatal care. Health Policy Plan. 2010;25(1):28–38. http://dx.doi.org/10.1093/heapol/czp031 10. Guinness L, Levine R, Weaver M. 10 best resources in … cost analysis for HIV/AIDS programmes in low and middle income countries. Health Policy Plan. 2004;19(4):242–245. http://dx.doi.org/10.1093/heapol/czh029 11. Ndasi J, Dimite L, Mbome V, et al. Decentralised facility-based training as an alternative model for SLMTA implementation: The Cameroon experience. Afr J Lab Med. 2014;3(2), Art. #231, 6 pages. http://dx.doi.org/10.4102/ajlm.v3i2.231 12. Nzombe P, Luman ET, Shumba E, et al. Maximising mentorship: Variations in laboratory mentorship models implemented in Zimbabwe. Afr J Lab Med. 2014;3(2), Art. #241, 8 pages. http://dx.doi.org/10.4102/ajlm.v3i2.241 13. Central Intelligence Agency. The World Factbook [page on the Internet]. c2013 [cited 2014 Aug 31]. Available from: https://www.cia.gov/library/publications/the-world-factbook/index.html |
