Brief Report

Cross-validation of a high-performance liquid chromatography nevirapine plasma assay in a resource-limited setting in Zimbabwe

Faithful Makita-Chingombe, Anthony T. Podany, Timothy Mykris, Farai Muzambi, Richard W. Browne, Andrew J. Ocque, Robin DiFrancesco, Lee C. Winchester, Courtney V. Fletcher, Tinashe Mudzviti, Charles C. Maponga, Gene D. Morse

Received: 08 May 2020; Accepted: 24 Feb. 2021; Published: 08 July 2021

Copyright: © 2021. The Author(s). Licensee: AOSIS.
This is an Open Access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

An international HIV pharmacology specialty laboratory (PSL) was established at the University of Zimbabwe to increase bioanalytical and investigator capacities. Quantitation of plasma nevirapine in samples from the AIDS Clinical Trials Group protocol 5279 was compared between the University of Nebraska Medical Center PSL and the University of Zimbabwe PSL. Both PSLs employed internally developed methods utilising reverse-phase high-performance liquid chromatography with ultraviolet detection. Eighty-seven percent of the cross-validation results exhibited ± 20% difference.

Keywords: cross-validation; HIV; root-cause analysis; high-performance liquid chromatography.

Introduction

The University of Zimbabwe (UZ) International HIV pharmacology speciality laboratory (IPSL) was established to increase HIV pharmacology-related research and support research investigator capacity in Africa.¹ The UZ-IPSL performs drug development assay and clinical research specimens analyses, specifically drug-drug interactions, pharmacokinetic and pharmacodynamic data analyses.

The Clinical Pharmacology Quality Assurance programme, which monitors all PSLs within the AIDS Clinical Trials Group, provided technical guidance to and developed a comparative nevirapine validation study for the UZ-IPSL to analyse replicate HIV clinical samples. Validation of the nevirapine bioanalytics method² was essential at the time because of nevirapine use in the sub-Saharan region and results were generated by a reverse-phase high-performance liquid chromatography (HPLC) system using ultraviolet detection with gradient-elution separation.^3,4,5 This report compares nevirapine bioanalysis at two laboratories: the United States-based, University of Nebraska Medical Center Pharmacology Specialty Laboratory (UNMC-PSL) and the UZ-IPSL. The UNMC-PSL served as the AIDS Clinical Trials Group 5279 (A5279) protocol designated laboratory. The UNMC-PSL, during the time of the A5279 study, participated in the Clinical Pharmacology Quality Assurance proficiency testing (PT) programme to assure nevirapine assay performance and accuracy. Although each PSL validated the nevirapine assay separately, the lack of data comparing the bioanalytical capacity of pharmacology laboratories in low-middle income countries using clinical samples (rather than spiked plasma samples) was the justification for this project.

Therefore, implementation of the project was the last stage in determining UZ-IPSL’s readiness to begin assaying human samples for clinical trials.

Methods

Ethical considerations

Data files used in this comparison study were de-identified and Clinical Pharmacology Quality Assurance was blinded to any data associated with samples. This article followed all ethical standards for research without direct contact with human or animal subjects.

Project design

The UZ-IPSL utilised the A5279 replicate samples (n = 95) that were available at the UZ College of Health Sciences Clinical Trial Research Center (UZCHS-CTRC) for cross-validation of nevirapine assays between the UNMC-PSL and the UZ-IPSL. A5279 was a multi-centre, phase III clinical trial investigating the use of short-course rifapentine or isoniazid for the prevention of active tuberculosis in HIV-positive adults.⁶ In A5279, nevirapine pharmacokinetics when co-administered with rifapentine and isoniazid was one of the exploratory objectives. All A5279 primary aliquots collected from the UZ AIDS Clinical Trials Group CTRC were analysed for nevirapine by the protocol designated PSL at the UNMC-PSL.

A5279 sample collection and processing

Plasma samples for the quantitation of nevirapine concentrations were obtained from A5279 study participants. Blood was collected into potassium ethylenediaminetetraacetic acid collection tubes and transported on ice to the processing laboratory within 1 h where the plasma was separated from cells by centrifugation (1200 × g, 10 min, 4 °C). The plasma aliquots were frozen (–70 °C) and shipped to the UNMC-PSL. The UZCHS-CTRC retained secondary aliquots for the UZ-IPSL cross-validation assay.

University of Nebraska Medical Center PSL nevirapine assay

A5279 primary plasma aliquots were shipped from UZCHS-CTRC on dry ice to the UNMC-PSL for determination of the nevirapine. The UNMC-PSL nevirapine determination assay had a quantitation range of 25 ng/mL to 10 000 ng/mL. Samples measuring above the quantitation range were diluted and reanalysed using a validated dilution protocol. Solid-phase extraction was utilised to prepare samples for analysis. The UNMC-PSL utilised a Waters e2695 HPLC coupled to a Waters 2489 ultraviolet (Waters, Milford, Massachusetts, United States) detector, which was controlled with Empower 2 (Waters, Milford, Massachusetts, United States) software as the analytical platform. The performance of the assay was compliant with the United States Food and Drug Administration bioanalytical guidelines for method validation.⁷

University of Zimbabwe International HIV PSL nevirapine assay

Replicate plasma aliquots (n = 95) from A5279 available at the UZCHS-CTRC were shipped to the UZ-IPSL for determination of the nevirapine concentration for cross-validation. The UZ-IPSL measured nevirapine using a validated HPLC-ultraviolet assay detailed previously.² The UZ-IPSL chromatographic system consisted of a Shimadzu LC20A HPLC using ultraviolet photodiode array detection (model SPD-M20A) and LabSolutions Software (version 5.8; Kyoto, Japan). The assay quantitation range was 500 ng/mL to 15 000 ng/mL. Samples that were above the quantitation range were diluted and reanalysed. The performance of the assay was compliant with United States Food and Drug Administration bioanalytical guidelines. Peak purity for nevirapine was assessed to confirm the absence of interferences from potential impurities also extracted from the patient’s sample. A5279 samples were assayed over five runs; the two last runs included samples that were above the upper limit of quantification and were diluted (1:8) according to the validated dilution protocol.²

Data management and analysis

The UZ-IPSL nevirapine results were submitted to the AIDS Clinical Trials Group Data Management Center portal using the Data Submission Utility (Frontier Science Foundation Inc., Brookline, Massachusetts, United States). The A5279 study team approved the release of the UNMC A5279 nevirapine concentration results for comparison with the UZ-IPSL results. The original nevirapine concentration data from the UNMC-PSL were used in the specified A5279 protocol pharmacokinetics analysis; no UZ-IPSL derived pharmacokinetics data were used in the per-protocol study analysis. The Data Management Center compiled the data and provided the de-identified data files to the Clinical Pharmacology Quality Assurance PT unit to perform blinded, comparative statistical analyses of the nevirapine results. After examination (Omnibus 2) and finalisation of the data, the analyses of the paired t-test, Deming regression and Bland-Altman analyses were completed using Prism GraphPad (version 8.3; San Diego, California, United States) software.

Results

Ninety-five replicate plasma aliquots were bioanalysed. The nevirapine concentration range in the analysed samples was ~2000 ng/mL – 34 000 ng/mL (~17-fold). Of this, 97% (n = 92) ranged between 2000 ng/mL and 20 000 ng/mL and the remaining 3% (n = 3) were above 20 000 ng/mL and not contiguous (Table 1, Figure 1a)⁹. The nevirapine concentration values from the laboratories were tested for normality and only data ≤ 15 000 ng/mL or less were normally distributed. Data 15 000 ng/mL reflected the upper limit of the UZ-IPSL assay and was appropriate because it more closely represented the previously reported nevirapine steady state concentrations (5086 ng/mL – 13 368 ng/mL or 19.1 uM to 50.2 uM).^3,4,5 Of the data, 93% (n = 88) were 15 000 ng/mL or less (Table 1)⁹ while 7% (n = 7) were above this value. Therefore, the seven sample pairs were excluded from the method comparison. After exclusion, an additional sample pair was identified as a significant outlier using the Grubbs test and was also excluded.

FIGURE 1: Differences in nevirapine concentrations assayed at UNMC-PSL (Omaha, Nebraska, United States, October 2017) and UZ-IPSL (Harare, Zimbabwe, May 2018); (a) Scatter plot (n = 95 data points). (b) Deming regression plot of 87 data points (outliers excluded). Boxes in (a) indicate UNMC upper limit of quantitation (dashed) and UZ-IPLS upper limit of quantitation (solid lines).

The two-tailed paired t-test of the final data set (n = 87) (Table 1)⁹ showed UZ-IPSL nevirapine values were significantly higher with a constant error of 3% – 4% more than UNMC-PSL values. The Deming regression analysis (Figure 1b)⁹ and the Bland-Altman plots (Figure 2)⁹ further confirmed the higher values from the UZ-IPSL. As shown in Figure 2a⁹, regression analysis using the difference plot indicated an increasing proportional difference between the clinical pharmacology laboratories as the concentration of nevirapine increased. However, when the data were normalised by concentration, using the % difference analysis (Figure 2b)⁹, the correlation was no longer significant.

FIGURE 2: Differences in nevirapine samples (n = 87) assayed at UNMC-PSL (Omaha, Nebraska, United States, October 2017) and UZ-IPSL (Harare, Zimbabwe, May 2018). (a) Bland-Altman difference plot indicating proportionally higher difference at high concentrations (mean difference = −430). (b) Bland-Altman percentage difference on normalisation by concentration, correlation not significant (mean % deviation = −4.49). Shaded areas present confidence interval limits for mean (green shade) and agreement limits (red shade).

Discussion

Drug concentrations for nevirapine reported in the literature for HIV-positive individuals indicate a steady state maximum of 5740 ng/mL (5000–7440) and minimum of 3730 ng/mL (3200–5080)⁸. Both nevirapine assays from the two laboratories can detect concentrations that might be below the target concentration for virologic suppression or above the upper limit of the therapeutic range. Although the UZ-IPSL nevirapine concentrations were higher than those of UNMC-PSL and this difference was statistically significant, it is unlikely to have clinical significance. The United States Food and Drug Administration does not provide a window of acceptance for cross-validation studies but allows laboratories to determine a priori the acceptance criteria. Using the established acceptance window for Clinical Pharmacology Quality Assurance PT samples, about 20% of the final target value, and expected concentrations of nevirapine, this difference was acceptable.

The outcomes of the cross-validation also presented an opportunity to perform a root-cause analysis. The UZ-IPSL’s trend of PT outcomes before and during the A5279 sample analysis period was explored. While all PT results were satisfactory, agreement of initial PT sample analyses showed unbiased accuracy, while during subsequent analyses which coincided with A5279 sample analysis, the UZ-IPSL values exhibited a biased, high trend (4% – 19%) as compared to the final target values of that PT round. This shift in bias and accuracy was provided within the PT report and the UZ-IPSL was able to complete a root-cause analysis and remediate as needed.

Limitations

One limitation to consider is that the calibration ranges for the two equipment sets used for the nevirapine analysis were not identical. Future comparisons of this nature may benefit from evaluations where the calibration range is the same for both laboratories. In addition, limited data points above 20 000 ng/mL entailed difficulties in quantitation of proportional error at that level.

Conclusion

The cross-validation study provided evidence that the UZ-IPSL performance using a nevirapine assay that was validated in their laboratory was acceptable and correlated with the results of an experienced PSL. This study afforded the UZ-IPSL a valuable opportunity to implement operations using its validated nevirapine assay for the analysis of samples obtained from a clinical research protocol and adopt procedures for handling of protocol specimens based on experience. Furthermore, the outcomes of the cross-validation emphasised the value of PT and provided an occasion to perform root-cause analysis.

Acknowledgements

The UZ-IPSL acknowledges the contribution of Dr Marshall Munjoma for his support during the laboratory work that led to the development of this manuscript.

The authors declare that they have no financial or personal relationships that may have inappropriately influenced them in writing this article.

F.M.-C. was the project leader and F.M. was the laboratory technologist. T.Mudzviti and C.C.M. provided manuscript review and supervised the UZ-IPSL activities for the project. A.T.P. was clinical pharmacologist and C.V.F. was the PSL director and A5279 pharmacology investigator. T.Mykris and L.C.W. were laboratory technologists. A.J.O., R.W.B., R.D. and G.D.M. provided clinical pharmacology quality assurance project design and data analysis. All authors critically revised intellectual content and approved the final version to be published.

University of Zimbabwe IPSL: Project was funded by the United States National Institute of Allergy and Infectious Diseases, National Institutes of Health (AIDS Clinical Trials Group Grant 5UM1AI106701-04).

University of Nebraska PSL: Project was funded by the United States National Institute of Allergy and Infectious Diseases, National Institutes of Health, Department of Health and Human Services Awards ATP (K23 AI134307), and CVF (UM AI106701).

Clinical Pharmacology Quality Assurance Program: This project has been funded in whole or in part with federal funds from the United States National Institute of Allergy and Infectious Diseases, National Institutes of Health and the Department of Health and Human Services, under contract numbers HHSN272201500006C and HHSN272200800019C.

Center for AIDS Research: This publication was made possible through core services and support from the University of Rochester Center for AIDS Research, a United States National Institutes of Health-funded programme (P30 AI078498).

Data are available from (1) Clinical Pharmacolog Quality Assurance Program Translational Pharmacology Research Core, Center for Integrated Global Biomedical Sciences, School of Pharmacy and Pharmaceutical Sciences, University at Buffalo, State University of New York, Buffalo, New York, United States, (2) International PSL, School of Pharmacy, University of Zimbabwe College of Health Sciences, PO Box A178, Avondale, Harare, Zimbabwe and (3) Antiviral Pharmacology Laboratory, University of Nebraska Medical Center, Omaha, Nebraska, United States.

The content is solely the responsibility of the authors and does not necessarily represent the official views of the United States National Institutes of Health.

References