Abstract
Background: Many women undergoing cervical screening as part of a national South African screening programme may be positive for HIV. The performance of liquid-based cytology (LBC) on samples from HIV-positive women needs to be determined.
Objectives: The performance of the Cellslide® automated LBC system was evaluated as a possible alternative to conventional cytology in a national cervical cancer screening programme.
Methods: Split samples from 348 HIV-positive women attending an HIV treatment clinic in Johannesburg, South Africa were examined by conventional cytology and monolayer LBC methods. All samples were stained, examined and reported in the same manner. Cytotechnologists were blinded to the conventional smear diagnosis if the LBC smear was screened and vice versa.
Results: The same percentage of inadequate smears (1.4%) was obtained by conventional cytology and LBC. Atypical squamous cells of undetermined significance were observed in 5.2% of conventional smears and 4.0% of LBC smears. Low-grade squamous intraepithelial lesions were found in 35.6% of conventional smears and 32.7% of LBC smears. Only one conventional smear was categorised as atypical squamous cells – cannot exclude a high-grade lesion, whereas five such cases were identified on LBC. High-grade squamous intraepithelial lesions were seen in 21.6% of conventional smears and 23.3% LBC smears. No invasive carcinoma was identified.
Conclusion: The performance of the Cellslide® LBC system was similar to that of conventional cytology in this population of high-risk HIV-positive women, indicating that it may be introduced successfully as part of a cervical cancer screening programme.
Introduction
Cervical cancer is a significant cause of morbidity and mortality in South Africa. In 2009, it was the second-most common cancer amongst South African women, with an age-standardised incidence rate of 22.33 per 100 000.1 Amongst black South African women, cervical cancer was the most commonly histologically diagnosed cancer in 2009, with an age-standardised incidence rate of 26.19 per 100 000.1 Unfortunately, more recent incidence data are not available. From a global perspective, an analysis of 187 countries showed that approximately 200 000 women died from cervical cancer in 2010, of which a significant proportion were women aged between 15 and 49 years in under-resourced nations.2
In South Africa, 30.2% of women of reproductive age were HIV-positive in 2010, whereas the rate was 29.5% in 2012.3,4 The burden of cervical cancer and its precursor lesions is intensified amongst HIV-positive women. In a study from Johannesburg, HIV-positive women had a higher prevalence of cervix lesions related to human papillomavirus (HPV) compared with HIV-negative women, even after controlling for confounding variables such as age and sexual behaviour.5 This finding reflects the high rate of co-infection of HIV and HPV. Such co-infection is often associated with higher prevalence of high-risk HPV infections and increased rates of intraepithelial lesions such as high-grade squamous intraepithelial lesions (HSIL), which are often large, multifocal, and have higher recurrence rates. Invasive cervical cancer is also more common amongst HIV-positive women, occurring approximately 10 years earlier and with more rapid progression and poorer prognosis, than amongst HIV-negative women.6,7
The national South African guidelines for cervical cancer screening of HIV-positive women recommend screening upon diagnosis of HIV. If the results are negative, follow-up screening every one to three years is recommended. If the initial results show a low-grade lesion (i.e. atypical squamous cells of undetermined significance [ASCUS] or low-grade squamous intraepithelial lesion [LSIL]), a repeat screening is required one year later.8 If a high-grade lesion is found (i.e. HSIL or atypical squamous cells – cannot exclude a high-grade lesion [ASCH]), the patient is referred for further evaluation. Suggested screening modalities include conventional and liquid-based cytology (LBC), HPV testing, visual inspection with acetic acid and visual inspection with Lugol’s iodine. A number of studies to compare conventional cytology, HPV testing and visual inspection with acetic acid for screening of HIV-positive women in South Africa are currently underway.9,10 It is estimated that 80% of South Africans use public–sector healthcare facilities, including the National Health Laboratory Service. Approximately 1 million screenings using the conventional cervical cytology method were reported by the National Health Laboratory Service in 2013.11
LBC is an alternative method of preparing cervical smears for microscopic examination and is widely used in well-resourced nations. However, although it was developed 15 years ago, it has not been adopted into the South African health sector. Several meta-analyses comparing LBC with conventional cytology have reported conflicting results. Abulafia et al.12 concluded that a commonly used LBC test was more sensitive and specific compared with conventional cytology for diagnosing cervical dysplasia, whereas Arbyn et al.13 and Davey et al.14 determined that LBC neither reduces the number of unsatisfactory smears nor improves detection of HSIL. Karnon et al. found that there is uncertainty regarding the ‘relative effectiveness (and cost-effectiveness) of the two main LBC techniques’.15 Advantages of LBC include that screenings for HPV and other sexually transmitted infections, including chlamydial and gonococcal infections, can be performed on the LBC collection fluid, without the need for collecting a separate specimen. HPV testing can be performed on the fluid in the vial, and HPV testing or cytology can be performed on the same sample.16,17
A large percentage of South African women undergoing routine cervical screening may be HIV-positive.3,4 As there is a paucity of literature examining whether LBC can be successfully used to screen for cervical abnormalities in HIV-positive women, the benefit of introducing LBC as part of a national cervical cancer screening programme in South Africa is unclear. The aim of this study was to determine whether Cellslide® (Audit Diagnostics, Cork, Ireland), an automated LBC processing system for the preparation of thin-layer smears, can be used successfully as a screening modality in a high-risk HIV-positive population.
Research method and design
Ethical considerations
The study protocol was reviewed and accepted by both the University of the Witwatersrand (Human Ethics Committee) and the University of North Carolina.
Study design and setting
The study was a non-randomised, prospective, observational evaluation. The study population comprised 348 HIV-positive women involved in a cervical cancer screening study in South Africa.5 All participants were enrolled consecutively. Women aged between 18 and 65 years were recruited from an HIV treatment clinic at a tertiary government hospital in Johannesburg, South Africa, between November 2009 and August 2011. Participants were approached for the study whilst in the HIV clinic awaiting medications or an appointment with a healthcare practitioner. Women were ineligible to participate if they were pregnant, had previously undergone a hysterectomy or treatment for cervical neoplasia or cancer, were severely ill or had signs or symptoms suggestive of a sexually transmitted disease. Women who had completed treatment for a sexually transmitted disease were eligible. Women who were menstruating at the time of study enrolment were asked to return within two weeks to participate. The main reasons that women declined to participate in the study were the fear of losing their place in the queue and time constraints.
A cervical fluid sample was taken with a cervical broom. A split-sample method was then used, whereby a conventional cytology smear (Pap smear) was prepared by spreading the collected material onto a glass slide and spray fixing immediately, followed by placing the tip of the brush in a vial containing Cellslide® preservative solution (Audit Diagnostics, Cork, Ireland). Both specimens were processed in the Cytology Unit of the Department of Anatomical Pathology, University of the Witwatersrand/National Health Laboratory Service in Johannesburg, South Africa. The manufacturer’s instructions were used when preparing the Cellslide® thin-layer slide. Both types of sample were stained, coverslipped, examined under the microscope and reported using the Bethesda system for reporting cervical cytology.18 The Bethesda system is a widely used cytology reporting system that not only provides guidelines for specimen adequacy but also offers standardised reproducible criteria for cytologic lesions such as ASCUS, LSIL, ASCH and HSIL. The aim of the Bethesda system is to minimise inter-observer variability and facilitate communication between the clinician and the laboratory.18
Laboratory investigations
The conventional and Cellslide® cervical smears were examined by different cytotechnologists. The cytotechnologists reporting the Cellslide® smears were blinded to the conventional smear diagnosis and vice versa. Thirteen cytotechnologists reported out some of the conventional cytology and some of the Cellslide® thin-layer slides. Cytotechnologists participate in stringent internal quality assurance activities. Some of these include all reportedly negative smears undergoing rapid review, all positive smears being evaluated by two technologists and evaluation of each technologist’s ASCUS : SIL ratio. External quality assurance activities employed by this laboratory include the Australian RCPA quality assurance proficiency programme and laboratory accreditation by external accreditation bodies. If quality assurance activities identify suboptimal performance by a cytotechnologist, re-training and intense monitoring of the work quality are undertaken.
Statistical analysis
Categories were compared using the chi-square test or Fisher’s exact test for proportions. We determined the accuracy of Cellslide® for identifying the diagnostic category correctly compared to the ‘gold standard’ of conventional cytology (Pap smears). The number of positive and negative samples as tested using Cellslide® was compared to the number of samples with and without each cervical abnormality of interest (e.g., HSIL, ASCH, LSIL, ASCUS) as determined by conventional cytology. We calculated the sensitivity, specificity, positive predictive value and negative predicative value for each diagnostic category, as well as the corresponding 95% confidence intervals (CI; binomial distribution assumed). The kappa coefficient was used to test for agreement between diagnostic categories for the split sample. Kappa values < 0.4 were considered to indicate poor agreement, whereas values of 0.41–0.75 were considered to indicate moderate (fair to good) agreement and values > 0.75 were regarded as indicating excellent agreement.19 As both methods used the same categories within the rating scale, a weighted kappa coefficient was not required. All analyses were performed at a 5% significance level using SAS version 9.1 (SAS Institute, Cary, North Carolina, United States).
Results
Very few inadequate smears were obtained by the respective methods (only five [1.4%] for both conventional cytology and Cellslide®) (Table 1). A high percentage of abnormal smears were identified with both methods, and a diagnosis of negative for intraepithelial lesion/malignancy (NILM) was found for only 125 (35.9%) by conventional cytology and 129 (37.1%) by Cellslide®. LSIL was the most frequently diagnosed epithelial abnormality (124 [35.6%] by conventional cytology and 114 [32.7%] by Cellslide®). Both preparation methods diagnosed a substantial number of HSIL cases (75 [21.6%] by conventional cytology and 81 [23.3%] by Cellslide®). The Cellslide® method diagnosed an additional six cases of HSIL (P < 0.001). ASCUS was diagnosed in 18 samples (5.2%) using conventional cytology and in 14 samples (4.0%) using Cellslide® (P < 0.001), whereas ASCH was diagnosed in only one sample (0.3%) using conventional cytology and in five samples (1.4%) using Cellslide® (P < 0.014). No cases of glandular lesions or invasive carcinoma were diagnosed by either method.
TABLE 1: Results from conventional cytology and Cellslide® automated liquid-based cytology amongst HIV-positive women (n = 348) in Johannesburg, South Africa (November 2009 to August 2011).† |
Twenty cases diagnosed as LSIL by conventional cytology were diagnosed as HSIL by Cellslide®, and 15 cases diagnosed as LSIL by Cellslide® were diagnosed as HSIL by conventional cytology. Four cases diagnosed as ASCH by Cellslide® were diagnosed as LSIL by conventional cytology. No cases diagnosed as ASCH by one method (either conventional cytology or Cellslide®) were diagnosed as HSIL by the other method. Three cases diagnosed as ASCUS by Cellslide® were diagnosed as HSIL by conventional cytology, but no cases diagnosed as ASCUS by conventional cytology were diagnosed as HSIL by Cellslide®.
The agreement between the two diagnostic methods was poor for ASCH (κ = 33.0, 95% CI: 1.4–33.0) (Table 2). Agreement was also considered poor for ASCUS, because the kappa value was close to the poor–moderate cut-off and the 95% CI was wide (κ = 41.1, 95% CI: 18.6–62.5). Agreement was moderate for LSIL and HSIL, and excellent for NILM.
TABLE 2: Level of agreement between conventional cytology and Cellslide® for each diagnostic category amongst samples from HIV-positive women (n = 348) in Johannesburg, South Africa (November 2009 to August 2011). |
For HSIL, Cellslide® showed sensitivity of 76.0% (95% CI: 64.8–85.1) and specificity of 91.0% (95% CI: 87.0–94.2), with a false-omission rate < 7%, compared with conventional cytology (Table 3). In addition, when compared with conventional cytology, Cellslide® showed sensitivity of 89.6% (95% CI: 82.9–94.4) and specificity of 92.2% (95% CI: 87.8–95.4) for NILM, sensitivity of 70.2% (95% CI: 61.3–78.0) and specificity of 87.7% (95% CI: 82.6–91.7) for LSIL, and sensitivity of 100% (95% CI: 2.5–100) and specificity of 98.8% (95% CI: 97.1–99.7) for ASCH.
TABLE 3: Diagnostic accuracy of Cellslide® compared with conventional cytology in samples from HIV-positive women in Johannesburg, South Africa (November 2009 to August 2011). |
Discussion
The results show excellent to moderate agreement between conventional cytology and the automated LBC system Cellslide® for diagnosis of NILM, LSIL and HSIL in this population of HIV-positive women. Poor agreement was observed between the two methods for diagnosis of ASCUS and ASCH.
HPV testing is becoming increasingly popular as a primary cervical screening modality. In South Africa, LBC can be efficacious, should HPV testing be implemented. HPV testing and co-testing with either cytology or reflex cytology, if certain high-risk HPV types are found, can be performed on the same vial, without the need for collecting two samples from the same patient. The LBC method may support faster microscope screening and therefore more samples could be screened daily, although not all studies have demonstrated this.12,13,14,15 The LBC method is reported to perform better when using computer-assisted screening devices,12,13,14,15 which is an advantage given the large number of Pap smears performed in South African public-sector healthcare facilities.
The cost associated with LBC has to be considered. Results on the cost-effectiveness of LBC are conflicting, depending on whether studies found improvements in the adequacy or detection of abnormality rates. A study by Taylor et al.20 found that a commonly used LBC product reduced the number of inadequate smears but did not improve detection of histology-confirmed disease (cervical intraepithelial neoplasia grade 1 or worse) and therefore concluded that the increased cost does not justify the implementation of LBC. In contrast, a review by Cox21 showed that LBC was cost-effective. A study by de Bekker-Grob et al.22 similarly determined that LBC can be cost-effective as a cervical screening modality, specifically if the cost of LBC exceeded the cost of conventional cytology by less than €3.2, the sensitivity of LBC was at least 3% – 5% greater than conventional cytology and the rate of inadequate smears on conventional cytology was at least 16.2%.
Only one study has investigated the performance of LBC on samples from HIV-positive women.23 The findings need to be considered critically to inform a decision about introducing LBC in the South African public health sector, as a large percentage of South African women eligible for cervical screening may be HIV-positive.6,7,24 The study by Swierczynski et al.23 concluded that conventional cytology and LBC detected the same number of squamous intraepithelial lesions. However, the diagnosis of ASCUS by LBC was more likely to be associated with a squamous intraepithelial lesion on follow-up compared with diagnoses of ASCUS by conventional cytology. They also determined that both methods could readily identify infectious organisms. In the current study, the conventional cytology and Cellslide® methods detected a similar number of unsatisfactory smears and ASCUS and LSIL diagnoses, but more cases of ASCH and HSIL were diagnosed by Cellslide®. Furthermore, we found excellent agreement between the two methods for diagnosis of NILM and moderate agreement for diagnosis of LSIL and HSIL. Our finding of poor agreement for diagnosis of ASCUS and ASCH highlights the well-described poor intra- and inter-observer reproducibility for these epithelial abnormalities.25,26,27 However, it is important to note that the small number of samples in the ASCUS and ASCH categories could have compromised the accuracy of the statistical analysis.
The results of the current study show that Cellslide® has good sensitivity and specificity for NILM. As a screening test, a negative result is useful for determining that the patient does not have the disorder. At this initial screening, Cellslide® correctly identified more than 90% of samples that showed no cervical abnormalities. Similar to these results, a Brazilian study found that the agreement between conventional cytology and LBC was highest in the NILM category.28 The authors further noted that this influenced the agreement rate, as the majority of cervical smears were negative. In comparison, the proportion of samples that showed abnormal cytology exceeded 60% for both preparation methods in the current study. Other studies have also documented below-excellent agreement for epithelial abnormalities when comparing conventional cytology to LBC preparations.27,28 Factors that influence agreement include the method employed to collect the smear, variations in cellular material between the conventional and LBC samples and the level of experience of the cytotechnologists in interpreting the smears.29,30,31,32,33,34
Limitations
One of the main limitations of the current study is the small number of samples in some of the epithelial abnormality categories (e.g., ASCUS, ASCH) as determined by the Bethesda system; these results should be interpreted with caution. Another limitation is that cellular morphology is somewhat different on LBC preparations compared with conventional cytology and cytotechnologists face a learning curve when moving from conventional cytology to LBC.30 In addition, training in LBC cytomorphology is recommended to facilitate accurate interpretation of an LBC smear.34 As this study was conducted over only a limited time period, cytotechnologists may not have mastered LBC cytomorphology completely. Accurate costing of a cervical smear, whether for conventional cytology or LBC, is a complex problem and beyond the scope of the current study. However, cost is a critical factor and must be considered when deciding whether to move to LBC or continue using conventional cytology.
Conclusion
Results obtained with Cellslide® were similar to those of conventional cytology in this population of high-risk HIV-positive women. The technique may therefore be used successfully should it be decided to move to LBC.
Acknowledgements
We would like to thank the nurse clinicians at Right to Care for performing the cervical smears and the cytotechnologists at the National Health Laboratory Service for screening the samples.
Competing interests
The authors declare that they have no financial or personal relationship(s) that may have inappropriately influenced them in writing this article.
Sources of support
The study was supported by the University of North Carolina Center for AIDS Research (P30-AI50410), USAID PEPFAR (674-A-00-08-00007-00) and the South African Research Chairs Initiative of the Department of Science and Technology (PHE ZA.09.0265).
Authors’ contributions
P.M. (University of the Witwatersrand and National Health Laboratory Service) and C.F. (University of the Witwatersrand and Helen Joseph Hospital) were the main investigators, designed the study, analysed the results and wrote the manuscript. A.Sh., L.R. and S.M. (University of the Witwatersrand and National Health Laboratory Service) prepared and examined the cervical smears. A.Sw. (University of the Witwatersrand) was the data manager. N.R. (Helen Joseph Hospital) enrolled patients in the study, performed cervical smears and was responsible for patient follow-up. D.E. (University of the Witwatersrand) and J.S.S. (University of North Carolina) performed the statistical analysis and contributed to writing the manuscript.
References
- National Cancer Registry. Cancer in South Africa: 2009. Full report, National Cancer Registry [report on the Internet]. National Health Laboratory Service; no date [cited 2015 July 18]. Available from: http://www.nioh.ac.za/assets/files/NCR_2009_FINAL.pdf.
- Forouzanfar M, Foreman K, Delossantos A, et al. Breast and cervical cancer in 187 countries between 1897 and 2010: A systematic analysis. Lancet. 2001;378(9801):1461–1484. http://dx.doi:10.1016/S0140-6736(11)61351-2.
- National Department of Health. The 2010 national antenatal Sentinel HIV and syphilis prevalence survey in South Africa. Pretoria: National Department of Health; 2011.
- National Department of Health. The 2012 antenatal Sentinel HIV and Herpes Simplex Type-2 prevalence survey in South Africa. Pretoria: National Department of Health; 2014
- Firnhaber C, Van Le H, Pettifor A, et al. Association between cervical dysplasia and human papillomavirus in HIV-seropositive women from Johannesburg, South Africa. Cancer Causes Control. 2010;21(3):433–443. http://dx.doi:10.1007/s10552-009-9475-z
- Pantanowitz L, Michelow P. Review of human immunodeficiency virus (HIV) and squamous lesions of the cervix. Diagn Cytopathol. 2011;39(1):65–72. doi: 10.1002/dc.21364
- Firnhaber C, Michelow P. Cervical cancer and the human immunodeficiency virus: a review. SA J HIV Med. 2009;10(3):23–27.
- National Department of Health. Clinical guidelines for the management of HIV and AIDS in adults and adolescents [document on the Internet]. South African National Department of Health; 2010 [cited 2015 March 27]. Available from: http://www.who.int/hiv/pub/guidelines/south_africa_art.pdf.
- Firnhaber C, Mayisela N, Mao L, et al. Validation of cervical cancer screening methods in HIV positive women from Johannesburg, South Africa. PLoS One. 2013;8(1):e53494. doi: 10.1371/journal.pone.0053494
- Kelly H, Muzah B, Sawadogo B, et al. Prospective evaluation of cervical screening methods in HIV positive women in Africa (HARP study): baseline results. Paper presented at: Eurogin; 2012 July 8–11 July 2012; Prague, Czech Republic.
- National Health Laboratory Service. Annual report 2013–14 [document on the Internet]. National Health Laboratory Service; 2014 [cited 2015 July 17]. Available from: http://www.nhls.ac.za/assets/files/an_report/NHLS_ANNUAL_REPORT_2013_2014.pdf.
- Abulafia O, Pezzulo J, Sherer D. Performance of ThinPrep liquid-based cervical cytology in comparison with conventionally prepared Papanicolaou smears: a quantitative study. Gynecol Oncol. 2003;90(1):137–144. http://dx.doi.org/10.1016/S0090-8258(03)00176-8
- Arbyn M, Bergeron C, Klinkhammer P, Martin-Hirsh P, Siebers A, Bulten J. Liquid compared with conventional cytology: a systematic review and meta-analysis. Obstet Gynecol. 2008;111(1):167–177. doi: 10.1097/01.AOG.0000296488.85807.b3
- Davey E, Barratt A, Irwig L, et al. Effect of study design and quality on unsatisfactory rates, cytology classifications, and accuracy in liquid-based versus conventional cytology: a systematic review. Lancet. 2006;367(9505):122–132. http://dx.doi.org/10.1016/S0140-6736(06)67961-0
- Karnon J, Peters J, Platt J, Chilcott J, McGoogan E, Brewer N. Liquid-based cytology in cervical screening: an updated rapid and systematic review and economic analysis. Health Technol Assess. 2004;8(20):1–78. http://dx.doi.org/10.3310/hta8200
- Pan Q, Hu S, Guo H, et al. Liquid-based cytology and human papillomavirus testing: a pooled analysis using data from 13 population-based cervical cancer screening studies from China. Gynecol Oncol. 2014;133(2):172–179. doi: 10.1016/j.ygyno.2014.03.008
- Arbyn M, Ronco G, Anttila A, et al. Evidence regarding human papillomavirus testing in secondary prevention of cancer. Vaccine. 2012;30 Suppl 5: F88–F99. Solomon D, Nayar R, editors. The Bethesda System for reporting cervical cytology: definitions, criteria and explanatory notes. 2nd ed. New York: Springer; 2004. http://dx.doi.org/10.1007/978-1-4612-2042-8
- Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20:37–46. http://dx.doi.org/10.1177/001316446002000104
- Taylor S, Kuhn L, Dupree W, Denny L, De Souza M, Wright T. Direct comparison of liquid-based and conventional cytology in a South African screening trial. Int J Cancer. 2006;118(4):957–962. http://dx.doi.org/10.1002/ijc.21434
- Cox T. Liquid-based cytology: evaluation of effectiveness, cost-effectiveness, and application to present practice. J Natl Compr Canc Netw. 2004;2(6):597–611.
- De Bekker-Grob E, De Kok I, Bulten J, et al. Liquid-based cervical cytology using ThinPrep technology: weighing the pros and cons in a cost-effectiveness analysis. Cancer Causes Control. 2012;23(8):1323–1331. http://dx.doi.org/10.1007/s10552-012-0011-1
- Swierczynski S, Lewis-Chambers S, Anderson J, Keller J, Hinkle D, Ali S. Impact of liquid-based gynecologic cytology on an HIV-positive population. Acta Cytol. 2004;48(2):165–172. http://dx.doi.org/10.1159/000326311
- Firnhaber C, Zungu K, Michelow P, et al. Diverse and high prevalence of human papillomavirus associated with a significant high rate of cervical dysplasia in HIV-infected women in Johannesburg, South Africa. Acta Cytol. 2009;53(1):10–17. http://dx.doi.org/10.1159/000325079
- Grenko R, Abendroth C, Frauenhoffer E, Ruggiero F, Zaino R. Variance in the interpretation of cervical biopsy specimens obtained for atypical squamous cells of undetermined significance. Am J Clin Pathol. 2000;114(5):735–740. http://dx.doi.org/10.1309/K7C9-X5P0-001B-2HK5
- Bonvicino A, Huitron S, Fadare O. Papanicolaou test interpretations of “atypical squamous cells, cannot exclude high grade squamous intraepithelial lesion”: An investigation of requisite duration and number of colposcopic procedures to a definitive diagnosis of high-grade dysplasia in routine practice. Cancer. 2007;111(6):477–481. http://dx.doi.org/10.1002/cncr.23121
- Gupta S, Sodhani P, Chachra K, Singh V, Sehgal A. Outcome of “Atypical squamous cells” in a cervical screening programme: Implications for follow up in resource limited settings. Diagn Cytopathol. 2007;35(11):677–680. http://dx.doi.org/10.1002/dc.20719
- Girianelli V, Thuler L. Evaluation of agreement between conventional and liquid-based cytology in cervical cancer early detection based on analysis of 2,091 smears: experience at the Brazilian National Cancer Institute. Diagn Cytopathol. 2007;35(9):545–549. http://dx.doi.org/10.1002/dc.20699
- Cocchi V, Carretti D, Fanti S, et al. Intralaboratory quality assurance in cervical/vaginal cytology: an evaluation of intercytologist diagnostic reproducibility. Diagn Cytopathol. 1997;16(1):87–92. http://dx.doi.org/10.1002/(SICI)1097-0339(199701)16:1<87::AID-DC19>3.0.CO;2-7
- Stoler M, Schiffman M, Atypical squamous cells of undetermined significance/low grade squamous intraepithelial lesion triage study (ALTS) group. Interobserver reproducibility of cervical cytologic and histologic interpretations: realistic estimates from the ASCUS-LSIL triage study. JAMA. 2001;285(11):1500–1505. http://dx.doi.org/10.1001/jama.285.11.1500
- Chung J, Park E, Choi D, et al. Efficacy assessment of CellSlide® in liquid-based gynecologic cytology. Gynecol Oncol. 2005;99(3):597–602. http://dx.doi.org/10.1016/j.ygyno.2005.06.059
- Obwegeser J, Brack S. Does liquid-based technology really improve detection of cervical neoplasia? A prospective, randomized trial comparing the ThinPrep Pap Test with conventional Pap Test including follow-up of HSIL cases. Acta Cytol. 2001;45(5):709–714. http://dx.doi.org/10.1159/000328292
- Yeoh G, Chan K. Cell block preparation on residual ThinPrep sample. Diagn Cytopathol. 1999;21(6):427–431. http://dx.doi.org/10.1002/(SICI)1097-0339(199912)21:6<427::AID-DC12>3.0.CO;2-4
- Iverson D. Impact of training on cytotechnologists’ interpretation of gynecologic thin-layer preparations. Diagn Cytopathol. 1998;18(3):230–235. http://dx.doi.org/10.1002/(SICI)1097-0339(199803)18:3<230::AID-DC14>3.0.CO;2-L
|