crossmark
Laboratory Evaluation of a Dual-Path Platform Assay for Rapid Pointof-Care HIV and Syphilis Testing S. R. Leon,a,b L. B. Ramos,a S. K. Vargas,a
N. Kojima,c D. G. Perez,a,d C. F. Caceres,a J. D. Klausnere
Laboratory of Sexual Health, Universidad Peruana Cayetano Heredia, Lima, Perua; Dirección de Investigación, Socios en Salud Sucursal del Perú, Lima, Perub; David Geffen School of Medicine, University of California Los Angeles, Los Angeles, California, USAc; Department of Clinical Pathology, National Hospital Daniel A. Carrion, Callao, Perud; Division of Infectious Diseases, Department of Medicine, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, California, USAe
R
apid multiplex point-of-care tests are increasingly available means to screen for syphilis and HIV infections (1–4). Dual screening tests for antibodies to HIV and Treponema pallidum have been evaluated in serum and venipuncture whole-blood samples, showing excellent sensitivity and specificity (5–7). We assessed the laboratory performance of the Chembio dual-path platform (DPP) HIV-syphilis rapid test and the Chembio digital electronic reader with stored serum samples collected from a cohort of men who have sex with men (MSM) and transwomen at high risk for HIV and syphilis infections. Serum specimens were collected between 2013 and 2014 from MSM and transwomen who had been recruited into an ongoing cohort study in Lima, Peru, and the specimens were stored at ⫺20°C (8). HIV positivity was determined with the Genscreen Ultra HIV Ag-Ab test (Bio-Rad, Hercules, CA), a novel enzyme immunoassay (EIA) which detects HIV p24 antigen (Ag) and HIV antibodies in the same test (9). Positive EIA results were confirmed by Western blotting (New Lav Blot I; Bio-Rad). Specimens also underwent rapid plasma reagin (RPR) testing, using the BD Macro-Vue RPR card test kit (BD, Franklin Lakes, NJ), and Treponema pallidum particle agglutination (TPPA) testing (Serodia; Fujirebio Diagnostics Inc., Tokyo, Japan). All tests were used according to the manufacturers’ instructions. The Chembio DPP HIV-syphilis test is a single-use, visual and qualitative immunochromatographic, dual rapid test for the detection of antibodies to HIV types 1 and 2 and Treponema pallidum in human serum, plasma, or venous or fingerprick wholeblood samples (10). A red control line confirms test validity. Visual observation of a red line in the HIV and/or syphilis detection zone is interpreted as a reactive result (10). Immediately after visual interpretation, tests were analyzed using the small, battery-powered, Chembio electronic reader, which was designed specifically to complement the Chembio DPP technology. The electronic reader scans the DPP test cartridge and displays a numerical value based on the test line intensity. If the electronic reader value is higher than the set cutoff value, then the result for the sample is reported as positive; the test result is reported as negative if the measured value is lower than the cutoff value. We estimated the sensitivity, specificity, and 95% confidence intervals (CIs) using the exact binomial method, and we calcu-
492
jcm.asm.org
lated the concordance between the visual results of the Chembio DPP HIV-syphilis rapid test and the results of the reference tests using Cohen’s kappa coefficient. Specimens were defined as HIV positive on the basis of Western blotting results. Specimens were defined as Treponema pallidum antibody positive on the basis of TPPA test results. For electronic reader data, we estimated the sensitivity, specificity, and 95% CIs using the exact binomial method and we evaluated the performance of different cutoff values. Of the 450 specimens, 100 were confirmed by Western blotting to be HIV-1 positive only, 99 were positive for Treponema pallidum antibodies by TPPA testing only (of which 79 [80%] had RPR titers between 1:1 and 1:64), and 51 were positive for both HIV and Treponema pallidum antibodies by Western blotting and TPPA testing. Of the dual-antibody-reactive specimens, 72% (37/51 specimens) had RPR titers between 1:1 and 1:64. The remaining 200 specimens tested negative for HIV and syphilis antibodies. Additionally, positive and negative controls were used with the tested specimens. With visual interpretation of HIV antibody reactivity, the test showed 155 positive and 295 negative results (Table 1). There were 4 false-positive results (DPP test positive and Western blot negative) and no false-negative results. The sensitivity of the HIV antibody component was 100% (95% CI, 97.6% to 100.0%), and the specificity was 98.7% (95% CI, 96.6% to 99.6%). The kappa coefficient for correlation between the reference HIV-1 Western blot test results and the Chembio DPP HIV-syphilis rapid test results was 0.98 (95% CI, 0.96 to 1.0). With visual interpretation of Treponema pallidum antibody
Received 1 December 2015 Accepted 4 December 2015 Accepted manuscript posted online 9 December 2015 Citation Leon SR, Ramos LB, Vargas SK, Kojima N, Perez DG, Caceres CF, Klausner JD. 2016. Laboratory evaluation of a dual-path platform assay for rapid point-ofcare HIV and syphilis testing. J Clin Microbiol 54:492–494. doi:10.1128/JCM.03152-15. Editor: E. Munson Address correspondence to S. R. Leon, [email protected]. Copyright © 2016, American Society for Microbiology. All Rights Reserved.
Journal of Clinical Microbiology
February 2016 Volume 54 Number 2
Downloaded from http://jcm.asm.org/ on July 5, 2016 by UNIVERSITY OF EXETER
We assessed the laboratory performance of the Chembio dual-path platform HIV-syphilis rapid immunodiagnostic test and electronic reader for detection of HIV and Treponema pallidum antibodies in 450 previously characterized serum specimens. For visual or electronic reader HIV antibody detection, the sensitivity was 100% and the specificity was 98.7%. For visual T. pallidum antibody detection, the test sensitivity was 94.7% and the specificity was 100.0%; with the electronic reader, the sensitivity was 94.7% and the specificity was 99.7%.
Evaluation of Assay for HIV and Syphilis Testing
TABLE 1 Laboratory performance for detection of HIV antibodies using a dual HIV-syphilis rapid immunodiagnostic test in Lima, Peru, in 2015 (n ⫽ 450) No. of samples Western blot positive
Western blot negative
Total
Visual interpretation Positive Negative
151 0
4 295
155 295
151
299
450
151 0
4 295
155 295
151
299
450
Total
Electronic reader (cutoff value of 10) Positive Negative Total a
Sensitivity (95% CI) (%)
Specificity (95% CI) (%)
Kappa coefficient (95% CI)
100.0 (97.6–100.0)
98.7 (96.6–99.6)
0.98 (0.96–1.0)
100.0 (97.6–100.0)
98.7 (96.6–99.6)
0.98 (0.96–1.00)
DPP, dual-path platform; CI, confidence interval.
reactivity, the test showed 142 positive and 308 negative results (Table 2). There were 8 false-negative results (DPP test negative and TPPA test positive) and no false-positive results. The sensitivity of the Treponema pallidum antibody component was 94.7% (95% CI, 89.8% to 97.7%), and the specificity was 100.0% (95% CI, 98.8% to 100.0%). The kappa coefficient for correlation between the reference TPPA syphilis test results and the Chembio DPP HIV-syphilis rapid test results was 0.96 (95% CI, 0.93 to 0.99). Using the Chembio electronic reader with the default cutoff value of 10 for HIV antibody detection, the sensitivity was 100.0% (95% CI, 97.6% to 100.0%), the specificity was 98.7% (95% CI, 96.6% to 99.6%), and the kappa coefficient was 0.98 (95% CI, 0.96 to 1.00) (Table 1). When the cutoff value was changed to 21, the specificity was 100.0% (95% CI, 98.8% to 100.0%), the sensitivity was 100.0% (95% CI, 97.6% to 100.0%), and the kappa coefficient for correlation was 1.0. No statistical difference was found when use of a cutoff value of 10 was compared with visual interpretation (P ⬎ 0.1). Using the Chembio electronic reader with the default cutoff value of 10 for Treponema pallidum antibody detection, the sensi-
tivity was 94.7% (95% CI, 89.8% to 97.7%), the specificity was 99.7% (95% CI, 98.2% to 100.0%), and the kappa coefficient was 0.95 (95% CI, 0.93 to 0.98) (Table 2). Various cutoff values for the Treponema pallidum antibody component showed that the cutoff value of 10 demonstrated the best performance. No statistical difference was found when use of a cutoff value of 10 was compared with visual interpretation (P ⬎ 0.1). Repeat laboratory testing was performed for the specimens with discordant test results. All 4 specimens with initial false-positive results for HIV antibodies were found to be negative in repeat testing with the Chembio DPP HIV-syphilis rapid test, with both visual interpretation and the electronic reader. Of the 8 specimens with false-negative results for treponemal antibodies, repeat Chembio DPP HIV-syphilis rapid tests were weakly positive for 4 samples using visual observation; 4 samples remained negative. The electronic reader classified 2 of the 4 samples that were weakly reactive using visual interpretation as positive. We conducted a laboratory-based performance study of the Chembio DPP HIV-syphilis rapid test and the electronic reader with characterized stored serum samples in Lima, Peru. With vi-
TABLE 2 Laboratory performance for detection of Treponema pallidum antibodies using a dual HIV-syphilis rapid immunodiagnostic test in Lima, Peru, in 2015 (n ⫽ 450) No. of samples Chembio DPP test resulta
TPPA test positive
TPPA test negative
Total
Visual interpretation Positive Negative
142 8
0 300
142 308
150
300
450
142 8
1 299
143 307
150
300
450
Total
Electronic reader (cutoff value of 10) Positive Negative Total a
Sensitivity (95% CI) (%)
Specificity (95% CI) (%)
Kappa coefficient (95% CI)
94.7 (89.8–97.7)
100.0 (98.8–100)
0.96 (0.93–0.99)
94.7 (89.8–97.7)
99.7 (98.2–100.0)
0.95 (0.93–0.98)
DPP, dual-path platform; TPPA, Treponema pallidum particle agglutination; CI, confidence interval.
February 2016 Volume 54 Number 2
Journal of Clinical Microbiology
jcm.asm.org
493
Downloaded from http://jcm.asm.org/ on July 5, 2016 by UNIVERSITY OF EXETER
Chembio DPP test resulta
Leon et al.
ACKNOWLEDGMENTS
3.
4.
5.
6.
7.
8.
9.
10.
11.
We thank all of the participants in the study, as well as the staff at Barton Health Center, Epicentro, and Cayetano Heredia University. All test materials were donated by Chembio Diagnostic Systems, Inc. The funders and donors had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
12.
FUNDING INFORMATION HHS | National Institutes of Health (NIH) provided funding to Carlos F. Caceres under grant number 5R01AI099727.
13.
REFERENCES 1. García PJ, Cárcamo CP, Chiappe M, Valderrama M, La Rosa S, Holmes KK, Mabey DC, Peeling RW. 2013. Rapid syphilis tests as catalysts for health systems strengthening: a case study from Peru. PLoS One 8:e66905. http://dx.doi.org/10.1371/journal.pone.0066905. 2. Ormaeche M, Whittembury A, Pun M, Suárez-Ognio L. 2012. Hepatitis B virus, syphilis, and HIV seroprevalence in pregnant women and their male partners from six indigenous populations of the Peruvian Amazon
494
jcm.asm.org
14.
Basin, 2007–2008. Int J Infect Dis 16:e724 – e730. http://dx.doi.org/10 .1016/j.ijid.2012.05.1032. Campos PE, Buffardi AL, Chiappe M, Buendía C, Garcia PJ, Carcamo CP, Garnett G, White P, Holmes KK. 2006. Utility of the Determine Syphilis TP rapid test in commercial sex venues in Peru. Sex Transm Infect 82(Suppl 5):v22–v25. http://dx.doi.org/10.1136/sti.2006.023325. Griemberg G, Ravelli MR, Etcheves PC, Orfus G, Pizzimenti MC. 2000. Syphilis and pregnancy: prenatal control, seroprevalence and false biological positives. Medicina (B Aires) 60:343–347. (In Spanish.) Humphries RM, Woo JS, Chung JH, Sokovic A, Bristow CC, Klausner JD. 2014. Laboratory evaluation of three rapid diagnostic tests for dual detection of HIV and Treponema pallidum antibodies. J Clin Microbiol 52:4394 – 4397. http://dx.doi.org/10.1128/JCM.02468-14. Yin YP, Ngige E, Anyaike C, Ijaodola G, Oyelade TA, Vaz RG, Newman LM, Chen XS. 2015. Laboratory evaluation of three dual rapid diagnostic tests for HIV and syphilis in China and Nigeria. Int J Gynaecol Obstet 130(Suppl 1):S22–S26. http://dx.doi.org/10.1016/j.ijgo.2015.04.004. Hess KL, Fisher DG, Reynolds GL. 2014. Sensitivity and specificity of point-of-care rapid combination syphilis-HIV-HCV tests. PLoS One 9:e112190. http://dx.doi.org/10.1371/journal.pone.0112190. Deiss RG, Leon SR, Konda KA, Brown B, Segura ER, Galea JT, Caceres CF, Klausner JD. 2013. Characterizing the syphilis epidemic among men who have sex with men in Lima, Peru to identify new treatment and control strategies. BMC Infect Dis 13:426. http://dx.doi.org/10.1186/1471 -2334-13-426. Bio-Rad. 2010. Genscreen™ ULTRA HIV Ag-Ab product insert. Bio-Rad, Marnes-la-Coquette, France. http://www.bio-rad.com/webroot/web/pdf /inserts/CDG/en/883605_EN.pdf. Masciotra S, Price KA, Sprinkle P, Wesolowski L, Owen SM. 2015. Performance evaluation of the CHEMBIO DPP® (dual path platform) HIV-1/2 assay in early and established infections. J Clin Virol 70:97–100. http://dx.doi.org/10.1016/j.jcv.2015.07.005. Bristow CC, Leon SR, Ramos LB, Vargas SK, Flores JA, Konda KA, Caceres CF, Klausner JD. 2015. Laboratory evaluation of a dual rapid immunodiagnostic test for HIV and syphilis infection. J Clin Microbiol 53:311–313. http://dx.doi.org/10.1128/JCM.02763-14. Bristow CC, Adu-Sarkodie Y, Ondondo RO, Bukusi EA, Dagnra CA, Oo KY, Pe EH, Khamsay C, Houng lT, Campuzano RV, Estes J, Klausner JD. 2014. Multisite laboratory evaluation of a dual human immunodeficiency virus (HIV)/syphilis point-of-care rapid test for simultaneous detection of HIV and syphilis infection. Open Forum Infect Dis 1:ofu015. http://dx.doi.org/10.1093/ofid/ofu015. Nabity SA, Ribeiro GS, Aquino CL, Takahashi D, Damião AO, Gonçalves AH, Miranda-Filho DB, Greenwald R, Esfandiari J, Lyashchenko KP, Reis MG, Medeiros MA, Ko AI. 2012. Accuracy of a dual path platform (DPP) assay for the rapid point-of-care diagnosis of human leptospirosis. PLoS Negl Trop Dis 6:e1878. http://dx.doi.org/10.1371/journal .pntd.0001878. Omoding D, Katawera V, Siedner M, Boum Y. 2014. Evaluation of the SD Bioline HIV/Syphilis Duo assay at a rural health center in southwestern Uganda. BMC Res Notes 7:746. http://dx.doi.org/10.1186 /1756-0500-7-746.
Journal of Clinical Microbiology
February 2016 Volume 54 Number 2
Downloaded from http://jcm.asm.org/ on July 5, 2016 by UNIVERSITY OF EXETER
sual interpretation, we found outstanding test performance. Different electronic reader cutoff values were tested, and the cutoff value of 21 had 100% specificity and sensitivity for HIV antibody detection. For Treponema pallidum antibody detection, the electronic reader with the default cutoff value of 10 had the best sensitivity and specificity. Our results are comparable to those of laboratory evaluations that were conducted previously with different point-of-care tests for HIV and treponemal antibody detection in sera and whole blood, which also yielded high performance values for sensitivity and specificity (1, 5–7, 11–13). In our evaluation, the sensitivity of the Chembio DPP HIV-syphilis rapid test to detect HIV antibodies was somewhat greater than its sensitivity to detect syphilis antibodies, in concurrence with several other studies (5, 6, 11, 12, 14). Our study had some limitations. We used specimens from a single population in Lima, Peru, which did not include any pregnant women or low-risk populations. The population had high risks for HIV and syphilis acquisition; therefore, our values for the sensitivity and specificity of the test might not be representative. The tested specimens were stored serum samples instead of the ideal samples, i.e., fingerprick whole-blood specimens. Since the evaluation of stored serum specimens seemed to be highly accurate, further studies using fingerprick whole-blood specimens are warranted, to evaluate the field performance of the Chembio DPP HIV-syphilis rapid test and the electronic reader.
Laboratory Evaluation of a Dual-Path Platform Assay for Rapid Pointof-Care HIV and Syphilis Testing S. R. Leon,a,b L. B. Ramos,a S. K. Vargas,a
N. Kojima,c D. G. Perez,a,d C. F. Caceres,a J. D. Klausnere
Laboratory of Sexual Health, Universidad Peruana Cayetano Heredia, Lima, Perua; Dirección de Investigación, Socios en Salud Sucursal del Perú, Lima, Perub; David Geffen School of Medicine, University of California Los Angeles, Los Angeles, California, USAc; Department of Clinical Pathology, National Hospital Daniel A. Carrion, Callao, Perud; Division of Infectious Diseases, Department of Medicine, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, California, USAe
R
apid multiplex point-of-care tests are increasingly available means to screen for syphilis and HIV infections (1–4). Dual screening tests for antibodies to HIV and Treponema pallidum have been evaluated in serum and venipuncture whole-blood samples, showing excellent sensitivity and specificity (5–7). We assessed the laboratory performance of the Chembio dual-path platform (DPP) HIV-syphilis rapid test and the Chembio digital electronic reader with stored serum samples collected from a cohort of men who have sex with men (MSM) and transwomen at high risk for HIV and syphilis infections. Serum specimens were collected between 2013 and 2014 from MSM and transwomen who had been recruited into an ongoing cohort study in Lima, Peru, and the specimens were stored at ⫺20°C (8). HIV positivity was determined with the Genscreen Ultra HIV Ag-Ab test (Bio-Rad, Hercules, CA), a novel enzyme immunoassay (EIA) which detects HIV p24 antigen (Ag) and HIV antibodies in the same test (9). Positive EIA results were confirmed by Western blotting (New Lav Blot I; Bio-Rad). Specimens also underwent rapid plasma reagin (RPR) testing, using the BD Macro-Vue RPR card test kit (BD, Franklin Lakes, NJ), and Treponema pallidum particle agglutination (TPPA) testing (Serodia; Fujirebio Diagnostics Inc., Tokyo, Japan). All tests were used according to the manufacturers’ instructions. The Chembio DPP HIV-syphilis test is a single-use, visual and qualitative immunochromatographic, dual rapid test for the detection of antibodies to HIV types 1 and 2 and Treponema pallidum in human serum, plasma, or venous or fingerprick wholeblood samples (10). A red control line confirms test validity. Visual observation of a red line in the HIV and/or syphilis detection zone is interpreted as a reactive result (10). Immediately after visual interpretation, tests were analyzed using the small, battery-powered, Chembio electronic reader, which was designed specifically to complement the Chembio DPP technology. The electronic reader scans the DPP test cartridge and displays a numerical value based on the test line intensity. If the electronic reader value is higher than the set cutoff value, then the result for the sample is reported as positive; the test result is reported as negative if the measured value is lower than the cutoff value. We estimated the sensitivity, specificity, and 95% confidence intervals (CIs) using the exact binomial method, and we calcu-
492
jcm.asm.org
lated the concordance between the visual results of the Chembio DPP HIV-syphilis rapid test and the results of the reference tests using Cohen’s kappa coefficient. Specimens were defined as HIV positive on the basis of Western blotting results. Specimens were defined as Treponema pallidum antibody positive on the basis of TPPA test results. For electronic reader data, we estimated the sensitivity, specificity, and 95% CIs using the exact binomial method and we evaluated the performance of different cutoff values. Of the 450 specimens, 100 were confirmed by Western blotting to be HIV-1 positive only, 99 were positive for Treponema pallidum antibodies by TPPA testing only (of which 79 [80%] had RPR titers between 1:1 and 1:64), and 51 were positive for both HIV and Treponema pallidum antibodies by Western blotting and TPPA testing. Of the dual-antibody-reactive specimens, 72% (37/51 specimens) had RPR titers between 1:1 and 1:64. The remaining 200 specimens tested negative for HIV and syphilis antibodies. Additionally, positive and negative controls were used with the tested specimens. With visual interpretation of HIV antibody reactivity, the test showed 155 positive and 295 negative results (Table 1). There were 4 false-positive results (DPP test positive and Western blot negative) and no false-negative results. The sensitivity of the HIV antibody component was 100% (95% CI, 97.6% to 100.0%), and the specificity was 98.7% (95% CI, 96.6% to 99.6%). The kappa coefficient for correlation between the reference HIV-1 Western blot test results and the Chembio DPP HIV-syphilis rapid test results was 0.98 (95% CI, 0.96 to 1.0). With visual interpretation of Treponema pallidum antibody
Received 1 December 2015 Accepted 4 December 2015 Accepted manuscript posted online 9 December 2015 Citation Leon SR, Ramos LB, Vargas SK, Kojima N, Perez DG, Caceres CF, Klausner JD. 2016. Laboratory evaluation of a dual-path platform assay for rapid point-ofcare HIV and syphilis testing. J Clin Microbiol 54:492–494. doi:10.1128/JCM.03152-15. Editor: E. Munson Address correspondence to S. R. Leon, [email protected]. Copyright © 2016, American Society for Microbiology. All Rights Reserved.
Journal of Clinical Microbiology
February 2016 Volume 54 Number 2
Downloaded from http://jcm.asm.org/ on July 5, 2016 by UNIVERSITY OF EXETER
We assessed the laboratory performance of the Chembio dual-path platform HIV-syphilis rapid immunodiagnostic test and electronic reader for detection of HIV and Treponema pallidum antibodies in 450 previously characterized serum specimens. For visual or electronic reader HIV antibody detection, the sensitivity was 100% and the specificity was 98.7%. For visual T. pallidum antibody detection, the test sensitivity was 94.7% and the specificity was 100.0%; with the electronic reader, the sensitivity was 94.7% and the specificity was 99.7%.
Evaluation of Assay for HIV and Syphilis Testing
TABLE 1 Laboratory performance for detection of HIV antibodies using a dual HIV-syphilis rapid immunodiagnostic test in Lima, Peru, in 2015 (n ⫽ 450) No. of samples Western blot positive
Western blot negative
Total
Visual interpretation Positive Negative
151 0
4 295
155 295
151
299
450
151 0
4 295
155 295
151
299
450
Total
Electronic reader (cutoff value of 10) Positive Negative Total a
Sensitivity (95% CI) (%)
Specificity (95% CI) (%)
Kappa coefficient (95% CI)
100.0 (97.6–100.0)
98.7 (96.6–99.6)
0.98 (0.96–1.0)
100.0 (97.6–100.0)
98.7 (96.6–99.6)
0.98 (0.96–1.00)
DPP, dual-path platform; CI, confidence interval.
reactivity, the test showed 142 positive and 308 negative results (Table 2). There were 8 false-negative results (DPP test negative and TPPA test positive) and no false-positive results. The sensitivity of the Treponema pallidum antibody component was 94.7% (95% CI, 89.8% to 97.7%), and the specificity was 100.0% (95% CI, 98.8% to 100.0%). The kappa coefficient for correlation between the reference TPPA syphilis test results and the Chembio DPP HIV-syphilis rapid test results was 0.96 (95% CI, 0.93 to 0.99). Using the Chembio electronic reader with the default cutoff value of 10 for HIV antibody detection, the sensitivity was 100.0% (95% CI, 97.6% to 100.0%), the specificity was 98.7% (95% CI, 96.6% to 99.6%), and the kappa coefficient was 0.98 (95% CI, 0.96 to 1.00) (Table 1). When the cutoff value was changed to 21, the specificity was 100.0% (95% CI, 98.8% to 100.0%), the sensitivity was 100.0% (95% CI, 97.6% to 100.0%), and the kappa coefficient for correlation was 1.0. No statistical difference was found when use of a cutoff value of 10 was compared with visual interpretation (P ⬎ 0.1). Using the Chembio electronic reader with the default cutoff value of 10 for Treponema pallidum antibody detection, the sensi-
tivity was 94.7% (95% CI, 89.8% to 97.7%), the specificity was 99.7% (95% CI, 98.2% to 100.0%), and the kappa coefficient was 0.95 (95% CI, 0.93 to 0.98) (Table 2). Various cutoff values for the Treponema pallidum antibody component showed that the cutoff value of 10 demonstrated the best performance. No statistical difference was found when use of a cutoff value of 10 was compared with visual interpretation (P ⬎ 0.1). Repeat laboratory testing was performed for the specimens with discordant test results. All 4 specimens with initial false-positive results for HIV antibodies were found to be negative in repeat testing with the Chembio DPP HIV-syphilis rapid test, with both visual interpretation and the electronic reader. Of the 8 specimens with false-negative results for treponemal antibodies, repeat Chembio DPP HIV-syphilis rapid tests were weakly positive for 4 samples using visual observation; 4 samples remained negative. The electronic reader classified 2 of the 4 samples that were weakly reactive using visual interpretation as positive. We conducted a laboratory-based performance study of the Chembio DPP HIV-syphilis rapid test and the electronic reader with characterized stored serum samples in Lima, Peru. With vi-
TABLE 2 Laboratory performance for detection of Treponema pallidum antibodies using a dual HIV-syphilis rapid immunodiagnostic test in Lima, Peru, in 2015 (n ⫽ 450) No. of samples Chembio DPP test resulta
TPPA test positive
TPPA test negative
Total
Visual interpretation Positive Negative
142 8
0 300
142 308
150
300
450
142 8
1 299
143 307
150
300
450
Total
Electronic reader (cutoff value of 10) Positive Negative Total a
Sensitivity (95% CI) (%)
Specificity (95% CI) (%)
Kappa coefficient (95% CI)
94.7 (89.8–97.7)
100.0 (98.8–100)
0.96 (0.93–0.99)
94.7 (89.8–97.7)
99.7 (98.2–100.0)
0.95 (0.93–0.98)
DPP, dual-path platform; TPPA, Treponema pallidum particle agglutination; CI, confidence interval.
February 2016 Volume 54 Number 2
Journal of Clinical Microbiology
jcm.asm.org
493
Downloaded from http://jcm.asm.org/ on July 5, 2016 by UNIVERSITY OF EXETER
Chembio DPP test resulta
Leon et al.
ACKNOWLEDGMENTS
3.
4.
5.
6.
7.
8.
9.
10.
11.
We thank all of the participants in the study, as well as the staff at Barton Health Center, Epicentro, and Cayetano Heredia University. All test materials were donated by Chembio Diagnostic Systems, Inc. The funders and donors had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
12.
FUNDING INFORMATION HHS | National Institutes of Health (NIH) provided funding to Carlos F. Caceres under grant number 5R01AI099727.
13.
REFERENCES 1. García PJ, Cárcamo CP, Chiappe M, Valderrama M, La Rosa S, Holmes KK, Mabey DC, Peeling RW. 2013. Rapid syphilis tests as catalysts for health systems strengthening: a case study from Peru. PLoS One 8:e66905. http://dx.doi.org/10.1371/journal.pone.0066905. 2. Ormaeche M, Whittembury A, Pun M, Suárez-Ognio L. 2012. Hepatitis B virus, syphilis, and HIV seroprevalence in pregnant women and their male partners from six indigenous populations of the Peruvian Amazon
494
jcm.asm.org
14.
Basin, 2007–2008. Int J Infect Dis 16:e724 – e730. http://dx.doi.org/10 .1016/j.ijid.2012.05.1032. Campos PE, Buffardi AL, Chiappe M, Buendía C, Garcia PJ, Carcamo CP, Garnett G, White P, Holmes KK. 2006. Utility of the Determine Syphilis TP rapid test in commercial sex venues in Peru. Sex Transm Infect 82(Suppl 5):v22–v25. http://dx.doi.org/10.1136/sti.2006.023325. Griemberg G, Ravelli MR, Etcheves PC, Orfus G, Pizzimenti MC. 2000. Syphilis and pregnancy: prenatal control, seroprevalence and false biological positives. Medicina (B Aires) 60:343–347. (In Spanish.) Humphries RM, Woo JS, Chung JH, Sokovic A, Bristow CC, Klausner JD. 2014. Laboratory evaluation of three rapid diagnostic tests for dual detection of HIV and Treponema pallidum antibodies. J Clin Microbiol 52:4394 – 4397. http://dx.doi.org/10.1128/JCM.02468-14. Yin YP, Ngige E, Anyaike C, Ijaodola G, Oyelade TA, Vaz RG, Newman LM, Chen XS. 2015. Laboratory evaluation of three dual rapid diagnostic tests for HIV and syphilis in China and Nigeria. Int J Gynaecol Obstet 130(Suppl 1):S22–S26. http://dx.doi.org/10.1016/j.ijgo.2015.04.004. Hess KL, Fisher DG, Reynolds GL. 2014. Sensitivity and specificity of point-of-care rapid combination syphilis-HIV-HCV tests. PLoS One 9:e112190. http://dx.doi.org/10.1371/journal.pone.0112190. Deiss RG, Leon SR, Konda KA, Brown B, Segura ER, Galea JT, Caceres CF, Klausner JD. 2013. Characterizing the syphilis epidemic among men who have sex with men in Lima, Peru to identify new treatment and control strategies. BMC Infect Dis 13:426. http://dx.doi.org/10.1186/1471 -2334-13-426. Bio-Rad. 2010. Genscreen™ ULTRA HIV Ag-Ab product insert. Bio-Rad, Marnes-la-Coquette, France. http://www.bio-rad.com/webroot/web/pdf /inserts/CDG/en/883605_EN.pdf. Masciotra S, Price KA, Sprinkle P, Wesolowski L, Owen SM. 2015. Performance evaluation of the CHEMBIO DPP® (dual path platform) HIV-1/2 assay in early and established infections. J Clin Virol 70:97–100. http://dx.doi.org/10.1016/j.jcv.2015.07.005. Bristow CC, Leon SR, Ramos LB, Vargas SK, Flores JA, Konda KA, Caceres CF, Klausner JD. 2015. Laboratory evaluation of a dual rapid immunodiagnostic test for HIV and syphilis infection. J Clin Microbiol 53:311–313. http://dx.doi.org/10.1128/JCM.02763-14. Bristow CC, Adu-Sarkodie Y, Ondondo RO, Bukusi EA, Dagnra CA, Oo KY, Pe EH, Khamsay C, Houng lT, Campuzano RV, Estes J, Klausner JD. 2014. Multisite laboratory evaluation of a dual human immunodeficiency virus (HIV)/syphilis point-of-care rapid test for simultaneous detection of HIV and syphilis infection. Open Forum Infect Dis 1:ofu015. http://dx.doi.org/10.1093/ofid/ofu015. Nabity SA, Ribeiro GS, Aquino CL, Takahashi D, Damião AO, Gonçalves AH, Miranda-Filho DB, Greenwald R, Esfandiari J, Lyashchenko KP, Reis MG, Medeiros MA, Ko AI. 2012. Accuracy of a dual path platform (DPP) assay for the rapid point-of-care diagnosis of human leptospirosis. PLoS Negl Trop Dis 6:e1878. http://dx.doi.org/10.1371/journal .pntd.0001878. Omoding D, Katawera V, Siedner M, Boum Y. 2014. Evaluation of the SD Bioline HIV/Syphilis Duo assay at a rural health center in southwestern Uganda. BMC Res Notes 7:746. http://dx.doi.org/10.1186 /1756-0500-7-746.
Journal of Clinical Microbiology
February 2016 Volume 54 Number 2
Downloaded from http://jcm.asm.org/ on July 5, 2016 by UNIVERSITY OF EXETER
sual interpretation, we found outstanding test performance. Different electronic reader cutoff values were tested, and the cutoff value of 21 had 100% specificity and sensitivity for HIV antibody detection. For Treponema pallidum antibody detection, the electronic reader with the default cutoff value of 10 had the best sensitivity and specificity. Our results are comparable to those of laboratory evaluations that were conducted previously with different point-of-care tests for HIV and treponemal antibody detection in sera and whole blood, which also yielded high performance values for sensitivity and specificity (1, 5–7, 11–13). In our evaluation, the sensitivity of the Chembio DPP HIV-syphilis rapid test to detect HIV antibodies was somewhat greater than its sensitivity to detect syphilis antibodies, in concurrence with several other studies (5, 6, 11, 12, 14). Our study had some limitations. We used specimens from a single population in Lima, Peru, which did not include any pregnant women or low-risk populations. The population had high risks for HIV and syphilis acquisition; therefore, our values for the sensitivity and specificity of the test might not be representative. The tested specimens were stored serum samples instead of the ideal samples, i.e., fingerprick whole-blood specimens. Since the evaluation of stored serum specimens seemed to be highly accurate, further studies using fingerprick whole-blood specimens are warranted, to evaluate the field performance of the Chembio DPP HIV-syphilis rapid test and the electronic reader.
