This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrowReprints and Permissions
Right arrow Copyright Information
Right arrow Books from ASM Press
Right arrow MicrobeWorld
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Gamiel, J. L.
Right arrow Articles by Quinn, T. C.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Gamiel, J. L.
Right arrow Articles by Quinn, T. C.

 Previous Article  |  Next Article 

Clinical and Vaccine Immunology, May 2008, p. 888-890, Vol. 15, No. 5
1071-412X/08/$08.00+0     doi:10.1128/CVI.00453-07
Copyright © 2008, American Society for Microbiology. All Rights Reserved.

Improved Performance of Enzyme-Linked Immunosorbent Assays and the Effect of Human Immunodeficiency Virus Coinfection on the Serologic Detection of Herpes Simplex Virus Type 2 in Rakai, Uganda{triangledown}

Jordyn L. Gamiel,1 Aaron A. R. Tobian,2 Oliver B. Laeyendecker,1,3 Steven J. Reynolds,1,3 Rhoda Ashley Morrow,4 David Serwadda,5 Ronald H. Gray,6 and Thomas C. Quinn1,3*

Department of Medicine, Johns Hopkins University School of Medicine, Baltimore, Maryland,1 Department of Pathology, Johns Hopkins University School of Medicine, Baltimore, Maryland,2 National Institute of Allergy and Infectious Diseases, National Institutes of Health, Bethesda, Maryland,3 Department of Laboratory Medicine, University of Washington, Seattle, Washington,4 Institute of Public Health, Makerere University, Kampala, Uganda,5 Department of Population, Family and Reproductive Health Sciences, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland6

Received 29 October 2007/ Returned for modification 28 January 2008/ Accepted 21 February 2008


arrow
ABSTRACT
 
Ugandan subjects (820) were tested by Focus HerpeSelect enzyme-linked immunosorbent assay (ELISA), Kalon herpes simplex virus type 2 ELISA, and BioKit rapid test, and the results were compared to those of Western blotting. Higher-than-standard-index cutoff values gave optimal sensitivity and specificity. Kalon ELISA was the optimal assay when an index value of 1.5 was used (sensitivity, 91.7%; specificity, 92.4%).


arrow
TEXT
 
Herpes simplex virus type 2 (HSV-2) infection is one of the most common sexually transmitted diseases, and HSV-2 is the main cause of genital ulceration worldwide (4, 5, 17). Genital HSV-2 infections are associated with an increased risk for acquiring human immunodeficiency virus type 1 (HIV-1) (5). Diagnosis of HSV-2 infection in sub-Saharan Africa and developing countries elsewhere, where the prevalence is high, has been problematic. Serologic tests for HSV-2 that use an enzyme-linked immunosorbent assay (ELISA) or dot blot are technically simple and relatively inexpensive (15) but have been complicated by a variable rate of samples with positive HSV-2 ELISA and negative Western blot results (6, 8, 10, 15). In addition, the Western blot assay is expensive, difficult to read, and inefficient for evaluating large numbers of samples for clinical trials (2). We and others have previously demonstrated that a higher index cutoff value is required for optimal sensitivity and specificity for the Focus HerpeSelect HSV-2 ELISA (3, 10); however, the assay still lacks specificity. Therefore, Focus HerpeSelect ELISA, Kalon HSV-2 ELISA, and BioKit rapid test were compared to Western blotting as the gold standard.

The study utilized sera from 820 subjects (273 HIV positive and 547 HIV negative) collected in a population-based randomized control trial of presumptive sexually transmitted disease treatment among adults aged 15 to 19 in Rakai District, Uganda, from 1994 to 1998 (7, 10). All relevant institutional review boards in Uganda and at Johns Hopkins University and the National Institutes of Health approved the trial. Samples were collected at the participant's home, processed for sera, and stored at –70°C. The University of Washington HSV-2-specific Western blot analysis was performed as previously described (1, 12). The Focus HerpeSelect HSV-2 ELISA (Focus Technologies, Cypress, CA) and Kalon ELISA (Kalon Biological Ltd., Guilford, United Kingdom) were performed according to the manufacturers' protocols (11) with a few modifications. Samples and controls were run in either triplicate (Focus) or duplicate (Kalon). Mean index values were used for all calculations. Any samples with discordant results were run again. The Sure-Vue HSV-2 rapid test (BioKit USA Inc., Lexington, MA) was performed according to the protocol for serum samples. HIV status was determined using two different ELISAs (the Vironostika HIV-1 [Organon Teknika, Charlotte, NC] and one from Cambridge Biotech, Worcester, MA). Discordant results or new seroconversions were confirmed by HIV-1 Western blot assay (bioMerieux-Vitek, St. Louis, MO), as previously described (7). Statistical calculations and receiver operating characteristic curves were performed using Intercooled Stata 9.2 (StataCorp LP, College Station, TX).

To evaluate the performance of Focus HerpeSelect ELISA in detecting HSV-2 seroprevalence in sub-Saharan Africa, 820 subjects were tested. According to the manufacturer's instructions (index cutoff value, 1.1), the test had a sensitivity of 99.0% and a specificity of 50.7%. An index cutoff value of 3.2 was determined to provide the optimal sensitivity (88.4%) and specificity (80.8%).

Of the 820 subjects, 538 were also evaluated by Kalon ELISA. According to the manufacturer's instructions (index cutoff value, 1.1), the test had a sensitivity of 95.1% and a specificity of 87.6% (Table 1). An index value cutoff of 1.5 gave the optimal sensitivity (91.7%) and specificity (92.4%) (Table 1). The receiver operating characteristic curve demonstrated that Kalon was superior to Focus, with a greater area under the curve (Fig. 1).


View this table:
[in this window]
[in a new window]

  		TABLE 1. Performance of the Kalon HSV-2 ELISA


Figure 1
View larger version (16K):
[in this window]
[in a new window]

  		FIG. 1. Receiver operating characteristic curves for Focus and Kalon assays. The areas under the curve are 0.98 for Kalon and 0.93 for Focus.

Of the 820 subjects, 524 were also evaluated with the BioKit rapid point-of-care test. According to the manufacturer's instructions, which indicated that low-positive results should be considered positive, the sensitivity was 95.8% and the specificity was 56.1%. Adjustment of index values was not possible for this assay.

Due to the association between HIV-1 and HSV-2 (5, 13, 14), it is important to determine the effect of HIV-1 infection on HSV-2 antibody detection. For both ELISAs and the BioKit assay, there were higher proportions of subjects positive for HSV-2 among the HIV-1-infected than among the uninfected populations (P < 0.001). However, none of the assays were significantly affected by HIV-1 status (Table 2).


View this table:
[in this window]
[in a new window]

  		TABLE 2. Performance of HSV-2 serology assays by HIV statusa

This study represents the largest investigation of the performances of three different commercial HSV-2 assays in sub-Saharan Africa. We demonstrated that the Kalon HSV-2 immunoglobulin G ELISA was improved at a higher index cutoff value of 1.5 than for subjects from the Western hemisphere and is superior to both the Focus HerpeSelect ELISA and the BioKit rapid point-of-care antibody test. In addition, we found that HIV status does not significantly affect the HSV-2 serologic diagnosis.

While adjusting the index values of the assays for subjects from sub-Saharan Africa significantly improved both the sensitivity and specificity, there were still both false-negative and false-positive results. The false negatives could have been due to an early infection, in which case the University of Washington HSV-2-specific Western blot was more sensitive. The false positives might have been due to cross-reactivity with HSV-1, which is >90% prevalent in sub-Saharan Africa (9, 16).

To create the best predictive testing strategy based on sensitivity and specificity compared to the University of Washington HSV-2-specific Western blot assay, different algorithms were analyzed. The optimal testing method with the highest combined sensitivity and specificity was to use the Focus ELISA with an index cutoff value of 1.1 and then test all positive samples with the Kalon ELISA, using an index cutoff value of 1.5. The sensitivity and specificity were then 92.0% and 92.8%, respectively. While this algorithm produced the best results overall, the results were not statistically significantly different from those using the Kalon test alone with a cutoff value of 1.5 (P = 0.7). Overall, the quickest, most economical, and most accurate method for HSV-2 detection was the Kalon ELISA but with an index cutoff higher than the manufacturer's recommendation.


arrow
ACKNOWLEDGMENTS
 
We are grateful to the study participants, whose commitment and cooperation made this study possible. We also appreciate help with statistical analysis from Melissa Riedesel and Thoai Ngo.

This study was supported by the Intramural Research Program of the National Institute of Allergy and Infectious Diseases.


arrow
FOOTNOTES
 
* Corresponding author. Mailing address: Ross Building 1159, 720 Rutland Ave., Baltimore, MD 21205. Phone: (410) 955-3151. Fax: (410) 614-9775. E-mail: tquinn{at}jhmi.edu Back

{triangledown} Published ahead of print on 5 March 2008. Back


arrow
REFERENCES
 
    1
  1. Ashley, R. L., J. Militoni, F. Lee, A. Nahmias, and L. Corey. 1988. Comparison of Western blot (immunoblot) and glycoprotein G-specific immunodot enzyme assay for detecting antibodies to herpes simplex virus types 1 and 2 in human sera. J. Clin. Microbiol. 26:662-667.[Abstract/Free Full Text]
    2. 2
  2. Ashley, R. L., and A. Wald. 1999. Genital herpes: review of the epidemic and potential use of type-specific serology. Clin. Microbiol. Rev. 12:1-8.[Abstract/Free Full Text]
    3. 3
  3. Ashley-Morrow, R., J. Nollkamper, N. J. Robinson, N. Bishop, and J. Smith. 2004. Performance of focus ELISA tests for herpes simplex virus type 1 (HSV-1) and HSV-2 antibodies among women in ten diverse geographical locations. Clin. Microbiol. Infect. 10:530-536.[CrossRef][Medline]
    4. 4
  4. Corey, L., and H. H. Handsfield. 2000. Genital herpes and public health: addressing a global problem. JAMA 283:791-794.[Abstract/Free Full Text]
    5. 5
  5. Corey, L., A. Wald, C. L. Celum, and T. C. Quinn. 2004. The effects of herpes simplex virus-2 on HIV-1 acquisition and transmission: a review of two overlapping epidemics. J. Acquir. Immune Defic. Syndr. 35:435-445.[CrossRef][Medline]
    6. 6
  6. Gorander, S., J. Mbwana, E. Lyamuya, T. Lagergard, and J. A. Liljeqvist. 2006. Mature glycoprotein g presents high performance in diagnosing herpes simplex virus type 2 infection in sera of different Tanzanian cohorts. Clin. Vaccine Immunol. 13:633-639.[Abstract/Free Full Text]
    7. 7
  7. Gray, R. H., M. J. Wawer, R. Brookmeyer, N. K. Sewankambo, D. Serwadda, F. Wabwire-Mangen, T. Lutalo, X. Li, T. van Cott, and T. C. Quinn. 2001. Probability of HIV-1 transmission per coital act in monogamous, heterosexual, HIV-1-discordant couples in Rakai, Uganda. Lancet 357:1149-1153.[CrossRef][Medline]
    8. 8
  8. Hogrefe, W., X. Su, J. Song, R. Ashley, and L. Kong. 2002. Detection of herpes simplex virus type 2-specific immunoglobulin G antibodies in African sera by using recombinant gG2, Western blotting, and gG2 inhibition. J. Clin. Microbiol. 40:3635-3640.[Abstract/Free Full Text]
    9. 9
  9. Kasubi, M. J., A. Nilsen, H. S. Marsden, T. Bergstrom, N. Langeland, and L. Haarr. 2006. Prevalence of antibodies against herpes simplex virus types 1 and 2 in children and young people in an urban region in Tanzania. J. Clin. Microbiol. 44:2801-2807.[Abstract/Free Full Text]
    10. 10
  10. Laeyendecker, O., C. Henson, R. H. Gray, R. H. Nguyen, B. J. Horne, M. J. Wawer, D. Serwadda, N. Kiwanuka, R. A. Morrow, W. Hogrefe, and T. C. Quinn. 2004. Performance of a commercial, type-specific enzyme-linked immunosorbent assay for detection of herpes simplex virus type 2-specific antibodies in Ugandans. J. Clin. Microbiol. 42:1794-1796.[Abstract/Free Full Text]
    11. 11
  11. Prince, H. E., C. E. Ernst, and W. R. Hogrefe. 2000. Evaluation of an enzyme immunoassay system for measuring herpes simplex virus (HSV) type 1-specific and HSV type 2-specific IgG antibodies. J. Clin. Lab. Anal. 14:13-16.[CrossRef][Medline]
    12. 12
  12. Safrin, S., A. Arvin, J. Mills, and R. Ashley. 1992. Comparison of the Western immunoblot assay and a glycoprotein G enzyme immunoassay for detection of serum antibodies to herpes simplex virus type 2 in patients with AIDS. J. Clin. Microbiol. 30:1312-1314.[Abstract/Free Full Text]
    13. 13
  13. Serwadda, D., R. H. Gray, N. K. Sewankambo, F. Wabwire-Mangen, M. Z. Chen, T. C. Quinn, T. Lutalo, N. Kiwanuka, G. Kigozi, F. Nalugoda, M. P. Meehan, R. Ashley Morrow, and M. J. Wawer. 2003. Human immunodeficiency virus acquisition associated with genital ulcer disease and herpes simplex virus type 2 infection: a nested case-control study in Rakai, Uganda. J. Infect. Dis. 188:1492-1497.[CrossRef][Medline]
    14. 14
  14. Stamm, W. E., H. H. Handsfield, A. M. Rompalo, R. L. Ashley, P. L. Roberts, and L. Corey. 1988. The association between genital ulcer disease and acquisition of HIV infection in homosexual men. JAMA 260:1429-1433.[Abstract/Free Full Text]
    15. 15
  15. van Dyck, E., A. Buve, H. A. Weiss, J. R. Glynn, D. W. Brown, B. De Deken, J. Parry, and R. J. Hayes. 2004. Performance of commercially available enzyme immunoassays for detection of antibodies against herpes simplex virus type 2 in African populations. J. Clin. Microbiol. 42:2961-2965.[Abstract/Free Full Text]
    16. 16
  16. Wagner, H. U., E. Van Dyck, E. Roggen, A. J. Nunn, A. Kamali, D. S. Schmid, J. G. Dobbins, and D. W. Mulder. 1994. Seroprevalence and incidence of sexually transmitted diseases in a rural Ugandan population. Int. J. STD AIDS 5:332-337.[Medline]
    17. 17
  17. Whitley, R. J., and B. Roizman. 2001. Herpes simplex virus infections. Lancet 357:1513-1518.[CrossRef][Medline]

Clinical and Vaccine Immunology, May 2008, p. 888-890, Vol. 15, No. 5
1071-412X/08/$08.00+0     doi:10.1128/CVI.00453-07
Copyright © 2008, American Society for Microbiology. All Rights Reserved.



This article has been cited by other articles:

  • Suntoke, T R, Hardick, A, Tobian, A A R, Mpoza, B, Laeyendecker, O, Serwadda, D, Opendi, P, Gaydos, C A, Gray, R H, Wawer, M J, Quinn, T C, Reynolds, S J (2009). Evaluation of multiplex real-time PCR for detection of Haemophilus ducreyi, Treponema pallidum, herpes simplex virus type 1 and 2 in the diagnosis of genital ulcer disease in the Rakai District, Uganda. Sex. Transm. Infect. 85: 97-101 [Abstract] [Full Text]  
  • Tobian, A. A.R., Serwadda, D., Quinn, T. C., Kigozi, G., Gravitt, P. E., Laeyendecker, O., Charvat, B., Ssempijja, V., Riedesel, M., Oliver, A. E., Nowak, R. G., Moulton, L. H., Chen, M. Z., Reynolds, S. J., Wawer, M. J., Gray, R. H. (2009). Male Circumcision for the Prevention of HSV-2 and HPV Infections and Syphilis. NEJM 360: 1298-1309 [Abstract] [Full Text]  

This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrowReprints and Permissions
Right arrow Copyright Information
Right arrow Books from ASM Press
Right arrow MicrobeWorld
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Gamiel, J. L.
Right arrow Articles by Quinn, T. C.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Gamiel, J. L.
Right arrow Articles by Quinn, T. C.

Copyright © 2009 by the American Society for Microbiology.   For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»