Previous Article | Next Article ![]()
Clinical and Vaccine Immunology, June 2007, p. 665-668, Vol. 14, No. 6
1071-412X/07/$08.00+0 doi:10.1128/CVI.00480-06
Copyright © 2007, American Society for Microbiology. All Rights Reserved.

Associated Regional and University Pathologists Institute for Clinical and Experimental Pathology,1 Department of Pathology, Pediatrics and Medicine, University of Utah School of Medicine, Salt Lake City, Utah2
Received 19 December 2006/ Returned for modification 31 January 2007/ Accepted 27 March 2007
|
|
|---|
|
|
|---|
Serology, particularly the detection of WNV immunoglobulin M (IgM) in serum, has become the primary method for determining acute WNV infection (2). The majority of infected persons have detectable IgM antibodies 8 days following onset of infection, and, in most cases, IgM antibodies remain detectable for 1 to 2 months. In some cases, IgM antibodies have been detected for 500 days or longer following disease onset (16). Commercial assays, including immunofluorescence assays (IFAs) and enzyme-linked immunosorbent assays (ELISAs) for the detection of IgG- and IgM-specific antibodies to WNV are commercially available for diagnostic use. While IFA has high sensitivity and specificity, with 4 to 10% cross-reactivity with other flaviviruses (7, 10, 11), this method is relatively labor intensive. Both Focus Diagnostics (Cypress, CA) and PanBio, Inc. (Columbia, MD) commercially distribute ELISAs that are approved by the Food and Drug Administration for diagnostic use. The Focus Diagnostics WNV IgM capture DxSelect ELISA uses a WNV preM/E recombinant protein antigen (4) for the detection of WNV-specific IgG and IgM. The IgM assay is a mu-capture assay that utilizes a background subtraction protocol to identify false-positive reactions due to nonspecific reactivity from interfering substances such as rheumatoid factor (RF), heterophile antibodies, and other interfering substances (5, 6, 9, 14). The PanBio WNV IgM capture ELISA uses inactivated purified native WNV antigen for the detection of WNV-specific IgG and IgM antibodies. Although the PanBio IgM assay is also a capture assay, no background subtraction protocol is recommended by the manufacturer.
We evaluated both of these commercial IgM capture ELISA systems using samples collected during the 2006 West Nile season. We also used samples from a previous study that had been collected during the 2002 West Nile season and that had been tested by both IgM IFA and the CDC IgM capture ELISA. Although the agreement, sensitivity, and specificity of the PanBio IgM capture WNV assay were determined in this previously published study (10), the PanBio assay has recently been reformulated to reduce false-positive results. In the present study, the performance characteristics of the reformulated PanBio IgM assay were evaluated and compared to the Focus IgM assay. Although PanBio does not recommend a background subtraction protocol with its IgM assay, we added a background subtraction step to the PanBio procedure to evaluate whether this protocol could improve specificity. Agreement, sensitivity, and specificity were determined both with and without the use of the background subtraction method for the PanBio assay.
|
|
|---|
Group I consisted of 40 serum samples that were collected for a previous study during the 2002 WNV season. Thirty-three of these samples had tested positive by IgM IFA and the Focus IgM capture ELISA. Eighteen of these 33 IgM-positive samples had been sent for confirmation by a plaque reduction neutralization test (PRNT) and were confirmed positive by PRNT. Seven samples that had tested negative by the Focus IgM capture ELISA were also included in this group. Six of the seven samples had negative results by IgM IFA, with the one positive having a low titer of 1:32. Clinical history and symptoms had previously been obtained for all samples in this group (10).
Group II consisted of 56 serum samples that were submitted to the clinical laboratory for WNV IgM testing during the 2006 WNV season. Samples were collected based on results from the Focus IgM capture assay, which is currently the in-house method for WNV antibody testing in the clinical laboratory. Twenty-four of these samples had tested positive, and 32 samples had tested negative for IgM antibodies to WNV.
Group III consisted of 31 serum samples that initially had positive or equivocal results but were subsequently considered equivocal or negative following the background subtraction procedure using the Focus IgM capture ELISA during the 2006 WNV season. Twenty-one of these samples had initially tested positive, and 10 had initially tested equivocal by the Focus IgM capture ELISA in the clinical laboratory. Testing of these samples was repeated using the manufacturer's recommended background subtraction protocol; 14 of 21 positive samples had negative results, and 7 of 21 samples had equivocal results following background subtraction in the clinical laboratory. Eight of 10 equivocal samples had negative results, and 2 of 10 had equivocal results following background subtraction by the Focus IgM capture assay in the clinical laboratory.
Direct identifiers had been removed from all samples in group I prior to testing, and samples had been stored at –20°C following completion of a previous study (10). Direct identifiers had been removed from all samples from groups II and III after collection from clinical frozen storage. All samples were thawed and stored at 2 to 8°C until testing was completed.
Commercial IgM capture ELISAs.
All specimens from groups I, II, and III were tested for IgM antibodies against WNV using the Focus Diagnostics WNV IgM capture DxSelect ELISA and the PanBio WNV IgM capture ELISA. Testing was performed according to the manufacturers' instructions. For the Focus assay, serum samples, positive and negative controls, and the cutoff calibrator were diluted 1:101 in sample diluent and added to microwells coated with rabbit anti-human IgM antibodies. Following a 1-h incubation at room temperature, the wells were washed, and reconstituted recombinant WNV antigen was added. The wells were incubated for 2 h at room temperature, followed by a second wash. Horseradish peroxidase-conjugated mouse anti-flavivirus conjugate was added and incubated for 30 min. A third wash step was employed, and tetramethylbenzidine and hydrogen peroxide substrate were added to each well. After 10 min, 1 M sulfuric acid was added to each well to stop the reaction. The absorbance of each well was determined spectrophotometrically at 450 nm using a microplate reader (Spectramax M5; Molecular Devices Corp., Sunnyvale, CA). An index value result was calculated for each specimen by dividing the optical density (OD) of the specimen well with the mean OD of the cutoff calibrator tested in triplicate. Samples with an index value of
1.11 were considered reactive (positive), values of 0.90 to 1.10 were indeterminate (equivocal), and values of
0.89 were considered nonreactive (negative).
Testing of all positive samples was repeated using the manufacturer's recommended background subtraction procedure to check for false positives due to nonspecific reactivity (14). All serum samples were incubated in two separate duplicate wells and washed as described above. WNV antigen was added to the first well (antigen well) and sample diluent (phosphate-buffered saline [PBS]) was added to the second well (background well). The assay was completed according to manufacturer's specifications. For each sample, the OD of the background well was subtracted from the OD of the antigen well. An index value result was calculated for each specimen using the reduced OD divided by the OD of the cutoff calibrator tested in triplicate.
For the PanBio IgM capture assay, serum samples, positive and negative controls, and the cutoff calibrator were diluted 1:101 in sample diluent and added to wells of a microtiter plate coated with polyclonal sheep anti-human IgM antibodies. Following a 1-h incubation at 37°C, wells were washed, and a horseradish peroxidase-conjugated mouse anti-WNV monoclonal antibody-WNV antigen complex solution was added to each well and incubated for 1 h at 37°C. Following a wash step, tetramethylbenzidine substrate was added. After 10 min, 1 M phosphoric acid was added and the absorbance of each well was determined spectrophotometrically at 450 nm. An index value result was calculated for each specimen by dividing the OD of the specimen well by the mean OD of the calibrator tested in triplicate. Samples with an index value of
1.11 were considered positive, values of 0.90 to 1.10 were equivocal, and values of
0.89 were considered negative.
Background subtraction of PanBio IgM capture ELISA. All samples from group III initially had positive or equivocal results but were subsequently considered equivocal or negative following the background subtraction procedure using the Focus IgM capture ELISA in the clinical laboratory. PanBio does not recommend utilizing a background subtraction procedure with its IgM capture ELISA to test reactive specimens. Testing of the samples from group III was repeated on the PanBio IgM capture ELISA with a modification of the manufacturer's protocol to include a background subtraction procedure. Samples were tested in two identical wells of a microtiter plate; following the first wash step, antigen was added to the first well (antigen well), and sample diluent was substituted for the antigen in the second well (background well). Testing was completed according to manufacturer's specifications, and the OD of the background well was subtracted from the OD of the antigen well at 450 nm to determine the result. An index value result was calculated using the reduced OD of the sample divided by the mean OD of the cutoff calibrator tested in triplicate.
Commercial IFA. Samples from group III, excluding three samples of insufficient volume, were tested by IgM IFA using slides with wells containing WNV-infected cells (PanBio, Inc.). Serum samples were diluted 1:16 with goat anti-human IgG absorbent diluent (11, 13) in microtiter tubes. The samples were centrifuged for 2 min, and 25 µl of supernatant was added to the wells of the IFA slides. Slides were incubated for 90 min at 37°C in a moist chamber and washed for 10 min in PBS. Following the wash, 25 µl of anti-mouse and anti-human IgM dual-species fluorescein-labeled conjugate (Focus Diagnostics) was added to the wells, and the slides were incubated for 30 min in a moist chamber at 37°C. The slides were then washed with PBS for 10 min, a coverslip was applied, and the slides were examined at a magnification of x400 using an Olympus (Tokyo, Japan) BH-2 transmitting fluorescence microscope with a 100-W mercury lamp. Results were determined based on the cytoplasmic fluorescence observed in each sample well. Fluorescence was assigned using the following scale: moderate to intense apple-green cytoplasmic fluorescence received a score of 2 to 4+; low intensity or dim, but definite, cytoplasmic fluorescence received a score of 1+. Samples showing 1+ or greater cytoplasmic fluorescence over 5% or more of the well were considered positive for IgM antibodies to WNV. The titers of samples with positive results were determined by diluting each sample 1:16 in goat anti-human IgG diluent and serially diluting to 1:256 in PBS. The titer at which cytoplasmic fluorescence of 1+ or greater was observed was reported as the result for each sample.
Statistical analysis. Two-by-two contingency table analysis was used to determine agreement, clinical sensitivity, and clinical specificity for the PanBio WNV IgM capture ELISA assay. The 95% confidence intervals (CI) for the clinical sensitivity and clinical specificity were also determined. Equivocal results were not included in the calculations, and the Focus WNV IgM capture ELISA assay was used as the reference method. Results from the PanBio WNV IgM capture ELISA were compared to results from the Focus WNV IgM capture ELISA, and discordant samples were retested in duplicate for each assay. Results from the PanBio IgM capture ELISA using the background subtraction protocol were also compared to the Focus WNV IgM capture ELISA results, and testing of discordant samples was repeated in duplicate with each assay.
|
|
|---|
|
View this table: [in a new window] |
TABLE 1. Summary of IgM results comparing the PanBio WNV IgM capture ELISA to the Focus Diagnostics WNV IgM capture ELISAa
|
To determine whether the low specificity of the PanBio assay compared to the Focus assay was due to high background, testing of the 18 samples that were positive by the PanBio assay but negative or equivocal by the Focus assay was repeated in duplicate using the background subtraction procedure for both assays (Table 2). After background subtraction, 9 of the 18 discrepant samples were considered negative, 4 samples were equivocal, and 5 remained positive by the PanBio IgM capture assay. These samples were also tested by IgM IFA, excluding one of the positives due to insufficient sample volume. Sixteen of the 18 samples had negative results by IFA (Table 2). One sample was IFA positive with a titer of 1:32 but had negative IgM results for the Focus and PanBio IgM capture ELISAs following background subtraction. This sample was positive by the PanBio assay, however, prior to the use of the subtraction protocol. Agreement, sensitivity, and specificity of the PanBio IgM capture assay were recalculated using the antigen subtraction data for the 14 samples that were positive by the PanBio assay but negative by the Focus assay (Table 3). Agreement, sensitivity, and specificity were 93.8%, 94.6% (95% CI, 89 to 98%), and 92.9% (95% CI, 87 to 93%), respectively.
|
View this table: [in a new window] |
TABLE 2. Antigen subtraction results from 18 discrepant sera as tested by the Focus WNV IgM capture ELISA, PanBio WNV IgM capture ELISA, and WNV IgM IFA
|
|
View this table: [in a new window] |
TABLE 3. Summary of agreement, clinical sensitivity, and clinical specificity of the PanBio WNV IgM capture ELISA compared to the Focus Diagnostics WNV IgM capture ELISA using antigen subtractiona
|
|
|
|---|
Studies comparing the PanBio first-generation WNV IgM capture assay to the Focus WNV IgM capture assay showed a specificity of only 82.9% for the PanBio assay (20). Although the PanBio assay has been reformulated since the aforementioned study was conducted, our present study actually showed a lower specificity of 75.9% for the current reformulated assay compared to the Focus assay. Eighteen of 31 samples that had high background and were considered either negative or equivocal after subtraction using the Focus assay were positive by the PanBio assay, for a false-positive rate of 58% for these 31 samples. Applying a background subtraction procedure to the PanBio protocol increased the specificity from 75.9% to 92.9%.
A study by Sambol et al. at the Nebraska Public Health Laboratory showed that specimens in the low-positive index value range of 1.2 to 3.5 by the Focus assay had a false-positive rate of 6.5%, in which 52 of 794 positive specimens had interfering factors such as RF and heterophile antibodies at high enough levels that the results were equivocal following antigen subtraction. The Nebraska Public Health Laboratory currently sends all WNV-positive samples for reflex testing for RF, heterophile antibodies, and PRNT as a result of the study (18). Similarly, all 31 samples that contained high background in our study, except for one with an index value of 8.78, had index values in the equivocal to low-positive range between 0.92 and 3.13 by the Focus assay before background subtraction. Of the 18 false positives by the PanBio assay, 12 samples had index values in the low-positive range between 1.22 and 2.76, and the remaining 6 samples had index values of >3.5. These data indicate the importance of using a background subtraction procedure, particularly for samples that have initial results that fall in the low-positive range. Five of the 18 samples remained positive following subtraction using the PanBio method; all but one sample were negative by IFA, showing that a background procedure may help to eliminate some, but not all, false-positive results for the PanBio assay.
Assays used to detect WNV IgM-specific antibodies must be highly sensitive and specific to avoid false-positive and -negative reporting of results. Laboratories must ensure that testing and result interpretation are performed properly (16). Our study, as well as the studies of others (14, 18), indicates that interfering substances can produce erroneous results and should be considered in assay protocols for WNV IgM antibody testing. We recommend that all WNV IgM assays be standardized with respect to the evaluation of samples with high background that may cause false-positive results.
We thank PanBio, Inc., for supplying reagents used in this study.
Published ahead of print on 11 April 2007. ![]()
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2010 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»