Previous Article | Next Article ![]()
Clinical and Vaccine Immunology, November 2006, p. 1212-1216, Vol. 13, No. 11
1071-412X/06/$08.00+0 doi:10.1128/CVI.00196-06
Copyright © 2006, American Society for Microbiology. All Rights Reserved.
Animal Disease Research Unit, Agricultural Research Service, U.S. Department of Agriculture, Pullman, Washington 99164-6630,1 Queensland Department of Primary Industries, Animal Research Institute, Yeerongpilly, Queensland, 4105, Australia,2 Veterinary Clinic, Route 349 KM1.0 Interior, Mayaguez, Puerto Rico 00680,3 Department de Parasitologie, Institut Agronomique et Veterinaire Hassan II, 6202 Rabat, Morocco,4 Division of Clinical Veterinary Medicine, Department of Animal Health and Welfare, Faculty of Veterinary MedicineUniversity of Bari, Strada per Casamassima km 3-70010 Valenzano (Ba.), Italy,5 VMRD, Inc., Pullman, Washington 99163,6 Department of Veterinary Microbiology and Pathology, College of Veterinary Medicine, Washington State University, Pullman, Washington 99164-7040,7 Washington Animal Disease Diagnostic Laboratory, Pullman, Washington 99163-20378
Received 30 May 2006/ Returned for modification 11 August 2006/ Accepted 28 August 2006
|
|
|---|
|
|
|---|
|
|
|---|
IIF. The indirect immunofluorescence (IIF) assay was performed as previously described (6) using 10 µl of a 1/100 dilution of serum. A positive result was defined as fluorescence equal to or greater than that of a weak positive control sample.
PCR samples and reaction conditions. External and nested primers were previously described (5) and produced a nested amplification product of approximately 297 base pairs from within the gene coding for RAP-1. The sensitivity of the nPCR was determined on dilutions of blood containing a known number of infected erythrocytes confirmed by real-time PCR (rtPCR). SYBR green-based rtPCR (Bio-Rad, Hercules, CA) was performed with the following conditions: 5 min at 95°C; 45 cycles of 95°C for 15 s, 58°C for 30 s, and 72°C for 45 s; and 72°C final extension for 7 min with a hold at 10°C. The PCR mixture contained 20 mM Tris (pH 8.4); 50 mM KCl; 3 mM MgCl; 200 µM (each) dATP, dGTP, dCTP, and dTTP; a 0.25 µM concentration of each primer; 25 U/ml iTaq DNA polymerase; and 10 nM fluorescein stabilizer and SYBR green dye. Each reaction was performed with the iCycler iQ real-time PCR detection system (Bio-Rad). Initially, rtPCR was standardized on dilutions of pCR2.1 (Invitrogen, Carlsbad, CA) containing the full-length rap-1 gene (TOPO-rap-1) and using the same internal primers as for nPCR (see below) (Fig. 1A). These primers amplified a fragment of 297 bp from nucleotides 690 to 987. rtPCR was then performed with genomic DNA (gDNA) from known numbers of cultured B. bovis-infected erythrocytes (MO7 reference biological clone) (10) and compared with the rap-1-containing plasmid to establish a genomic-control standard curve (Fig. 1B). For the nPCR, the external-reaction primers were forward, 5'-CACGAGGAAGGAACTACCGATGTTGA-3', and reverse, 5'-CCAAGGAGCTTCAACGTACGAGGTCA-3', and the nested primers were forward, 5'-TCAACAAGGTACTCTATATGGCTACC-3', and reverse, 5'-CTACCGAGCAGAACCTTCTTCACCAT-3'. The external reaction was performed in a 50-µl volume containing 2.0 µl of sample gDNA in Tris buffer, 1.5 µl of 50 mM MgCl2, 5.0 µl 10x reaction buffer, 1.0 µl of 10 mM deoxynucleoside triphosphate mix, 1.0 µl of external primers (50 pmol/µl of both forward and reverse primers), 0.4 µl Taq polymerase (5 units/µl), and 39.1 µl of ultrapure water. The primary amplification was carried out with 25 cycles of 95°C for 1 min, 60°C for 1 min, and 72°C for 1.5 min, with a final extension time of 7 min at 72°C. For the nested reaction, 1 or 2 µl from the primary reaction was used under the same conditions but increased to 35 cycles. The nPCR products were examined following 2% agarose gel electrophoresis (Fig. 1C).
![]() View larger version (54K): [in a new window] |
FIG. 1. Validation of the Babesia bovis-specific nested PCR. (A) Real-time PCR detection of the B. bovis rap-1 gene (297 bp). The standard curve was generated using TOPO-RAP-1. On the x axis, the log starting quantity of template is equal to the copy number. Correlation coefficient, 0.996; slope, 3.362; intercept, 33.778; y = 3.362x + 33.778. (B) Real-time PCR detection of the B. bovis rap-1 gene from dilutions of MO7 B. bovis genomic DNA extracted from cultured infected erythrocytes. On the x axis, the log starting quantity of template is equal to genomic units. Correlation coefficient, 0.992; slope, 3.597; intercept, 33.418; y = 3.597x + 33.418. (C) Nested PCR of MO7 B. bovis genomic DNA extracted from 10-µl volumes of 50% suspensions of erythrocytes spiked with 10-fold dilutions of infected erythrocytes beginning with 108/ml. big, Babesia bigemina genomic DNA control.
|
297 bp) were grown overnight in LB plus ampicillin, and the plasmid isolated using a miniprep kit (Wizard-Plus SV; Promega Inc., Madison, WI) was sequenced by conventional methods (Amplicon Express, Pullman, WA). cELISA. The format of the cELISA was as previously described using the same C terminus of RAP-1 antigen expressed as a histidine-tagged thioredoxin fusion protein purified on a ProBond resin column (Invitrogen, Carlsbad, Calif.) and dried on the wells of Immulon II plates (8). Optimal concentrations of antigen and MAb were determined by block titration as previously described (8), and a plate washer (BioTek Instruments Inc., Winooski, VT) was used at each step of the protocol. Other slight modifications were made after additional experience in using the assay. Prior to use, 200 µl of a blocking buffer (phosphate-buffered saline containing 0.2% Tween 20 and 20% nonfat dry milk) was added to each well, and the plates were incubated at room temperature for 1 h on a rotating platform. After the blocking buffer was aspirated off, 100 µl of undiluted serum was added to each well (principal test sera and control sera), and the plates were incubated at room temperature for 30 min. After the serum from each well was aspirated off, 100 µl (50 ng/well) of BABB75A4 MAb (7) was added, and the plates were incubated at room temperature for 15 min. Each plate was then washed three times with 200 µl of wash buffer (blocking buffer minus the nonfat dry milk), followed by the addition of 100 µl of wash buffer containing an appropriate concentration of conjugate (horseradish peroxidase-labeled goat anti-mouse immunoglobulin G; KPL, Gaithersburg, MD) (each lot of new conjugate was titrated). After incubation at room temperature for 15 min, each plate was washed three times, as before, and then allowed to set for 30 to 60 s in wash buffer before a final three washes. After equal volumes of 3,3',5,5'-tetramethylbenzidine and H2O2 were combined according to the manufacturer's instructions (KPL), 100 µl of the substrate was added to each well and the plates were incubated at room temperature in the dark for 15 min, followed by the addition of 50 µl of stop buffer (2 N H2SO4). The mean optical density (OD) at 450 nm was determined for all test wells and for duplicate wells of a positive control serum and negative control sera pooled from five known-negative animals using a microtiter plate reader (Dynex Technologies, Chantilly, VA). The percent inhibition for each test sample was determined using the mean of each duplicate well compared to the mean of duplicate control wells using the following formula: percent inhibition = [1 (OD of sample - OD of buffer/OD of negative control - OD of buffer)] x 100.
Interlaboratory comparison. Aliquots of 100 sera (all from Australia, as described above) were sent to each of four laboratories in different countries, along with antigen plates from the same lot and conjugates, substrates, and other reagents from the same lot and/or shipment from the same vendors. All laboratories used the same protocol, described above, and recorded ODs at 450 nm with plate readers. All samples were coded so that the assay in each laboratory was run in a blind fashion.
Statistical analysis. To accurately assess the assay for diagnostic specificity, sensitivity, and predictive values, the results from the 100 known-positive and 100 known-negative samples were subjected to receiver operating characteristic (ROC) analysis performed using MedCalc statistical software (version 8.1.1), and a frequency distribution graph was generated. Concordance among laboratories was established using Cohen's kappa values (2), Hartley's test for homogeneity (9), and a one-way analysis of variance (ANOVA) of ODs among the four laboratories.
|
|
|---|
10 copies =
10 genomic units) (Fig. 1B). Genomic DNA was then extracted from similar cultures and subjected to nPCR, where the same level of detection was demonstrated, indicating that the nested PCR can detect at least 10 infected erythrocytes in the PCR sample (Fig. 1C). Given this level of sensitivity, the nPCR was used to define known-positive samples from Puerto Rico as part of the defined sera used to establish specificity and sensitivity. Sequence analysis of PCR-positive results confirmed the presence of B. bovis DNA in these samples (data not shown). Specificity, sensitivity, and predictive value. Figure 2A shows the frequency distribution graph for the cELISA using the 135 known-positive and 141 known-negative samples. Based on ROC analysis (Fig. 2B), 21% inhibition was chosen as the threshold value to define a positive or negative sample, yielding a specificity of 100%, a sensitivity of 91.1%, and a positive predictive value of 100%. Using the 21% inhibition cutoff, the negative predictive value varied, depending on the prevalence of disease in a particular area, ranging from 99.0% at a prevalence of 10% to 55.6% at a prevalence of 90% (Fig. 3).
![]() View larger version (15K): [in a new window] |
FIG. 2. (A) Frequency distribution of known-negative (left cluster) and known-positive (right cluster) sera. A sample was considered positive with an inhibition equal to or greater than 21%. (B) ROC plot (solid line) of sensitivity and specificity with 95% confidence levels (broken lines) calculated from the 135 known-positive and 141 known-negative serum samples, establishing 21% inhibition as the optimal cutoff value (the percent inhibition that corresponds to the maximum diagnostic sensitivity and specificity). A random, no-discrimination line is shown as the 45° broken line.
|
![]() View larger version (14K): [in a new window] |
FIG. 3. Predictive value of a negative cELISA test result when applied to different levels of disease prevalence. The values were determined by ROC analysis based on a 21% cutoff.
|
|
View this table: [in a new window] |
TABLE 1. Validation of cELISA with IIF
|
|
View this table: [in a new window] |
TABLE 2. Pairwise concordance among laboratoriesa
|
|
View this table: [in a new window] |
TABLE 3. Percent inhibition from 18 samples resulting in discordant status among the four laboratories
|
|
|
|---|
As previously reported the antigen is based on a species-specific, broadly conserved, and tandemly repeated B-cell epitope within the C terminus of RAP-1 of B. bovis (14). This antigen is well recognized by antibody from infected cattle within 2 weeks following infection. The response to this epitope persists in experimentally infected cattle for at least several months, and the antigen is recognized by antibodies from infected cattle in diverse geographic locations (8).
After determining the optimal concentration of antigen and MAb, drying the antigen on the plates, and slightly altering the washing procedure and conjugate/substrate, we determined that bovine sera could be used undiluted to minimize false negatives without increasing false positives or background. The current protocol has now been used to test several hundred known-negative samples, with 141 randomly selected for this report, along with the 135 known positives. At a cutoff of 21% inhibition, the assay has a specificity of 100% and a sensitivity of 91.1%. This translates into a positive predictive value of 100% under any conditions. However, at 21% inhibition, the negative predictive value decreases as the prevalence increases and drops off dramatically as the prevalence increases from 80% to 90%. To our knowledge, 90% prevalence has not been reported for any region surveyed, but enzootic stability, where the estimated prevalence is near 70%, does occur in many regions. At this prevalence, the predictive value of a negative test result would be 83%.
Based on this and our previous study, the cELISA has the attributes (particularly the use of a dried-antigen plate format) necessary for worldwide diagnostic application. The overall accuracy is good, and the reliability is excellent based on concordance, kappa values, test of homogeneity, and ANOVA results from the four laboratories independently performing the assay. The few samples that were scored differently between laboratories had, for the most part, inhibition levels near the cutoff of 21%. This suggests that the cELISA, as is the case for other assays, should be repeated with samples near the cutoff using either a repeat of the same sample or another sample collected several days later. Our experience with the assay using a limited number of field samples, where PCR and the cELISA have been compared, suggests that resampling when results are negative but near the cutoff is also important, since there is a chance that very early infections would be PCR positive prior to detectable antibody being produced (data not shown). The accuracy and reliability of the cELISA need to be further determined by application to large numbers of sera collected from well-defined enzootic regions, and such studies are under way. However, the assay appears to meet regulatory stringency for use as an international standard and is formatted for ease of distribution and use under a variety of laboratory conditions.
We thank Paul Lacy, Sanna Ait, Beatrice Greco, Anthea Bruyeres, and Carey Wilson for excellent technical support and John Vanderschalie from the Washington Animal Disease Diagnostic Laboratory for provision of negative serum samples.
D.S.A. is associated with VMRD, a company with a commercial interest in veterinary diagnostics.
Published ahead of print on 6 September 2006. ![]()
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»