Previous Article | Next Article ![]()
Clinical and Vaccine Immunology, September 2008, p. 1316-1321, Vol. 15, No. 9
1071-412X/08/$08.00+0 doi:10.1128/CVI.00150-08
Copyright © 2008, American Society for Microbiology. All Rights Reserved.

Animal Disease Research Unit, Agricultural Research Service, U.S. Department of Agriculture, Pullman, Washington 99164-6630,1 Queensland Department of Primary Industries and Fisheries, Animal Research Institute, Yeerongpilly, Queensland 4105,2 Tick Fever Centre Wacol, Wacol, Queensland 4076, Australia,3 CENID-PAVET, INIFAP, Jiutepec, Morelos 62550, Mexico,4 Department of Parasites, Vectors and Vector-Borne Diseases, Onderstepoort Veterinary Institute, Onderstepoort 0110, Republic of South Africa,5 VMRD, Inc., Pullman, Washington 99163,6 Department of Veterinary Microbiology and Pathology, College of Veterinary Medicine, Washington State University, Pullman, Washington 99164-7040,7 Veterinary Clinic, Route 349 KM1.0 Interior, Mayaguez, Puerto Rico 00680,8 Washington Animal Disease Diagnostic Laboratory, Pullman, Washington 99163-20379
Received 28 April 2008/ Returned for modification 1 July 2008/ Accepted 3 July 2008
|
|
|---|
|
|
|---|
RAP-1 from B. bigemina, first described as a 58-kDa surface protein (13, 14), is a product of a multigene family (15, 18) with four nonallelic genes containing dimorphic regions that encode both B-cell and T-cell epitopes (10). A conserved B-cell epitope within the C terminus of RAP-1a is recognized by MAb 64/04.10.3 (10, 19) and was the target for the development of the cELISA described here. Recently, we determined that the epitope is useful in avoiding cross-reactions with B. bovis (3), which had been a problem when crude antigens were used (4). In the study reported here, we describe a B. bigemina-specific cELISA formatted for ease of distribution and validate the assay for global use through an international interlaboratory comparison.
|
|
|---|
For the interlaboratory comparison, a set of 100 defined serum samples was distributed among five laboratories. The sera represented 79 additional known negative samples from the United States, a single sample from an animal experimentally infected with a Mexican B. bigemina isolate, and 20 samples from cattle from Australia that had been immunized with a live B. bigemina "G" vaccine strain at the Tick Fever Research Center in Australia and that were confirmed to be infected by the microscopic detection of parasites in stained blood films. In addition, each of the 20 samples was tested in Australia by using another ELISA format, as described previously (16). All sera for the interlaboratory validation were preserved with sodium azide prior to shipment.
Two additional cattle were experimentally infected with a Puerto Rican field isolate of B. bigemina. The blood stabilate, which contained 1 x 108 infected erythrocytes, was inoculated intravenously, and serum was collected daily through 35 days postinoculation. The clinical disease was mild, and no treatment was necessary. Sera from these two animals along with sera from the cattle experimentally infected with the Australian "G" vaccine strain mentioned above were used to assess the kinetics of seroconversion.
cELISA. The format of the cELISA was as described previously for use of the assay with B. bovis (8). The epitope recognized by MAb 64/04.10.3 is contained within amino acids 393 and 443 of the C terminus (amino acids 306 to 480) of B. bigemina RAP-1a (GenBank accession no. M60878 [http://www.ncbi.nlm.nih.gov/GenBank/index.html]). The C terminus was subcloned into a pBAD vector (rCT-rap-1aa1) and expressed as a histidine-tagged thioredoxin fusion protein purified on a ProBond resin column (Invitrogen, Carlsbad, CA). The antigen was coated and then dried onto wells of Immulon II plates. The optimal concentrations of antigen and MAb were determined by block titration. A plate washer was used at each wash step of the protocol. Prior to use, 200 µl of a blocking buffer (phosphate-buffered saline containing 0.2% Tween 20 and 20% nonfat dry milk) was added to each well, and the plates were incubated at room temperature for 1 h on a rotating platform. Each incubation step was accomplished on a rotating platform. After aspiration of the blocking buffer, 100 µl of undiluted serum was added to each well (which contained the principal test sera or control sera) and the plates were incubated at room temperature for 30 min. After aspiration of the serum from each well, 100 µl (5 ng/well) of MAb 64/04.10.3 was added and the plates were incubated at room temperature for 15 min. Each plate was then washed three times with 200 µl of wash buffer (blocking buffer minus the nonfat dry milk), followed by the addition of 100 µl of wash buffer containing a 1/4,000 dilution of conjugate (horseradish peroxidase-labeled goat anti-mouse immunoglobulin G; Kirkegaard & Perry Laboratories, Gaithersburg, MD) (each lot of new conjugate was titrated to obtain the optimal dilution). After incubation at room temperature for 15 min, each plate was washed three times, as described above, and then allowed to set for 30 to 60 s in wash buffer before a final three washes. After equal volumes of 3,3',5,5'-tetramethylbenzidine and H2O2 were combined, according to the manufacturer's instructions (Kirkegaard & Perry Laboratories), 100 µl of the substrate was added to each well and the plates were incubated at room temperature in the dark for 15 min, followed by the addition of 50 µl of stop buffer (2 N H2SO4). By using a microtiter plate reader, the mean optical density (OD) at 450 nm was determined for all test wells and for duplicate wells of a positive control serum sample and a negative control serum sample pooled from five animals known to be negative. The percent inhibition for each test sample was determined by using the mean of each duplicate well compared to the mean of duplicate control wells and the following formula: 1 – [(OD of sample – OD of buffer)/(OD of negative control – OD of buffer)] x 100.
Interlaboratory comparison. An aliquot of each of the 100 defined serum samples was provided to each of three laboratories in different countries as well as to another laboratory in the United States and the laboratory of the Animal Disease Research Unit, Agricultural Research Service. In addition to the defined sera, antigen plates from the same lot and conjugates, substrates, and other reagents from the same lot and/or shipment from the same vendors were also provided. All laboratories used the same protocol described above and recorded the ODs at 450 nm with plate readers. All samples were coded so that the assay in each laboratory was run in a blind fashion.
Statistical analysis. To accurately assess the assay for its diagnostic specificity, sensitivity, and predictive values, the results for the 66 known positive and the 474 known negative samples were subjected to receiver operating characteristic (ROC) analysis, which was performed with MedCalc statistical software (version 9.3.7.0; http://www.medcalc.be); and a frequency distribution graph was generated. The concordance among the laboratories was established by using Cohen's kappa values (1). Hartley's test for homogeneity (9) and a two-way analysis of variance of the ODs among the five laboratories were also included, and statistical significance was established at a P value of <0.05.
|
|
|---|
![]() View larger version (16K): [in a new window] |
FIG. 1. ROC analysis of the cELISA with 66 known positive and 474 known negative serum samples. (A) Plot-versus-criterion graph identifying 16% inhibition as the suggested threshold, with a specificity (dashed line with 95% confidence intervals) of 98.3% and a sensitivity (solid line with 95% confidence intervals) of 94.7%; (B) ROC plot with an area under the curve of 0.992 (0.00665) and a 95% confidence interval between 0.980 and 0.997; (C) graph of distributions of the known negative (left cluster) and known positive (right cluster) serum samples by using 16% and 21% inhibition as threshold values.
|
![]() View larger version (9K): [in a new window] |
FIG. 2. Negative (squares) and positive (triangles) predictive values associated with performance of the cELISA with samples from areas with different B. bigemina disease prevalence levels. The values were determined by ROC analysis based on a 21% inhibition threshold.
|
![]() View larger version (21K): [in a new window] |
FIG. 3. Kinetics of seroconversion during an initial exposure of cattle to approximately 108 infected erythrocytes of a Puerto Rican field isolate of B. bigemina delivered intravenously (A) or approximately 106 Australian "G" vaccine strain-infected erythrocytes delivered subcutaneously (B). Twenty-one percent inhibition was used as the threshold.
|
|
View this table: [in a new window] |
TABLE 1. Pairwise concordance of B. bigemina RAP-1a cELISA results among laboratories
|
|
View this table: [in a new window] |
TABLE 2. Percent inhibition associated with samples giving discordant results between laboratories
|
|
|
|---|
We previously described the development of a competitive ELISA for B. bovis that used a similar species-specific epitope within the C terminus of RAP-1 from B. bovis (7) and included an international validation (8). The usefulness of this detection format is evidenced by the recent recognition by the U.S. Department of Agriculture of similar cELISA formats as the official detection tests for the detection of both B. caballi and B. equi (11, 12) and by the recognition by the Office International des Epizooties (OIE) of the cELISA as the international standard assay for the detection of these babesial species. In order to comply with OIE validation standards, we have now defined the optimized format for both the B. bovis and the B. bigemina cELISAs; determined their specificities, sensitivities, and predictive values; and demonstrated their reliabilities. Both assays include purified recombinant antigen dried onto microtiter wells for ease of handling, distribution, and stability. The B. bigemina antigen is based on a broadly conserved, species-specific epitope within the C terminus of RAP-1a of B. bigemina (10). This antigen is recognized by antibodies from infected cattle in diverse geographic locations, and the response to this epitope persists in experimentally infected cattle for at least several months (data not shown).
There was a difference in the kinetics and the levels of antibodies detected in cattle inoculated with the attenuated Australian "G" vaccine strain and the Puerto Rican field isolate. The vaccine strain represented a lower infectious dose than the nonattenuated Puerto Rican isolate and was delivered subcutaneously instead of intravenously, perhaps contributing to the difference in kinetics. Actual transmission by ticks may also affect the kinetics, delaying seroconversion a bit longer. In addition, there are reports that multiply passaged attenuated parasites are less immunogenic (2). This could also have contributed to a decreased antibody response in this cELISA.
Babesiosis is characterized as a persistent infectious disease, and consequently, the sensitivity of a diagnostic assay or the ability to correctly identify true-negative samples is expected to be a greater issue than specificity. In addition, the specificity of this cELISA is inherently high due to the format and use of species-specific reagents. At a cutoff of 21% inhibition, the cELISA has a specificity of 100% and a sensitivity of 87.2%. This translates into positive and negative predictive values of 100% and 95.9%, respectively, in an area with a 25% prevalence and positive and negative predictive values of 100% and 84.0%, respectively, in an area with a 75% prevalence; these prevalence rates are typical of those found in areas of endemicity.
The B. bigemina cELISA has the attributes necessary for worldwide application for the detection of specific antibody, including the use of a dried antigen plate format. The overall accuracy is good and the reliability is excellent, on the basis of the concordance and the kappa values from the five laboratories that independently performed the assay. The majority of the samples that were scored differently between laboratories had inhibition levels between 16% and 21%. This suggests that the cELISA, as is the case in other assays, should be repeated for samples whose results are near the threshold by using another sample collected several days later. In some cases, supplemental diagnostics such as PCR could be used for samples with inconclusive results. Our experience with the cELISA with a limited number of field samples for which the results obtained by PCR and the cELISA have been compared suggests that resampling when the results are negative but near the threshold is important, since there is a chance that animals with very early infections would be PCR positive prior to the presence of detectable antibody (data not shown). Conversely, if the infection was cleared in an animal, the titer would decline and would progress toward and, finally, below the threshold. This is not uncommon for B. bigemina-infected animals, unlike B. bovis-infected cattle, which for the most part remain carriers for life. In particular, 7 of the 20 samples from cattle inoculated with the "G" vaccine strain used in this study were seronegative at 82 days postinoculation. This was confirmed by use of the ELISA used in Australia as well as the cELISA described here. The five samples with disparate results reported here represent samples that were still seropositive by the Australian ELISA, but they could have been from animals that had recently cleared the infection and whose titers were in decline. The accuracy and reliability of the cELISA need to be further determined by application of the assay to large numbers of serum samples collected from well-defined enzootic regions. However, the assay has the potential for use as an international standard and is formatted for ease of distribution and use under a variety of laboratory conditions.
We thank Paul Lacy, Carey Wilson, and Carmen Rojas-Martínez for excellent technical support and John Vanderschalie from the Washington Animal Disease Diagnostic Laboratory for the provision of negative serum samples. We also thank Russell Bock and Bert De Vos for constructive review of the manuscript.
D.S.A. is associated with VMRD, Inc., a company with a commercial interest in veterinary diagnostics.
Published ahead of print on 16 July 2008. ![]()
|
|
|---|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»