Previous Article | Next Article ![]()
Clinical and Vaccine Immunology, June 2008, p. 911-915, Vol. 15, No. 6
1071-412X/08/$08.00+0 doi:10.1128/CVI.00046-08
Copyright © 2008, American Society for Microbiology. All Rights Reserved.

Campo Experimental Río Bravo, Instituto Nacional de Investigaciones Forestales y Agrícolas y Pecuarias, Rio Bravo, Tam., México,1 Laboratorio de Bacteriología, Centro Nacional de Investigaciones Disciplinarias en Microbiología, Instituto Nacional de Investigaciones Forestales y Agropecuarias, México D. F., México,2 Universidad Autónoma de Nuevo León, Departamento de Inmunología y Virología, Facultad de Ciencias Biológicas, San Nicolás de los Garza, N. L., México,3 Campo Experimental General Terán, Instituto Nacional de Investigaciones Forestales, Agrícolas y Pecuarias, General Terán, N. L., México,4 Consorcio Técnico del Norte de México, Guadalupe Nuevo León, México,5 Campo Experimental Sur de Tamaulipas, Instituto Nacional de Investigaciones Forestales, Agrícolas y Pecuarias, Altamira, Tamaulipas, México6
Received 5 February 2008/ Returned for modification 3 March 2008/ Accepted 17 March 2008
|
|
|---|
|
|
|---|
Despite the reduction of false positives, a large number of goats may be culled in test-and-slaughter programs. This makes it critical to evaluate and develop new test procedures with high sensitivity and specificity to significantly improve the diagnosis of brucellosis. Studies have shown that IELISA, CELISA, and the fluorescence polarization assay (FPA) might be useful. Despite its high sensitivity, IELISA has a relative lack of specificity, and interference from cross-reacting antibodies may arise (15). This weakness was largely overcome by the development of CELISA (10, 17) and the FPA (12), since ELISAs and the FPA are not significantly affected by antibodies resulting from immunization (3, 12, 13, 17, 24) and are faster than the CFT (16). Previous evaluations of the FPA (11, 15, 16, 19, 20) using the O-polysaccharide (OPS) conjugated with fluorescein isothiocyanate (FITC) as a tracer (OPS tracer) in goats and sheep, have shown that the diagnostic performance results might be affected by different selection criteria for positive reference standards and by the quality of sera used; however, there appears to be agreement that the OPS tracer might be a useful tool for the diagnosis of brucellosis in small ruminants (9, 15, 16, 19, 20).
We have recently (20) developed a novel FITC-conjugated tracer for use in the FPA, based on the B. melitensis native hapten (NH) described by Diaz et al. (5) for diagnosis of bovine brucellosis using radial immunodiffusion, which in an initial evaluation with positive and negative Mexican field goat serum samples, selected by test series approved by the OIE (card test [with 3% suspension] and CFT), performed better than the OPS tracer. The present study was undertaken to evaluate the novel NH tracer for detecting Brucella antibodies in goat serum relative to bacteriology-, PCR-, and ELISA-positive samples and to validate its performance on vaccinated goats and in test series that can be easily adopted for use by any laboratory or in the field.
(This work was part of the Ph.D. thesis of Carlos Ramírez-Pfeiffer.)
|
|
|---|
(i) In the first study, FPA/NH tracer performance in detecting Brucella antibodies in infected goats was determined; (ii) in a second study, the NH tracer potential to detect antibodies in samples obtained from vaccinated goats was evaluated; and (iii) in a third study, the NH tracer potential to improve the final specificity of tests, when used as a confirmatory test in combination with screening tests (RBT3, RBT8, or BPAT) for positive samples, was evaluated.
Goat serum samples. Goat serum samples, together with their RBTs (RBT8 and RBT3, with 8% and 3% cell concentrations, respectively), CFT, FPA with OPS tracer, ELISAs, and PCR results, were obtained from the serum bank of the Laboratorio de Inmunología y Virología (LIV) of the Facultad de Ciencias Biológicas, Universidad Autónoma de Nuevo León (N. L.), México. Most of them had been used in previous studies (19, 20) and had been kept frozen at –70°C. These samples had been obtained as part of the eradication campaign in the northeast part of Mexico and had been tested by RBT3, RBT8, and CFT at the Laboratorio Regional Central de Monterrey (LRCM) N. L. (Comité de Fomento y Protección Pecuaria de Nuevo León, Guadalupe, N. L., México) according to the Mexican official norm (22), which applies procedures and antigens described elsewhere (1, 24). Additional results for ELISAs, BPAT, and Canadian CFT (CFTc) were performed at the Reference Laboratory and Brucellosis Centre of Expertise of the Ottawa Laboratories (Fallowfield, Nepean, Ontario, Canada) (OLF), as previously described (12). The results of PCR performed according to the method of Bailey et al. (2) were obtained at the Laboratorio de Biotecnología of the Instituto Nacional de Investigaciones Forestales y Agrícolas y Pecuarias located in the LRCM. Isolation and identification of Brucella spp. was performed at LIV using goat milk samples obtained from nonvaccinated goats according to previously described procedures (1).
For this study, a total of 381 serum samples were classified as positive in the following cases: (i) sera obtained from an area where nonvaccinated goats were raised for at least 5 years and with the presence of flock abortions and human cases of Malta fever in which Brucella spp. were isolated from goats' milk (8 samples) and (ii) samples from bacteriologically positive flocks that were positive by PCR (40 samples) or positive by both IELISA and CELISA (333 samples). No signs of disease were observed in the goats when they were sampled, nor were tests for other diseases performed on the samples. "Negative" samples were obtained from Canada (96 samples) (a brucellosis-free country where vaccination is not done) or were considered negative if they were obtained from nonvaccinated flocks from northeast Mexico without a history of abortion, with two consecutive negative tests by RBT3, and with negative IELISA and CELISA results (125 samples) and where no human Malta fever cases were observed; in addition, "vaccinated" samples were obtained from vaccinated animals after at least two consecutive negative tests with RBT3 and also vaccination with B. melitensis strain Rev. 1.
NH tracer preparation and FPA procedure. NH was obtained from B. melitensis strain Rev. 1 in a previous work (21) at the Centro Nacional de Investigaciones Disciplinarias en Microbiología of the Instituto Nacional de Investigaciones Forestales Agrícolas y Pecuarias, following the extraction method described by Díaz et al. (6) for use in FPA. In brief, to obtain the crude NH-containing pelleted fraction (6), killed cultured cells were pelleted, suspended in distilled water, centrifuged, precipitated twice with ethanol, and lyophilized; then, NH was FITC conjugated at LIV as previously described (12). The amounts of tracer and serum samples for testing were standardized to yield polarization fluorescence reading values similar to those obtained from FPA using the OIE OPS tracer and FPA bovine standard serum controls (produced at OLF and kindly supplied by Klaus Nielsen).
Once the NH tracer was standardized, FPA was performed at LIV following the procedure previously described by Nielsen et al. (12). In brief, for the NH tracer, 10 µl of each goat serum sample was diluted in 1.0 ml of 0.1 M Tris buffer in a test tube or in 700 µl of this buffer in each microplate well, instead of the 25 µl used for the OPS tracer. After the ingredients were mixed, a blank reading was obtained; 10 µl of the tracer was then added to the diluted sample, and after 2 min of incubation, a final reading was obtained.
Strong-positive, weak-positive, and negative goat FPA serum controls were prepared by pooling goat serum samples and adjusting their readings to the respective OIE brucellosis FPA bovine standard serum readings (kindly supplied by Klaus Nielsen), and they were used daily as controls for FPA tests. It was not possible to perform all tests on all serum samples due to sample depletion.
FPA readers. Two fluorescence polarization readers were used: the Fluorescence Polarization Analyzer (Sentry FP, model PS-1; Jolley Consulting and Research Inc. Diachemix, Grayslake, IL), in which test tubes were used for testing, and the Multimode Reader DTX 880 (Beckman-Coulter, Inc., Fullerton, CA), in which 96- or 254-well black plates could be used. Data are expressed in milli-polarization units (mP).
Data analysis.
To evaluate the diagnostic performance of the FPA or its ability to discriminate diseased from healthy cases, based on its accuracy, sensitivity, and specificity values, receiver operating characteristic (ROC) analysis (MedCalc software, V.9.2.1.0, from Frank Schoonjans) was used to determine the statistical differences in pairwise nonparametric comparisons of areas under the ROC curves (AUCs) (25). We used a P-value cutoff of
0.05 for significance. A ROC curve analysis is a graph that plots the true rate in the function of the false-positive rate at different cutoff points that are a consequence of their individual test sample results. The ROC graph is a plot of all of the sensitivity/specificity pairs resulting from continuously varying the decision threshold over the entire range of results observed. In each case, the ROC plot depicts the overlap between the two distributions by plotting the sensitivity versus 1 minus the specificity for the complete range of decision thresholds, and it determines the optimal cutoff value based on achieving the highest possible sensitivity and specificity without a suspect range (25). This is especially useful for free-ranging populations in which resampling of suspect animals is impossible. RBT3 was not included in this comparison, as it had been proved previously that its performance is poorer than that of RBT8 (20).
In addition, the sensitivity and specificity values of tests were added to obtain the performance index (PI), which is a value that is useful for comparing test performances (13); when the sensitivity and specificity of one test are 100%, the resulting PI value is 200.
|
|
|---|
|
View this table: [in a new window] |
TABLE 1. Performances of individual tests related to the status criteria for sample selection
|
81 mP) had the fewest (72.9%) positive reactions when 107 vaccinated-goat serum samples were tested, compared with the other evaluated tests (OPS tracer, 98.2% positive reactions; RBT3 and RBT8, 98.2% positive reactions; 281, 283, and 282 samples, respectively). Performance of NH tracer in test series. In the third study, goat serum samples that tested positive with RBT3, RBT8, and BPAT were considered "positive on screening tests" and were tested with FPA with NH and OPS tracers, CFTm, and CFTc as confirmatory tests for test series evaluation. Table 2 shows that when RBT3 was used as the screening test (with an initial sensitivity of 99.7% and a specificity of 32.7%) and the positive samples were confirmed with secondary tests, the final specificities of the diagnostic procedures increased to 94.5% (NH), 91.2% (OPS), 86.9% (CFTm), 81.1% (CFTc), 65.5% (CFTm), and 62.1% (RTB8), whereas when RBT8 was used as the screening test (with an initial sensitivity of 81.1% and a specificity of 68.4%) and the positive results were confirmed with NH, CFTs, or OPS, the final specificities of the diagnostic procedures increased to 96.3% (NH), 94.7% (CFTm), 91.3% (OPS), and 85.2% (CFTc). Finally, when BPAT was used as the screening test (with an initial sensitivity of 98.3% and a specificity of 81%) and the positive samples were confirmed with NH or OPS, the final specificities of the diagnostic procedures increased to 95.6% (NH) and 90.0% (OPS). As can be seen in Table 2, in all cases, the PI was in accord with the increase in the final specificity. It is notable that the NH tracer PI (177.8) (Table 1), as a single test, was higher than those of all of the test series (Table 2), except when RBT3 was used as the screening test and FPA was used with NH (194.2) or OPS tracer (190.9).
|
View this table: [in a new window] |
TABLE 2. Comparison of test series performance used to improve the final specificity, using a screening test and a secondary test for positives testing
|
|
|
|---|
The results of the first study with infected goats showed that NH tracer's accuracy (94.4%) and PI (177.8) were higher than those of other tests, including the OPS tracer (accuracy and PI, 89.6% and 168.8, respectively). Such results have some similarity to the results of conventional tests; in a previous evaluation of the tracers using RBT3 and CFTm to select samples, we also obtained better accuracy and PI for the NH tracer (87.5% and 163.8) than for the OPS tracer (83.5% and 156.9). Nielsen et al. (13), using OPS (16), found the respective values to be 96.1% and 187.6% relative to BPAT and CFT, whereas Minas et al. (11), also using the OPS tracer, found an accuracy of 98.7% and a PI of 191.8 in nonvaccinated goats. The differences in test performance between studies may be associated with the tests/antigens selected and the serum quality; other individual factors, such as age, stage of pregnancy, health status, and stage of infection; the type of husbandry, management, and animal breeds (11); and, in addition, as in this case, the kind of tracer used in FPA.
Although in the evaluation of tests with vaccinated-goat serum samples, the antibody response was followed up to 4 months after vaccination, it was expected that both the NH and OPS tracers would yield similar and lower percentages of positives than RBT, but according to our results, the NH tracer yielded 72.9% positives whereas, surprisingly, the OPS tracer yielded 94.3% (and the RBT3 and RBT8 yielded 98.2%). It is difficult to explain the differences between the tracers, but they may be related to the postvaccination period evaluated, making it necessary to extend it for future studies.
The Rev.1 B. melitensis NH tracer's higher performance, compared with the OPS S1119-3 B. abortus tracer observed in the present work, might be due to the production of higher-affinity antibodies directed against NH in homologous B. melitensis infections in goats than those cross-reacting with B. abortus OPS; however, to date, it is not clear why the OPS tracer showed a high percentage of reactions with vaccinated-goat serum samples in a homogeneous FPA format. However, whatever the explanation for this, there is an advantage for the NH tracer in an FPA format, because according to our results, it is more accurate in areas in which vaccination is being done and it may reduce the killing of goats in areas where test-and-slaughter programs are being run.
In the third study, we evaluated serial testing, considering that this procedure may optimize the specificity and the predictive value of a positive test result, making it an important part of the disease eradication campaigns in which positive animals are culled from flocks (i.e., for goat brucellosis) (23). Unlike parallel testing, in which animals positive in any test are considered to be affected, thus emphasizing sensitivity, serial testing analysis is conducted sequentially, and only those samples that are positive in an initial screening are tested again with the confirmatory test and only samples that are positive in all tests are considered "affected" (23). For this, we used BPAT, RBT3, and RBT8 as screening tests because they showed higher sensitivity than other tests, they are easy to perform, and they are used worldwide, whereas FPA (with NH and OPS tracers) and CFTm were selected as confirmatory tests because of their relatively high specificity, which ensures a higher final specificity than with other tests. Our results showed that all test series in which NH was used as a confirmatory test yielded higher final specificity than others, including the OPS tracer series. The difference observed between NH and OPS performances as confirmatory tests may be due to the fact that NH alone had 91.9% specificity versus 89.3% for the OPS (Table 1), and it may be a result of the higher affinity of goat antibodies for B. melitensis NH tracer directed to B. melitensis field strain infection than that of antibodies reacting to B. abortus OPS tracer.
In addition, it is noteworthy that the use of RBT3 plus NH instead of RBT3 plus CFTm (>1:4), which is the only procedure accepted in Mexico for goat testing (22), might significantly reduce the number of false positives, from 67.3% or 34.5% to 5.5%, if only RBT3 or RBT3 plus CFT (>1:4) are used; this may prevent goats from being culled according to the current Mexican regulations (22).
In summary, our results demonstrated that the FPA with the B. melitensis NH tracer yielded better diagnostic performance results for detection of antibodies against Brucella in goat serum samples than other tests, including FPA using B. abortus OPS tracer. The performance values of the FPA found in the present study support its use as a secondary test for RBT3 and make the NH a tracer of choice to be used in test series for goat brucellosis in areas with high vaccination rates and high prevalence; nevertheless, more studies are needed to evaluate the FPA in long-term vaccination studies. In addition, our results agreed with those of previous studies by others in which FPA was observed to perform better than the currently approved tests for diagnosis of B. melitensis infection in small ruminants (11, 14, 15, 18, 19) and showed that it is a viable solution for low-income countries where the goat industry is developing, because it is a simple, rapid, and low-cost test that does not require highly trained technicians like other confirmatory tests. In addition, it can be performed in or outside the laboratory, and it is considered that the reduction in the cost of replacement of wrongly killed goats justifies the initial investment in the test.
We thank the LRCM, particularly José Muraira and Fernando Marin, for collaboration in sampling and serological tests.
Published ahead of print on 2 April 2008. ![]()
|
|
|---|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»