Previous Article | Next Article ![]()
Clinical and Vaccine Immunology, August 2008, p. 1272-1276, Vol. 15, No. 8
1071-412X/08/$08.00+0 doi:10.1128/CVI.00114-08
Copyright © 2008, American Society for Microbiology. All Rights Reserved.

Aklilu Lemma Institute of Pathobiology, Addis Ababa University, P.O. Box 1176, Addis Ababa, Ethiopia,1 Armauer Hansen Research Institute, P.O. Box 1005, Addis Ababa, Ethiopia,2 TB Research Group, Veterinary Laboratories Agency, Weybridge, New Haw, Addlestone, Surrey KT15 3NB, United Kingdom,3 Department of Infectious Disease and Microbiology, Imperial College, South Kensinton Campus, London SW7 2AZ, United Kingdom4
Received 29 March 2008/ Returned for modification 22 April 2008/ Accepted 15 May 2008
|
|
|---|
2 = 13.56; P < 0.001) higher at a cutoff of >2 mm (16.0%; n = 5,424) than at a >4-mm cutoff (13.5%; n = 5,424). Nonetheless, no significant difference (
2 = 2.15; P = 0.14) in true prevalence was observed at a cutoff of >2 mm (19.6%) and at a cutoff of >4 mm (18.5%). Thus, our study demonstrates the importance of defining local, relevant cutoff values to maximize test sensitivity, and we suggest the application of the >2-mm cutoff for testing of cattle in central Ethiopia. |
|
|---|
In this study, the cutoff point of the CIDT test was assessed with the Ethiopian Arsi breed, which belongs to Bos indicus (zebu), and also with a mixed population of Holstein, Bos taurus, and Arsi breeds grazing together under identical husbandry conditions, using receiver operating characteristic (ROC) analysis. The standard used to define disease status was the result of postmortem examination, which involved detailed gross examination of the head, thoracic and abdominal lymph nodes, and lungs, using inspection, palpation, and incision of suspicious tissues into pieces for further visualization. In addition, the true prevalence of bTB in 5,424 cattle was established by using the cutoff values of the CIDT test defined in this study.
|
|
|---|
CIDT test. Two sites on the right side of the mid-neck, 12 cm apart, were shaved, and the skin thicknesses were measured with calipers. One site was injected with an aliquot of 0.1 ml containing 2,500 IU/ml bovine PPD (Veterinary Laboratories Agency, Addlestone, Surrey, United Kingdom). Similarly, 0.1 ml of 2,500-IU/ml avian PPD (Veterinary Laboratories Agency, Addlestone, Surrey, United Kingdom) was injected into the second site. After 72 h, the skin thicknesses at the injection sites were measured. Cutoff points were assessed using ROC analysis.
Postmortem examination. The lungs and lymph nodes were removed for the investigation of gross pathological lesions. The seven lobes of the two lungs, namely, the (i) left apical, (ii) left cardiac, (iii) left diaphragmatic, (iv) right apical, (v) right cardiac, (vi) right diaphragmatic, and (vii) right accessory lobes, were inspected externally and palpated. Each lobe was then sectioned into about 2-cm-thick slices to facilitate the detection of lesions. Similarly, lymph nodes, namely, the (i) mandibular, (ii) medial retropharyngeal, (iii) cranial and caudal mediastinal, (iv) left and right bronchial, (v) hepatic, and (vi) mesenteric lymph nodes, were sliced into thin sections (circa 2 mm thick) and inspected for the presence of visible lesions. When gross lesions suggestive of bTB were found in any of the tissues examined, the animal was classified as lesioned. Animals in which lesions were not found were classified as nonlesioned.
Statistical analysis.
ROC analysis was performed using Analyze-it software (Analyze-it Ltd., Leeds, United Kingdom) as an add-on to Microsoft Excel. Logistic regression analysis was used to assess the association between prevalence and animal risk factors, including age and breed, using STATA statistical software (Stata Corporation, College Station, TX). The difference in prevalence of bTB between breeds was analyzed using the EPI6 dose version and was compared using the Pearson chi-square (
2) test. Odds ratios were calculated to assess the strength of association of animal risk factor (age and breed) and the prevalence of bTB.
|
|
|---|
2 = 3.45; P = 0.05). Thus, a cutoff of >2 mm could be applied without a loss of specificity compared with that of the OIE-recommended >4-mm cutoff. Reducing the cutoff further resulted in a loss of specificity (Table 1).
![]() View larger version (14K): [in a new window] |
FIG. 1. ROC curves for the CIDT test in zebu cattle (blue line and symbols) and Arsi and Holstein cattle (red line and symbols). The ROC plots pass through the upper left corner, and the areas under the ROC curves are 0.87 and 0.89, for Arsi cattle and Arsi and Holstein cattle, respectively. Blue letters, Arsi cattle; red letters, Arsi and Holstein cattle.
|
|
View this table: [in a new window] |
TABLE 1. Sensitivities, specificities, and cutoff points of CIDT test for cattle in central Ethiopiaa
|
Apparent prevalence of bTB at cutoff points of >2 mm and >4 mm in zebu and Holstein cattle.
In an earlier study, we assessed the skin test prevalence of bTB in 5,424 cattle consisting of zebus, Holsteins, and their crosses, using the OIE-recommended cutoff value of >4 mm (2). Based on the results described in the previous section, we reanalyzed these data using a >2-mm cutoff point. The apparent prevalence at the >2-mm cutoff point was 16.0% (868/5,424 cattle), compared to 13.5% (732/5,424 cattle) at the >4-mm cutoff point. Confirming and extending our earlier results (2) for both cutoff points, the apparent prevalence was significantly higher in Holsteins than in zebus either at a cutoff of >4 mm (22.2% versus 11.6% [
2 = 61.8; P < 0.001]) or at a cutoff of >2 mm (24.9% versus 13.9% [
2 = 65.5; P < 0.001]) (Table 2). Moreover, at both cutoff points, significant differences (P < 0.001) in prevalence were observed among the different age groups (Table 2). The difference in apparent prevalence rates between the two cutoffs was statistically significant (16.0% versus 13.5% [
2 = 13.56; P < 0.001]) (Table 3).
|
View this table: [in a new window] |
TABLE 2. Association of host-related risk factors to skin test positivity at cutoff points of >4 mm and >2 mm for TB in central Ethiopiaa
|
|
View this table: [in a new window] |
TABLE 3. Comparison of apparent and true prevalence rates of bTB in central Ethiopia at cutoffs of >4 mm and >2 mma
|
Thus, the true prevalence was calculated (Table 3) using the sensitivities and specificities calculated by the ROC analysis. Accordingly, the true prevalence at a cutoff of >4 mm was 18.5%, while it was 19.6% at a cutoff of >2 mm. There was no significant (
2 = 2.15; P = 0.14) (Table 3) difference between the true prevalence rates at the two cutoff points, and it can therefore be assumed that the true prevalence of bTB in the study population was around 19.0%.
|
|
|---|
The cornerstone of TB control in cattle is the accurate detection and removal of infected cattle; however, because the infection is usually chronic and can remain subclinical for a long period, infected cattle can become infectious long before they exhibit any obvious clinical signs. As a result, effective antemortem surveillance must rely primarily on the detection of infected cattle at an early stage by the use of sensitive immunodiagnostic tests (1). Although imperfect, no better general approach for TB screening of cattle populations has been devised since Robert Koch discovered tuberculin (19). Programs based on the basic principles of systematic and regular skin testing of cattle herds, supplemented with compulsory removal of test reactors, movement restriction of known infected herds, and slaughterhouse surveillance of undetected infection, have eradicated bTB from many developed countries (6, 8, 10, 11).
The diagnostic accuracy of a test is defined primarily in terms of its sensitivity and specificity. There is an inverse relationship between test sensitivity and specificity (23), and these two parameters are frequently assumed to be constant across different populations as long as the test procedure and cutoff point for a positive test result remain the same from one group of animals to another (12). However, for TB diagnostics, this is not necessarily the case, as test results are influenced by the stage and severity of the disease (25, 31). This was the reason that we initiated a reevaluation of the OIE-recommended cutoff (>4 mm) in an Ethiopian context, using ROC analysis. Our data showed that sensitivities and specificities of the CIDT test were optimal at cutoff values ranging from >2 mm to >4 mm for zebu cattle in central Ethiopia. At a cutoff of >2 mm, the CIDT test's sensitivity was 69%, while it was 59% at a cutoff of >4 mm, with identical specificities, at 97%, for the two cutoff points.
ROC analysis is used to visualize, organize, and select classifiers based on their performance (14, 15, 34) and has been extended for use in visualizing and analyzing the behavior of diagnostic systems (33). Our results showed that the ROC plots for the CIDT test are high in the left corner, indicating good performance of the CIDT test for both the zebu breed and a mixed population of zebus and Holsteins. The area under the curve was 0.87 for zebus, while it was 0.89 for the mixed population of zebus and Holsteins, demonstrating moderate to high discriminatory power of the CIDT test.
The published sensitivity estimates for the tuberculin test were summarized by de la Rua-Domenech et al. (12), and the estimates ranged from 63.2% to 100%, with a median sensitivity of 83.9%, for the single intradermal tuberculin test and from 52.0% to 100%, with a median value of 80.0%, for the CIDT test. The sensitivity recorded by the present study is relatively lower than the median sensitivity (80.0%) of the CIDT test reported by other authors but is well within the reported range.
There are different reasons which could cause false-negative results, lowering the sensitivity of the CIDT test. For instance, newly infected animals may not react to the CIDT test, as reactions have been reported to develop between 3 and 6 weeks postinfection for most animals (16, 17, 21). A state of anergy can also develop in animals with advanced or generalized TB and in animals subjected to stress (22, 28), such as calving within the preceding 4 to 6 weeks (24). In addition, administration of glucocorticoids can also lead to lower indurations of tuberculin reactions in infected animals (13), while coinfection with viruses such as bovine viral diarrhea virus could transiently compromise the reaction to tuberculin (7). Furthermore, a reduced tuberculin reaction can occur if the infected animal is malnourished (24). The phenomenon of desensitization, which describes the depressed skin reactivity to the second tuberculin injection in naturally and experimentally infected cattle for some time after the first tuberculin injection, can also reduce the sensitivity of the tuberculin test (18, 20, 24, 29). Furthermore, prior tuberculin test exposure to mycobacteria of the M. avium complex and/or the Mycobacterium intracellulare complex may also lower sensitivity, as the reaction to avian tuberculin could be high and thus interfere with the interpretation of the result (17).
In our study, we found antibodies for paratuberculosis in 4% (n = 263) of animals (G. Ameni and M. Vordermeier, unpublished data), using the CSL Paracheck enzyme-linked immunosorbent assay with randomly selected sera obtained from the same population used as sources of our sampled cattle for the ROC analysis. In addition, we found an 80% (n = 263) (Ameni and Vordermeier, unpublished data) seroprevalence of Fasciola hepatica in the same group of animals by enzyme-linked immunosorbent assay at the Veterinary Laboratories Agency. Therefore, the relatively lower sensitivity recorded by our ROC analysis could also be attributed to coinfections with Fasciola hepatica and/or M. avium subsp. paratuberculosis, which could interfere with and compromise the response to tuberculin.
Using our data set, we calculated the apparent prevalence rates with the two cutoff values following ROC analysis to see the level of difference in apparent prevalence rates at the two cutoff points. Apparent prevalence is calculated as the number of test-positive animals divided by the total number of animals tested (23). We found a significant difference in apparent prevalence rates at the two cutoff points. Although it is useful as a consistent index and is used routinely to measure disease frequencies, apparent prevalence may underestimate the true prevalence of disease because the test used to determine apparent prevalence does not capture all infected animals (26, 30). The true prevalence of a disease in a population can be calculated using the apparent prevalence (as detected by some screening test) together with the sensitivity and specificity values of the test (30). Comparison of the true prevalence rates at the two cutoff points showed no significant difference. This is because, in addition to sensitivity and apparent prevalence, the calculation of true prevalence takes specificity into account. But in this case, although there were increases in sensitivity and apparent prevalence at a cutoff of >2 mm, the specificity was the same at both cutoff values, and the increase in true prevalence at a cutoff of >2 mm was not significantly different from the true prevalence at a cutoff of >4 mm.
Confirming our previous report (2) on both cutoff points, the apparent prevalence was significantly higher in Holsteins than in either crosses or zebus kept under identical husbandry conditions. This difference in breed susceptibility was also highlighted by the demonstration of increased disease severity in Holsteins (3).
In conclusion, our study emphasizes the need to define local cutoff values to ensure maximum test sensitivity to detect TB in cattle. In particular, we suggest that a >2-mm cutoff be applied to both breeds in central Ethiopia, rather than the OIE-recommended >4-mm cutoff, resulting in increased sensitivity without a loss of specificity.
We thank Surane Gemeda and Ato Nega Nigussie for their technical support.
Published ahead of print on 21 May 2008. ![]()
|
|
|---|
-IFN assay, and other ancillary diagnostic techniques. Res. Vet. Sci. 81:190-210.[CrossRef][Medline]
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»