Previous Article | Next Article ![]()
Clinical and Diagnostic Laboratory Immunology, March 2004, p. 297-301, Vol. 11, No. 2
1071-412X/04/$08.00+0 DOI: 10.1128/CDLI.11.2.297-301.2004
Copyright © 2004, American Society for Microbiology. All Rights Reserved.
McLendon Clinical Laboratories, University of North Carolina HealthCare,1 Department of Medicine, University of North Carolina School of Medicine,3 Department of Epidemiology, University of North Carolina School of Public Health, Chapel Hill,4 Great Smoky Mountain Diagnostics, Asheville, North Carolina2
Received 19 June 2003/ Accepted 9 October 2003
|
|
|---|
|
|
|---|
Testing for anti-ENA antibodies has historically relied on gel-based immunoprecipitation techniques such as double immunodiffusion (DID) and counterimmunoelectrophoresis (2, 14). The associations of specific types of ENA autoantibodies with rheumatological diseases were established by using these gel-based immunoassay techniques (15). In the last decade, enzyme-linked immunoassay (ELISA) systems have been developed to detect and determine the specificity of anti-ENA antibodies. ELISA systems permit more rapid processing of more specimens with a faster turnaround time than gel-based assays. ELISA-based methods may also have increased sensitivity for detection of ENA antibodies. However, the increased sensitivity of these ELISAs may influence the clinical relevance of their detection because diagnostic specificity may be reduced (10, 12, 17, 24). As yet, a set of reference standards with known antibody specificities against defined antigen preparations is not available for evaluation of various methods or kits. Serum reference panels are available from the Association of Medical Laboratory Immunologists (4), but the specificities of these sera were determined by consensus results from multiple laboratories. The purpose of this study was to address the relationship between DID and ELISA methods for the detection and identification of anti-ENA antibodies by evaluating and comparing two DID kits and three ELISA kits. We evaluated both screening ELISAs and monospecific antigen ELISAs to determine anti-ENA specificity.
|
|
|---|
Kits. The immunoassay kits chosen for this study were based upon their representation in the listing of immunoassays utilized by participants in the College of American Pathologists proficiency surveys, as well as the manufacturer's willingness to participate in this study by providing immunoassay kits. Three manufacturers of screening and individual antigen ELISA systems are as follows: Immuno Concepts (kit 2) (Sacramento, Calif.), INOVA Diagnostics, Inc. (kit 3) (San Diego, Calif.), and Diamedix (kit 4) (Miami, Fla.). Two DID kits from INOVA Diagnostics, Inc. (kit 5) (currently in use in the Clinical Immunology Laboratory at UNC Hospitals), and Immuno Concepts (kit 1) were evaluated. The test procedures were performed according to the directions supplied in the manufacturers' package inserts.
Study population and specimens. The sample set used for this study consisted of 180 patient specimens received in the clinical immunology laboratory at UNC Hospitals for ENA autoantibody antibody testing. This set represents 1 year of ENA testing at this institution, which is a tertiary-care hospital associated with a medical school. Serum specimens from these patients were frozen at -70°C after testing for clinical purposes. Based on the standard assays used in our laboratory (testing for ENA by DID, ANA by indirect immunofluorescence using a Hep-2 substrate, and double-stranded DNA [dsDNA] by indirect immunofluorescence using a Crithidia luciliae substrate), the sample set included 83 ENA-, ANA-, and dsDNA-positive specimens, 77 ANA-positive, ENA- and dsDNA-negative specimens, and 20 specimens that were negative for ENA, dsDNA, and ANA. The 83 specimens that were ENA positive by our DID testing represented 81% of the total number of ENA antibody-positive specimens analyzed by the clinical immunology laboratory. All 180 of the specimens were tested for autoantibodies directed against Smith (Sm), ribonucleoprotein (RNP), anti-Sjögrens syndrome A/RO (SSA), and anti-Sjögrens syndrome B/La (SSB) with DID kit 5, our standard laboratory immunoassay for ENA antibodies. A small fraction of these specimens were also tested for autoantibodies directed against Scl-70 and Jo-1 with DID kit 5 as part of the previous routine testing requested by the physician. For this study, testing was conducted on frozen aliquots from the original specimens. All screening ELISAs, individual antigen profile ELISAs, and DID using kit 1 were carried out on the same day according to the manufacturers' kit instructions. The specimens were tested on the individual antigen ELISA regardless of their results on the initial screening ELISA, since both assays were set up at the same time. Specificity for each of the four main ENA antigens (Sm, RNP, SSA, and SSB) was determined. Testing of specimens by DID for detection of Scl-70 or Jo-1 autoantibodies was based on whether the specimen had previously been tested by DID for the antigens or detection of Scl-70 or Jo-1 autoantibody by ELISA.
The medical records of the patients whose specimens yielded inconsistent results by different methods were reviewed by an independent rheumatologist, to determine the clinical diagnosis at the time that the clinical specimen was collected. The reviewer was asked, based upon the patient's clinical presentation and symptoms at the time that the specimen was collected, to consider whether a positive ENA result would be expected and, if so, whether anti-ENA specificity might be expected to be present.
Statistical analysis. Two of the ELISA kit manufacturers reported results that were called "borderline" or "equivocal." For purposes of statistical analysis, specimens (n = 12) that gave equivocal or borderline results were eliminated from the data set prior to statistical analysis. Sensitivity and specificity were calculated by two methods. First, sensitivity and specificity were calculated by using the kit 5 (DID) result as the reference standard. In this analysis, the sensitivity and specificity of kit 5 are assumed to be 100%. Secondly, latent-class analysis was used to calculate sensitivity and specificity for each of the kits tested (18, 23). Using a maximum likelihood procedure, this method provides estimates for all five kits without designating a reference standard. Although this method assumes that the tests are independent, the method is robust to violations of this assumption (18).
|
|
|---|
|
View this table: [in a new window] |
TABLE 1. Evaluation of screening ELISAs and DID for detection of ENA autoantibodiesa
|
|
View this table: [in a new window] |
TABLE 2. Latent class analysis of ELISA screening and DID for detection of autoantibodies against ENAa
|
98% for detection of the four major antigens using kit 1. The sensitivities of kit 1 were 73% for detection of Sm antibodies, 100% for RNP antibodies, and 92 and 78% for SSA and SSB antibodies, respectively. The three ELISA profile kits performed similarly as a group. Kit 3, overall, had more discordant results than the other two ELISAs (kits 2 and 4) for the four major antigens (Table 3). The average sensitivity of detection of the Sm antigen by the kits tested compared to kit 5 was the lowest for the four antigens tested (75% ± 9%). Average concordance between the other kits and kit 5 for detection of Sm was also lower, on average, than for the other three antigens. Average concordance for detection of Sm antigen was 91% ± 12%, compared to 94% ± 7% for RNP, 95% ± 2% for SSA, and 94% ± 3% for SSB. The specificity of detection for all four antigens was similar regardless of the kit used. Limited testing was conducted for Jo-1 and Scl-70 antigens; however, in all cases where the in-house DID (kit 5) was positive for either antigen, kit 1 DID and all three ELISA profile kits for either Jo-1 or Scl-70 were positive. |
View this table: [in a new window] |
TABLE 3. Evaluation of profile kitsa using in-house DID (kit 5) as the reference standard
|
98% for detection of the four major antigens tested. The ELISA kits also showed similar results, except for kit 3, which had low specificity for Sm (73%) and RNP (86%). |
View this table: [in a new window] |
TABLE 4. Latent-class analysis of profile kitsa
|
|
View this table: [in a new window] |
TABLE 5. Clinical data for specimens with inconsistent results of ENA autoantibody testinga
|
|
|
|---|
The determination of the test characteristics of these assays is limited because no "perfect" reference standard is available. In using kit 5 (DID) as the reference standard, we assumed it had perfect characteristics. If a test is more sensitive, such as many of the ELISAs, some true-positive specimens may be misclassified as false positives, resulting in underestimation of test sensitivity. To address this issue we used latent-class analysis, which does not require the designation of a reference standard. Although this procedure assumes independence between the assays, the estimates are relatively robust to violation of this assumption (18). Results of this study indicate that the initial antibody screening ELISA had good correlation with the DID for detecting anti-ENA antibodies. One can reasonably assume that, based upon these results, the ELISA kits commercially available will detect specimens that contain anti-ENA antibodies. Both DID methods showed high levels of agreement for detection of specific ENA autoantibodies. By latent class analysis, the ELISA kits were more sensitive for antibody detection than the DID kits (Table 2), which was not unexpected, because other studies have drawn similar conclusions (1, 9). Lock et al. found that some patients who do not have systemic lupus erythematosus had levels of anti-Sm antibodies that were detectable by ELISA (8). This type of nonspecificity may have important consequences, since the presence of anti-Sm is one of the diagnostic criteria described by the American Rheumatism Association for a diagnosis of systemic lupus erythematosus (15). The antigen source, native or recombinant, and method of purification are critical to sensitivity and specificity in relation to the Sm/RNP complex (7) and to the SSA multichain antigen (13, 21). Conformational changes, as a result of coating the plastic microwell, may result in loss of conformational epitopes recognized by ENA antibodies (6, 11). However, the DID technique may be more specific for detecting clinically significant anti-ENA antibodies.
ELISA techniques are more likely to detect low affinity antibodies than gel immunodiffusion methods (8, 19). The variation in results of the ELISA kits may reflect differences in antigen preparations, possibly resulting in different antigen-binding epitopes and/or the presence of contaminating antigens; differences in antigen coating concentrations; different buffers affecting binding of antibodies, and different cutoff values for determination of positive and negative. Other studies have also shown inconsistent results between various ELISA kits (17). Additional studies are needed to determine the reasons for these inconsistencies, but this will be difficult to do until a standardized set of control antigens is available.
A majority of the specimens with inconsistent results that were noted in this study (67%) were from specimens with lower ANA titers, which has been noted in other studies as well (4). The lower ANA titers may reflect antibodies that have lower binding avidities. Among specimens with inconsistent results, review of the patient's chart at the time of specimen collection showed that most of the patients had either a diagnosis or symptoms of autoimmune disease. The major discrepancy was due to the fact that the DID test was negative while the ELISAs were positive. Overall, the agreement between the kits for ENA specificity was good. Predicted ENA specificity matched measured specificity in 50% of the specimens.
There is still no one ideal test that is both highly sensitive and highly specific. So what is the strategy for anti-ENA testing? The European Consensus Workshops recommends that ENA testing be performed by two or more methods (20). Given the trade-off between sensitivity and specificity between the ELISA and DID methods, one might consider using the ELISAs to screen sera for anti-ENA antibodies, followed by DID testing of positive sera for identification of antibody specificity. Regardless of the testing strategy an individual laboratory selects, clear communication with the clinical staff regarding the significance of a positive result is imperative. Clinicians must be aware of the sensitivity and specificity of each testing method used.
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»