Previous Article | Next Article ![]()
Clinical and Diagnostic Laboratory Immunology, November 2004, p. 1045-1053, Vol. 11, No. 6
1071-412X/04/$08.00+0 DOI: 10.1128/CDLI.11.6.1045-1053.2004
Copyright © 2004, American Society for Microbiology. All Rights Reserved.
Kathy Holland,2,
Bruce D. Meade,4 and
Freyja Lynn4
National Immunization Program, Centers for Disease Control and Prevention, Atlanta, Georgia,1 Department of Pediatrics, Division of Infectious Diseases,2 Departments of Preventive Medicine and Medicine (Infectious Diseases), Vanderbilt University School of Medicine, Nashville, Tennessee,3 Center for Biologics Evaluation and Research, Food and Drug Administration, Bethesda, Maryland4
Received 14 May 2004/ Returned for modification 16 July 2004/ Accepted 31 August 2004
| ABSTRACT |
|---|
|
|
|---|
94 EU was proposed as the diagnostic cutoff point. Application of this cutoff point to culture-confirmed illness in a prior study investigating cough illness yielded a high diagnostic sensitivity (80%) and specificity (93%). A standardized ELISA for anti-PT IgG with a single serum sample appears to be useful for the identification of recent B. pertussis infection in adolescents and adults with cough illness. The PT cutoff point will be further evaluated in prospective studies of confirmed B. pertussis infection. | INTRODUCTION |
|---|
|
|
|---|
The diagnosis of pertussis in adolescents and adults is formidable. Isolation of B. pertussis by culture is often unsuccessful after a few weeks of illness, when most patients first present for medical care (8, 11, 14, 18, 26, 32, 48, 54). PCR assays are sometimes used to diagnose pertussis, but these tests are not universally standardized or validated and are also likely to be negative after a few weeks of illness (26). Some investigators have relied on determining antibody levels in a population by using single serum sample to establish diagnostic cutoff points for a positive test result. Because pertussis toxin (PT) is found only in B. pertussis organisms (1), diagnostic enzyme-linked immunosorbent assays (ELISAs) have focused on detecting antibodies to this antigen. One laboratory, the Massachusetts State Laboratory Institute, established a diagnostic cutoff point by using the 99% upper tolerance limit (UTL) of immunoglobulin G (IgG) against PT in 100 subjects
11 years of age who had no known recent history of pertussis (29, 64). This cutoff point was applied to a sample of 64 persons aged
11 years with bacteriologically confirmed pertussis and resulted in a diagnostic sensitivity of 63% (29). In Massachusetts, serodiagnosis by an anti-PT IgG ELISA with a single serum sample has confirmed a high incidence among adolescents and adults with clinical pertussis (64). Other investigators have used cutoff points for single serum samples derived from the mean + 2 standard deviations (SDs) or the mean + 3 SDs of the anti-PT IgG or the anti-filamentous hemagglutinin (anti-FHA) IgG or IgA ELISA levels (7, 20, 34, 41, 44, 46, 47, 50, 62, 63).
Although commercial serologic tests for the detection of pertussis exist, none have been licensed in the United States for routine diagnostic use. Standardized measurement of the levels of antibodies to B. pertussis antigens has not been performed in a large serologic survey of the U.S. population to establish diagnostic cutoff points for the serodiagnosis of pertussis. After infection, IgG responses to PT and/or FHA can be detected in >90% of infected individuals, and those to fimbria types 2 and 3 (FIM) can be detected in 30 to 60% of infected individuals (37). However, IgA and IgM responses to these antigens occur less frequently, and the diagnostic value of IgM responses has not been established for pertussis (33). To provide the basis for a diagnostic test for acute pertussis in adolescents and adults by use of a single serum sample, we established a validated ELISA (28) to derive diagnostic cutoff points for the levels of IgG against PT, FHA, and FIM in a representative sample of U.S. residents.
(This study was presented in part at the Acellular Pertussis Vaccine Conference, Bethesda, Md., November 2000.)
| MATERIALS AND METHODS |
|---|
|
|
|---|
Of the 9,149 individuals aged 6 to 49 years who were interviewed, 94% (n = 8,604) were examined. Of those examined, 70% (n = 6,040) had a sufficient quantity of serum available for analysis. The rate of serum availability was lower for younger age groups (46% for individuals aged 6 to 9 years, 61% for individuals aged 10 to 14 years, 65% for individuals aged 15 to 19 years) and higher for older age groups (78 to 82%). Participation rates were slightly lower for individuals classified as "other" race or ethnicity (66%) and non-Hispanic blacks (67%) than for non-Hispanic whites (71%) and Mexican-Americans (75%). No response differences by gender were observed.
Laboratory analysis. The levels of IgG against PT, FHA, and FIM in serum were measured by ELISA methods (32) at Vanderbilt University Medical Center (VUMC) from December 1998 through July 2000. Antibody levels were quantitated with respect to a reference serum sample that was calibrated against the U.S. Reference Pertussis Serum, Human, Lot 3 (HRP3). HRP3 has been assigned unitages of 200 ELISA units/ml (EU) for PT and 200 EU for FHA. Because no official unitage had been assigned to HRP3 for the FIM ELISA, we arbitrarily assigned a unitage of 100 EU, as in prior studies (32). Single lots of the antigens were obtained from GlaxoSmithKline, Rixensart, Belgium (PT and FHA), and from Aventis Pasteur Ltd., Toronto, Ontario, Canada (FIM). These antigens were tested for purity and antigenicity by sodium dodecyl sulfate-polyacrylamide gel electrophoresis, Western blotting, and ELISA with rabbit polyclonal antibodies provided by the Food and Drug Administration. Their endotoxin concentrations were determined by the Limulus amebocyte lysate assay (Limulus E-Toxate kits; Sigma Chemical Company, St. Louis, Mo.). In each ELISA, the lower limit of detection (LLD) was defined as the lowest amount of antibody detected and was determined to be 1 EU for the PT assay, 1 EU for the FHA assay, and 2 EU for the FIM assay. Each ELISA had an interassay coefficient of variation (CV) of <25%. The lower limit of quantitation (LLQ) was defined as the ELISA value above which the precision of the estimated values stabilized at an acceptable level. The LLQ for all three assays was conservatively estimated to be 20 EU, based on the intra- and interassay variabilities and the parallelism of the sample titration curves to the reference titration curve. Although assays with LLQs below 20 EU have been reported (20, 32), prior studies have shown that most subjects with culture- or PCR-confirmed pertussis have antibody levels that are well above 20 EU (7, 29).
Acceptance criteria for a valid test result were established during assay validation. Reference and control sera were included on every assay plate. Serum samples were retested if assay performance was inconsistent with established acceptance criteria or if the sample titration curves were not parallel to the reference curve (43). Randomly chosen serum samples from participants in NHANES III were assayed in duplicate in every assay run, and intra-assay variability was assessed by evaluating plots of CV versus the mean for duplicate specimens. Assay performance during the study period was monitored by plotting values for the assay parameters versus the date of testing. No significant changes or trends in the values for the control serum samples, assay variability, or parallelism were noted during the course of the study.
Mixture models. Because pertussis remains an endemic disease (4), we expected some proportion of the population participating in NHANES III to have been recently infected with B. pertussis. From 1991 to 1994, pertussis outbreaks involving several hundred culture- or PCR-confirmed cases were documented throughout the United States (6, 13, 16, 21, 44). ELISA values for children aged 6 to 9 years were excluded from this analysis because elevated antibody levels in this group could have resulted from recent booster doses of diphtheria and tetanus toxoids combined with whole-cell or acellular pertussis vaccine (3). Because pertussis vaccines were not administered to individuals aged >6 years and the levels of antibodies against B. pertussis antigens in serum decline within a few years after vaccination (24, 25) or natural disease (35, 52, 58), we hypothesized that individuals aged 10 to 49 years were more likely than those aged 6 to 9 years to have elevated antibody levels as a result of recent infection rather than vaccination (19, 20, 48, 59). Thus, individuals aged 10 to 49 years who provided serum represented one of several possible exposure groups: (i) no recent exposure to pertussis disease, (ii) past immunization with waning immunity, (iii) prior infection(s) with B. pertussis (or an organism with cross-reacting antigens), or (iv) recent infection with B. pertussis (or an organism with cross-reacting antigens). Assuming that the study subjects fell into one of these or other groups, the distribution of quantitative results of each assay could be modeled as a mixture of the results for several underlying populations.
For each assay, antibody levels were transformed by using the log10 function. A mixture model (31, 42, 53) was then developed that assumed normal distributions for the component populations with antibody levels greater than the LLQ. The model included a component population representing individuals with little or no measurable antibody located entirely at or below the LLQ (36). Models with increasing numbers of groups were fit to determine the best model that could be used to cluster the measured antibody levels. The Bayesian information criterion (BIC) was used as a guideline to decide how many groups should be included in the model (31), with smaller values indicating better fits. The parameters in each model were estimated by maximum likelihood (45). All statistics were weighted to represent the U.S. population (39). Standard errors and variance matrices were estimated by use of the jackknife variance estimator (22).
Diagnostic cutoff points. For each assay, we assumed that the mixture model selected correctly identified distinct populations and that the component population with the highest antibody levels represented individuals recently exposed to B. pertussis. A cutoff point for the diagnosis of acute pertussis infection was then chosen to attain a high model specificity (99%) with respect to the two component populations with the highest modeled antibody levels. To assess the validity of the cutoff point chosen for each antigen, study subjects were classified into positive and negative groups by using the cutoff point, and the distributions of the levels of antibodies to the other two antigens were evaluated within each group. We also evaluated the alternative cutoff points used in previously published research: assuming a single population, we calculated the mean + 2 SDs or the mean + 3 SDs, the 99th percentile, and the distribution-free 99% UTL (15). For each of these statistics, EU values less than the LLD were assigned a value of one-half the LLD.
Evaluation of PT cutoff point. We evaluated our PT cutoff point by retrospectively applying it to published data from a prospective study of pertussis among health plan members in Minnesota conducted in 1995 and 1996 (50). We used data obtained from 65 subjects aged 10 to 49 years from whom specimens for culture and acute-phase serum samples were collected within 14 days of cough onset and from whom convalescent-phase serum samples were collected within 26 to 56 days of cough onset. The serologic assays had been performed previously (50) but were performed in the same laboratory used to perform the assays in the present study (VUMC) by using the same methods and primary reference serum sample. The PT cutoff point was evaluated with respect to the B. pertussis culture results.
We also evaluated the PT cutoff point using data from a recent pertussis outbreak among surgical staff at a rural hospital in Ohio (30). In the Ohio outbreak, nasopharyngeal specimens from three suspected pertussis adult patients were tested by a PCR assay at a local laboratory, and the specimens from two adults were found to be positive for B. pertussis DNA. Serum samples were also obtained from 16 adults aged 28 to 54 years who were exposed to B. pertussis or suspected to have pertussis. The serum samples were assayed in the fall of 1999 at VUMC during the period when the serum samples from the NHANES III participants were being tested. We evaluated the PT cutoff point with respect to cough duration.
PT positivity.
For selected characteristics of the NHANES III study subjects, an exponential risk model was fit and a Wald test (22) was performed to assess the association between PT positivity (defined as
94 EU) and the characteristic. The month of clinical examination was classified into two groups (July to September versus other months) because pertussis cases were reported more frequently from July to September than during other months (13). To investigate the functional relationship between PT positivity and age at interview, we fit an exponential risk model that included the linear age term (years) and additional spline terms to characterize the trends by age (12).
| RESULTS |
|---|
|
|
|---|
Number of components in mixture models. When anti-PT IgG levels were analyzed in the mixture models, the lowest BIC value occurred for the three-component mixture model. However, the four-component model had a BIC value that was relatively close to that for the three-component model (4,731.5 versus 4,729.1), and it identified an additional component with high antibody levels that we speculated represented individuals with recent B. pertussis infection (Table 1). Thus, the four-component model was chosen to represent the distribution of anti-PT IgG levels. The mixture density estimated by the four-component model indicated that the model reflected the frequency distribution of ELISA values greater than the LLQ (Fig. 1A). The first population, with antibody levels less than or equal to the LLQ, included individuals with nondetectable or low levels of anti-PT IgG. The second and third component populations included individuals with moderate antibody levels. The fourth component population included individuals who had relatively high antibody levels. Results from the mixture model suggested that this group comprised 4.23% (95% confidence interval [CI], 2.27 to 6.19%) of the U.S. population aged 10 to 49 years.
|
|
A three-component model was chosen for the anti-FIM IgG levels because it had the lowest BIC value (Table 1; Fig. 1C). The first component population included individuals with nondetectable or low levels of anti-FIM IgG. The second component population included a large proportion (52%) of the U.S. population aged 10 to 49 years. For the third component population, the mean anti-FIM IgG level was well above that for the second population (306 versus 47 EU). The results from the mixture model suggested that the third component included 10% of the U.S. population aged 10 to 49 years (Table 1).
Cutoff points for diagnosis of pertussis. We chose a diagnostic cutoff point by assuming that the fourth component population in the four-component mixture model for the anti-PT IgG data represented a group of individuals with true, recent B. pertussis infections, including individuals with atypical or asymptomatic cases. On the basis of a model specificity of 99% with respect to the third and fourth groups in the model, the diagnostic cutoff point for acute infection was chosen to be 94 EU and resulted in a model sensitivity of 70% (Table 2). In contrast, the cutoff point for acute infection defined by the mean for the entire study population + 3 SDs was 436 EU, and the cutoff defined by the 99% UTL was 232 EU, with both values being higher than the cutoff established by using the mixture model. The model-based cutoff point of 94 EU is well above the low end of the distribution for the fourth group in the mixture model (Fig. 1A). For this reason, we calculated a second cutoff point of 49 EU (the fifth percentile of the fourth group) to define a range of ELISA values that might possibly be associated with acute or recent B. pertussis infection. The interval from 49 to 93 EU anti-PT IgG could be used to define a group indeterminate for acute B. pertussis infection.
|
We evaluated the assumption that the fourth group in the PT mixture model represented individuals recently infected with B. pertussis by examining the distribution of anti-FHA IgG and anti-FIM IgG values for individuals classified as positive for anti-PT IgG. These analyses were restricted to the 5,366 serum samples that had valid results by all three assays. Individuals who had anti-PT IgG levels above the cutoff point of 94 EU had higher levels of both anti-FHA IgG and anti-FIM IgG than those with values below 94 EU (Table 3). The mean level of anti-FHA IgG was 61.2 EU for individuals who were positive for anti-PT IgG, whereas it was only 14.7 EU for individuals who were negative (P < 0.001). In addition, the rate of a positive FHA serologic result was 28.4 times (95% CI, 5.5 to 145.3 times) greater for individuals whose values were above the cutoff point for anti-PT IgG than individuals whose values were below this cutoff point. This pattern of results was also observed for the distribution of anti-FIM IgG levels stratified by positivity for anti-PT IgG (Table 3). Evaluation of the diagnostic cutoff points for the anti-FHA IgG values (
358 EU) and the anti-FIM IgG values (
402 EU) produced similar findings (Table 3).
|
94 EU, yielding a diagnostic sensitivity of 80% (Table 4). Of the 60 culture-negative patients, 56 had an anti-PT IgG level <94 EU, resulting in a diagnostic specificity of 93%. In the Ohio pertussis outbreak, 10 of 16 health care workers tested had an acute cough illness of >14 days' duration (range, 20 to 42 days); 6 of these 10 adults had anti-PT IgG levels >94 EU. The anti-PT IgG level was <22 EU for the three tested adults who did not have clinical signs of pertussis (cough for 0 days) and for the three adults who had cough for 5 to 7 days.
|
94 EU) was exceeded by 2.89% (95% CI, 2.14 to 3.64%) of the U.S. population, the cutoff point for anti-FHA IgG (
358 EU) was exceeded by 0.60% (95% CI, 0.22 to 0.99%) of the U.S. population, and the cutoff point for anti-FIM IgG (
402 EU) was exceeded by 4.56% (95% CI, 3.51 to 5.60%) of the U.S. population. Because subjects classified as indeterminate for PT may be used to identify additional pertussis cases, we also determined the percentage of the population classified as indeterminate for PT but positive for FIM (0.63%) or FHA (0.08%). To evaluate associations between PT positivity and selected characteristics of the study subjects, we analyzed the valid anti-PT IgG results for 6,030 subjects, including those aged 6 to 9 years. Subjects aged 6 to 9 years had a statistically significantly (P = 0.016) higher PT positivity rate than those aged 10 to 49 years (6.50 and 2.88%, respectively). The PT positivity rate varied across the entire age range, but the Wald test for an association between positivity and age group was not statistically significant (P = 0.384) (Table 5). The pattern of positivity by age group led us to explore the functional relationship between positivity and age (in years) using an exponential risk model with a quadratic regression spline for age; for the spline function, we chose category boundaries at 9, 12, 20, and 38 years of age. The fitted spline curve suggested a sinusoidal pattern with elevated positivity in the group aged 13 to 20 years and in the group aged 37 to 46 years (Fig. 2). The rate of a positive anti-PT IgG result was not statistically significantly associated (P < 0.05) with other characteristics (Table 5).
|
|
| DISCUSSION |
|---|
|
|
|---|
More traditional approaches to developing a diagnostic cutoff value for anti-PT IgG levels would assume that none of the study population had elevated levels of IgG against PT due to recent B. pertussis infection. These approaches would assume one healthy homogenous population that is lognormally distributed and would use the 99% UTL or the mean + 2 SDs (or the mean + 3 SDs) to define the diagnostic cutoff value (29, 50, 64). However, a more comprehensive approach to discriminating between individuals who have recently been infected with B. pertussis and those who have not been recently infected requires knowledge of the antibody distributions among the individuals in these groups (23, 38). Our mixture model analysis assumed the existence of more than one exposure group in the NHANES III population. This assumption took into consideration the fact that pertussis vaccination is not given to individuals aged >6 years, that documented pertussis outbreaks occurred throughout the United States during the period of collection of the samples from participants in NHANES III, and that waning immunity or recent exposure likely affected the antibody levels. In our four-component mixture model for anti-PT IgG levels, individuals in the fourth group were presumed to have been recently infected with B. pertussis (including individuals who had mild or asymptomatic infection), whereas those in the third group likely had less recent infection. The cutoff point chosen to distinguish between the third and fourth groups with high model specificity (99%) resulted in moderate model sensitivity (70%); a moderate model sensitivity was expected because some individuals with recent or acute B. pertussis infection produce little or no measurable anti-PT IgG (37, 57). Moreover, individuals with levels of anti-PT IgG above the cutoff point were more likely to have high levels of anti-FHA IgG and anti-FIM IgG, which is consistent with recent exposure to B. pertussis.
The mixture model approach yielded a cutoff point for anti-PT IgG of 94 EU. We found that 2.89% of the NHANES III population aged 10 to 49 years had an anti-PT IgG level
94 EU, indicating recent or acute infection with B. pertussis. Thus, the prevalence of an elevated anti-PT IgG value in the U.S. population aged 10 to 49 years was 2,890 individuals per 100,000 population. This prevalence rate is higher than previous estimates of annual incidence (41, 50, 61), at least in part because it likely included individuals with an asymptomatic or a mild cough illness and because it likely reflected the gradual decline in the IgG concentrations in the months or years following B. pertussis infection (17, 52). Our results also suggested that adolescents had an elevated rate of PT positivity relative to those of all individuals aged 10 to 49 years, consistent with other studies (2, 50).
We evaluated the PT cutoff point by retrospective application to data from a previously published pertussis study that used very similar assays performed in the same laboratory used for this study. The results support the conclusion that the proposed PT cutoff point is predictive of recent B. pertussis infection with reasonable diagnostic sensitivity and specificity. Although the sample size of 16 people was small, application of the PT cutoff point during the Ohio outbreak suggested that it was useful when it was coupled with clinical criteria. As in the Ohio outbreak, we envision the diagnostic criteria for pertussis by the detection of PT to be used primarily as an epidemiologic tool rather than for individual case management. Comprehensive, prospective evaluations of the PT cutoff point will be carried out in the future to define further the diagnostic sensitivity and specificity of the cutoff point and determine whether a range of ELISA values below the cutoff point can identify additional cases of pertussis.
We believe that a simple, standardized method for anti-PT IgG detection (10) can be developed on the basis of our assay. Transformation of the laboratory technology from our study into a useful diagnostic test will require careful calibration to the working reference sera used in our study. Regional or state health departments could use such a standardized assay to assess pertussis outbreaks and measure the burden of disease in adolescents and adults. Possible future routine vaccination of adolescents and adults with PT-containing vaccines might diminish the ability of serologic tests to diagnose pertussis. At present, however, diagnosis of pertussis with a single serum sample should be used on a broader scale. Timely identification of pertussis cases combined with public health interventions might help prevent the transmission of B. pertussis to infants, who suffer the greatest morbidity and mortality from pertussis (60).
| ACKNOWLEDGMENTS |
|---|
This study was supported by a contract from CDC to Vanderbilt University Medical Center (200-97-0606).
During the conduct of this work, none of the authors had a commercial or other association that might pose a conflict of interest.
| FOOTNOTES |
|---|
Present address: Scientific & Medical Affairs, Aventis Pasteur, Swiftwater, Pa. ![]()
Present address: Clinical Trials Office, Vanderbilt-Ingram Cancer Center, Nashville, Tenn. ![]()
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Antimicrob. Agents Chemother. | Clin. Microbiol. Rev. | Infect. Immun. |
|---|---|---|
| J. Clin. Microbiol. | J. Virol. | ALL ASM JOURNALS |