Previous Article | Next Article ![]()
Clinical and Diagnostic Laboratory Immunology, October 2005, p. 1195-1201, Vol. 12, No. 10
1071-412X/05/$08.00+0 doi:10.1128/CDLI.12.10.1195-1201.2005
Copyright © 2005, American Society for Microbiology. All Rights Reserved.
Wellcome Trust/Kenya Medical Research Institute, Centre for Geographic Medicine ResearchCoast, Kilifi, Kenya,1 Nuffield Department of Clinical Medicine, Oxford University, John Radcliffe Hospital, Oxford, United Kingdom,2 Respiratory Diseases Immunology Laboratory, National Center for Infectious Diseases, Centers for Disease Control and Prevention, 1600 Clifton Road NE, Atlanta, Georgia 303333
Received 25 April 2005/ Returned for modification 29 July 2005/ Accepted 11 August 2005
|
|
|---|
|
|
|---|
In sub-Saharan Africa, diagnostic facilities are limited (8), and children with pneumonia, meningitis, and septicemia are treated according to syndromic algorithms rather than by individual laboratory investigations (27). The detection of IPD is also needed, therefore, to validate treatment algorithms. The emphases of individual diagnosis and epidemiological validation differ; individual diagnosis is advanced by techniques with high sensitivities and negative predictive values, and epidemiological studies by techniques with high specificities and positive predictive values. Isolation of Streptococcus pneumoniae from cultures of normally sterile sites is insensitive in untreated patients; for example, in The Gambia, despite comprehensive blood culture screening in pneumonia cases, the absolute effectiveness of conjugate vaccine against radiological pneumonia was more than seven times greater than that against pneumococcal disease defined by blood or lung aspirate cultures, suggesting that most cases of pneumococcal pneumonia are culture negative (5). The natural insensitivity of cultures is compromised further by prior use of antibiotics, which are available without prescription in many developing countries. Techniques that are unaffected by antibiotic use, such as PCR, antigen detection, and serology, may therefore be advantageous.
Pneumococcal surface adhesin A (PsaA) is a conserved, common protein of S. pneumoniae expressed at the cell surface of all 90 pneumococcal serotypes and visible to the humoral immune system (4, 15). In mouse models, immunization with PsaA elicits protection against nasopharyngeal carriage and invasive disease, and PsaA is proposed as a potential vaccine antigen (3, 10, 23). An immunoglobulin G (IgG) enzyme-linked immunosorbent assay (ELISA) using native or recombinant PsaA has been developed (25), and among Kenyan adults with pneumococcal pneumonia, this test has a sensitivity of 0.70 and a specificity of 0.98 (21). Natural IgG to PsaA is observed in healthy Kenyan infants at levels similar to those found in adults (13), and in Finland, episodes of acute otitis media have been associated with serum and salivary anti-PsaA responses (18, 22). It is possible, therefore, that a rising concentration of anti-PsaA in the presence of a compatible clinical illness may provide a specific diagnosis of IPD. Here we test this possibility in pediatric patients with IPD and in two control populations.
|
|
|---|
60 days old for whom sepsis was suspected. The commonest presentations were with malaria, invasive bacterial disease, anemia, and malnutrition. The prevalences of human immunodeficiency virus among outpatients and admissions to the pediatric service were 2.4% and 7.1%, respectively (1, 2). Study populations. IPD patients were defined as children of 1 month to 7 years of age admitted to Kilifi District Hospital whose cultures of blood, cerebrospinal fluid (CSF), or pleural aspirate grew S. pneumoniae and who survived for at least 10 days and provided convalescent-phase blood specimens.
For every patient with IPD, one sick and one healthy control child were recruited and frequency matched by sex and by age in seven strata (0 to 5, 6 to 11, 12 to 17, 18 to 23, 24 to 35, 36 to 59, and 60 to 83 months of age). After identifying a patient with IPD, sick control children were recruited on the pediatric ward as the next qualifying admissions, subject to the constraints of matching. A child was eligible for inclusion as a sick control if he or she had a blood culture negative for S. pneumoniae and had either anemia (hemoglobin level of <6.0 g/dl) or malaria, defined as pyrexia and a blood smear positive for Plasmodium falciparum. Later, a fieldworker traveled to the home of the IPD patient and, spinning a pencil on the ground, walked in the direction indicated looking for a homestead with a suitable healthy control child. Children were eligible for inclusion if they were well on the day of recruitment and had no histories of cough or clinic attendance in the last 14 days.
Sampling procedures. Blood for culture was inoculated into BACTEC PedsPlus media, incubated for 5 days in a BACTEC 9050 instrument (Becton Dickinson, New Jersey), and subcultured to 7% horse blood agar as signaled. From each child, samples of plasma, one at recruitment and another 10 or more days later, were taken and frozen at 70°C. Among controls, a Dacron-tipped flexible wire swab was passed to the nasopharynx, twisted, and withdrawn; the swab was inoculated promptly onto gentamicin blood agar and incubated overnight at 37°C in 5% CO2. All healthy control children were sampled at the hospital clinic close to the laboratory. Pneumococci from blood, CSF, and nasopharyngeal swab cultures were identified by colony morphology, optochin sensitivity, and capsular serotyping by the Quellung technique with polyclonal rabbit sera (Statens Seruminstitut, Denmark).
ELISA for anti-PsaA IgG. The method of Tharpe and colleagues was used (24, 25) and is described in detail elsewhere (21). An in-house standard serum, BW2000, was used to calculate concentrations; this in-house serum was given a value of 578 ng/ml anti-PsaA when assayed in the laboratory of J. S. Sampson against reference serum IS1644 (CDC, Atlanta, Georgia). A commercial pooled serum (Sandoglobulin) was used for quality control. Paired plasma samples from each patient were always assayed on the same plate, including those for any repeat assays.
Blood samples for ELISA were taken from IPD patients when blood or CSF cultures became positive at 1 to 6 days after admission. Plasma residual volumes from hemoglobin estimations done upon admission were available for some children. To take advantage of these earlier acute-phase samples and maintain consistency across acute-convalescent-phase pairings, all blood samples in the study were assayed as plasma. The use of plasma was first validated in 25 serum-plasma pairs taken from the same blood draw.
Analytical methods. Analysis was performed using STATA v 8.2 (StataCorp, College Station, TX). For consistency, the terms acute- and convalescent-phase plasma are used to refer to the first and second samples, respectively, drawn from study subjects in all groups. Receiver operating characteristic (ROC) curves for acute concentrations and for the ratio rises in concentration between the two samples, comparing IPD patients to healthy controls, were generated. Optimal thresholds were selected from these curves to estimate sensitivities and specificities. Differences in categorical data were tested by chi-square test, and differences in concentrations and ratio rises between groups were tested by t test after logarithmic transformation. For proportions, exact binomial 95% confidence limits were calculated.
The study was approved by the National Ethical Review Committee of Kenya and by the Institutional Review Board of the Centers for Disease Control and Prevention.
|
|
|---|
|
View this table: [in a new window] |
TABLE 1. Characteristics of the three study groups
|
The distributions of anti-PsaA concentrations in acute-phase samples and of the ratios of convalescent/acute-phase concentrations of anti-PsaA are shown in Fig. 1. The distribution of ratios shows a significant rightward spread (indicating rising concentrations) among IPD patients compared to the control groups. A smaller rightward shift is seen for the concentrations of anti-PsaA in acute-phase plasma samples from IPD patients, suggesting that some patients already had elevated concentrations of anti-PsaA at the point when they were admitted to the study. The median (interquartile range) concentrations of acute-phase plasma in µg/ml for IPD cases and healthy and sick controls were 51 (18 to 163), 36 (21 to 64), and 36 (16 to 97), respectively.
![]() View larger version (22K): [in a new window] |
FIG. 1. Distributions of the concentrations of anti-PsaA in acute-phase samples and of the ratios of convalescent/acute-phase concentrations in IPD patients and in two control groups. Bars show the frequencies of children in each group against concentrations of anti-PsaA in acute-phase plasma samples (left side) and ratio rise/fall in anti-PsaA concentrations between acute- and convalescent-phase samples (right side). The numbers in each group are as follows: patients with IPD, 98; healthy controls, 97; and sick controls, 95.
|
0.96), a single measurement of anti-PsaA in the acute-phase specimen had a sensitivity of less than 0.20.
![]() View larger version (13K): [in a new window] |
FIG. 2. Receiver operating characteristic curves for the anti-PsaA ELISA in IPD patients and healthy controls. (A) The gray curve describes thresholds defined by the convalescent/acute-phase concentration ratio; the black curve describes thresholds defined by the acute-phase plasma concentration alone. The areas under the two ROC curves are 0.82 and 0.57, respectively (chi-square value, 19.6; P < 0.0005). (B) Both curves describe thresholds defined by the convalescent/acute-phase concentration ratios. Data for children of <2 years old are in black; The data for children of 2 to 6 years old are in gray. The areas under the two ROC curves are 0.91 and 0.79, respectively (chi-square value, 4.2; P = 0.04).
|
|
View this table: [in a new window] |
TABLE 2. Sensitivities and specificities of different diagnostic criteria estimated among patients with invasive pneumococcal disease and healthy controls, respectively
|
Acute-phase samples were available from the day of admission in half of the IPD patients (Table 1). Restriction of the analysis to these children improved the sensitivity of the assay to 0.48 (Table 2).
Nasopharyngeal swabs from 40 (41%) healthy controls and 31 (33%) sick controls were positive on cultures for S. pneumoniae. Colonization prevalences were 43%, 35%, and 22% among children of <2 years, 3 to 4 years, and 5 to 6 years of age, respectively. We hypothesized that healthy control children with positive swabs would be more likely than those with negative swabs to express rises in anti-PsaA and also that the presence of S. pneumoniae in the nasopharynges of sick control children may be a marker for undetected pneumococcal disease. However, the geometric mean ratio change in anti-PsaA between acute- and convalescent-phase plasma was not significantly different among colonized (1.01) and uncolonized (0.84) healthy controls. Similarly the mean ratio change in anti-PsaA was not significantly different among colonized (0.94) and uncolonized (0.96) sick controls.
Given the small excess of very high concentration values in the acute-phase samples from IPD cases (Fig. 1), we explored the value of including these in the analysis. From the scatter graphs of the acute-phase concentrations and ratio rises (Fig. 3), new threshold criteria were selected to exclude the main cluster of results in the healthy control group, allowing only outliers to be considered as positive. These thresholds represent an acute concentration of >323 µg/ml and a ratio rise of >3-fold. In this analysis, a positive test was achieved by meeting either threshold; sensitivity was 0.48 (95% CI, 0.38 to 0.58), and specificity was 0.97 (95% CI, 0.91 to 0.99)
![]() View larger version (15K): [in a new window] |
FIG. 3. Scatter plots of convalescent/acute-phase concentration ratios against acute-phase concentrations of anti-PsaA for three study groups. Dots represent individual patients within the three study groups: (A) patients with IPD, n = 98; (B) healthy controls, n = 97; (C) sick controls, n = 95. Convalescent/acute-phase ratios have been transformed to log2 and acute-phase concentrations to log10. Dotted lines indicate the thresholds selected from the scatter plots to optimize sensitivity in IPD patients and specificity in healthy controls.
|
250 µg/ml, and 6 (6.3%) had rises in anti-PsaA concentrations between acute- and convalescent-phase plasma samples of
2.7. The proportions meeting these criteria among sick control children of <2 years of age were 7% (3/46) and 2% (1/46), respectively. |
|
|---|
Our objective was to validate the performance of the anti-PsaA ELISA for the diagnosis of pediatric IPD with adequate numbers and appropriate control groups. Pneumococcal disease is more common among children than among adults admitted to hospitals, and given the insensitivity of blood and CSF cultures, we anticipated that the sick control group would contain moderate numbers of occult pneumococcal patients. To illustrate, at Kilifi Hospital 21% of childhood deaths associated with P. falciparum parasitemia have concurrent bacteremia, for which S. pneumoniae is the commonest pathogen (1). For this reason, we estimated specificity here among healthy controls. The sick control group was included to test the hypothesis that nonspecific factors associated with illness, particularly with fever, may frequently elicit immunological changes that mimic a measurable anti-PsaA ELISA response. In Kilifi, it is quite plausible that 6% of patients admitted with malaria or anemia have occult pneumococcal disease, and therefore the results do not support the hypothesis of nonspecific immunological changes.
The performance of the anti-PsaA ELISA was not as impressive in children as it had been in adults (21). Optimized at a 2.7-fold rise in concentration, sensitivity was 0.42 and specificity was 0.97. Two factors suggest that the study performance would be slightly better in the context of an epidemiological study. First, in a surveillance study or vaccine efficacy trial, blood specimens would normally be collected from all study participants on admission. Second, research and surveillance studies focus almost invariably on children in the first 2 years of life, because that is the age of maximum disease risk. In our subset analyses, both factors yielded higher sensitivity estimates, albeit marginally, and in the group of children satisfying both factors, the assay correctly identified half of all cases of IPD and correctly classified all of the healthy controls.
An assay of IgM rather than IgG antibodies might have discriminated better between healthy children and patients with IPD. However, Kenyan children attain adult levels of anti-PsaA IgG in the first year of life (13), and as IPD affects only a small percentage of the population, the most likely stimulus is early nasopharyngeal colonization with S. pneumoniae. Later exposures leading to disease are likely therefore to elicit secondary memory immune responses.
The fact that colonization prevalence is much higher in children than in adults might explain the inferior performance of the serological assay in this age group. This problem was first described for a PCR assay of the pneumolysin gene, for which the proportion of false-positive results by age among healthy controls was shown to parallel the prevalence of nasopharyngeal carriage (6). We hypothesized that a rising concentration of anti-PsaA, captured during a 2-week observation period, might be stimulated by recent nasopharyngeal acquisition in healthy controls but found no evidence to support this; it may be that acquisition during, but not before, the sampling period was driving false-positive results, and in hindsight the study may have benefited from nasopharyngeal swab cultures taken with the convalescent-phase samples.
Deriving a standard curve from 8 dilutions and assaying test samples at 7 dilutions allows a precise definition of the IgG concentration. On a continuous concentration scale, the ROC analysis permits fine optimization of the test performance. Applying fitted thresholds for both the ratio rise and the acute-phase concentration together extended the sensitivity of the assay to 0.48 by including those who exhibited high concentrations on admission, presumably because they had been exposed to the pneumococcus several days prior to admission. The thresholds were derived closely from the data, and before generalizing this approach to another setting, it would be prudent to validate it locally. It does, however, illustrate the practical problems of serological diagnosis and a potential solution.
Advances in the diagnosis of invasive pneumococcal disease in children are rare and have been confined recently to the detection of C polysaccharide antigen in urine and CSF (19). The specificity of this antigen assay in urine is too low for consideration in epidemiological studies (7, 9). The anti-PsaA IgG ELISA has a sensitivity of 0.42 at an acceptable specificity of 0.97. It is possible that assay refinements (e.g., employing different blocking agents or wash routines or prior absorption with potentially cross-reactive antigens) could improve performance, though in this evaluation we adhered to the published methodology (21). Sampling children at first presentation, examining only those under 2 years of age, and using a two-threshold analysis all tended to improve sensitivity without compromising specificity. In any of these situations, the anti-PsaA ELISA can detect approximately half of culture-positive cases; if some of this benefit extends to culture-negative cases, especially those with prior antibiotic use, it would augment our currently meager diagnostic toolbox. However, the excellent performance of the assay in adults has clearly not been reproduced in children, and what gains can be claimed for the anti-PsaA ELISA are more indicative of the extremely poor state of diagnostics, both epidemiological and clinical, for invasive pneumococcal disease in children.
The work was supported by the Wellcome Trust of Great Britain, and J.A.G.S. is supported by a fellowship from the Wellcome Trust (no. 061089).
|
|
|---|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»