Previous Article | Next Article ![]()
Clinical and Diagnostic Laboratory Immunology, August 2005, p. 970-976, Vol. 12, No. 8
1071-412X/05/$08.00+0 doi:10.1128/CDLI.12.8.970-976.2005
Copyright © 2005, American Society for Microbiology. All Rights Reserved.
Meningococcal Reference Unit, HPA North West Laboratory, PO Box 209, Clinical Sciences Building, Manchester Royal Infirmary, Manchester M13 9WZ, United Kingdom,1 Division of Infectious Disease Control, Norwegian Institute of Public Health, NO-0403 Oslo, Norway,2 Chiron Vaccines, 4560 Horton Street, Emeryville, California 94608-2916,3 Chiron Biostatistics, 4560 Horton Street, Emeryville, California 94608-2916,4 Chiron Vaccines, Via Fiorentina 1, 53100 Siena, Italy,5 Institute of Environmental Science & Research Ltd., Kenepuru Science Centre, Porirua, New Zealand6
Received 25 April 2005/ Returned for modification 13 May 2005/ Accepted 24 May 2005
|
|
|---|
4 prevaccination and 6 weeks following each dose were found. The SBA assay has been harmonized between the four different laboratories with good agreement on seroconversion rates, n-fold changes in titers, and percentages of subjects with SBA titers of
4. |
|
|---|
The lack of a standardized MenB SBA assay restricts the comparison of data produced by different laboratories and prevents the direct assessment of the immunogenicity of MenB vaccines. A multilaboratory comparison was successfully performed for serogroup A and C SBA assays (10), and a similar approach is required for MenB. A collaboration involving four laboratories, Health Protection Agency (Manchester, United Kingdom) (MC HPA), Institute for Environmental Science and Research Ltd. (Porirua, New Zealand) (NZ ESR), Norwegian Institute of Public Health (Oslo, Norway) (NIPH), and Chiron Vaccines (Emeryville, Calif.) (Chiron), was set up to compare the SBA titers generated when the same target strain and same complement source were used to test the same serum samples (but using "local" protocols). The sera were obtained from subjects immunized with a three-dose course of MenBvac produced by NIPH. The aim of the study was to standardize the SBA assay prior to trials of a "tailor-made" OMV vaccine for use in New Zealand, where a MenB epidemic caused by meningococci defined as B:4:P1.7-2,4 has been occurring since 1991 (9).
|
|
|---|
15% reduction in CFU which was used at a 25% final concentration after 60 min of incubation. The reaction mixture was mixed by gentle tapping, and the number of CFU at time zero was determined by allowing 10 µl of the reaction mixture (in the control column) to flow 8 to 10 cm, in lanes, down a CBA plate (the tilt method). Following incubation of the reaction mixture at 37°C for 60 min, 10 µl was removed from each well and plated on CBA using the tilt method to determine the number of CFU per well after 60 min of incubation. Colonies were counted after overnight incubation at 37°C with 5% CO2. SBA titers were expressed as the reciprocal of the final serum dilution step giving
50% killing at 60 min compared to the number of CFU at time zero. The assay was controlled by the use of an in-house serum control, and the target strain was controlled by the use of monoclonal antibodies raised against serogroup B polysaccharide (NIBSC code 95/750; National Institute for Biological Standards and Control, Potters Bar, South Mimms, Hertfordshire, United Kingdom) and serosubtypes P1.7 (NIBSC code 01/514) and P1.16 (NIBSC code 01/538). All four laboratories used the same complement source provided by NIPH. The protocols of each laboratory differed from the protocol of MC HPA. NZ ESR cultured bacteria on CBA with 5% sheep blood, bactericidal buffer with 1% BSA, and occasional light tapping of the reaction mixture to ensure thorough mixing. NIPH used bactericidal buffer with 0.1% BSA in Hanks balanced salt solution, mixed the heparin with the complement rather than the bactericidal buffer, and mixed the reaction mixture by an occasional light tapping. For the initial study, NIPH added 120 µl of agar, equilibrated to 48°C (and liquefied by heating to 100°C), to each well of the microtiter plates (agar overlay method) to determine the number of CFU after 60 min of incubation. The original strain shipment received by Chiron contained a contaminant, and a replacement strain was sent as a frozen culture. (This frozen culture was subsequently resupplied by NIPH to the remaining labs for use in the second study.) To create its mother culture, Chiron used a sweep of an overnight growth on chocolate agar (36°C, 5% CO2; Microbiological Media, Concord, CA), which was then frozen in 50% BSA at 80°C. For use in the assay, a tube was thawed and 10 µl was added to chocolate agar, spread across the plate, and cultured overnight. After 18 h, 10 to 15 colonies were combined and subcultured for 1.5 h in Mueller-Hinton broth (Becton-Dickinson, Sparks, MD) plus 0.25% D-glucose (Sigma, St. Louis, MO) with 5% CO2 and gentle mixing. For the determination of surviving CFU, the reaction mixture was cultured in Gey's buffer with balanced salts and 1% BSA with gentle mixing in 5% CO2; surviving bacteria were then plated and grown overnight on Mueller-Hinton agar with 5% CO2.
For the initial study, MC HPA, Chiron, and NZ ESR ran each sample three times and NIPH ran each sample twice.
Repeat interlaboratory study. Modifications to laboratory testing procedures were included in the protocols for the repeat study. Strain 44/76-SL, as a frozen culture, was redistributed to all laboratories with instructions for the production of the mother culture and working stocks. This included instructions not to pick a single colony on receipt at the receiving laboratory but to take a sweep of colonies for preparation of the mother culture. Also, the number of colonies picked for subculture for the working suspension was increased from 10 to 50 colonies.
Other changes implemented included the following. MC HPA implemented gentle rocking (for mixing) at 65 rpm in a Unitron model AJ2150 shaking incubator (Infors, Surrey, United Kingdom) during the reaction, and a control serum (NIBSC code 02/234) was used in the assay. NIPH introduced the tilt method described above for the MC HPA protocol. The two runs that NIPH performed in the repeat study differed slightly in the assay procedure; the first run used sera that were not heat inactivated, while the second run was performed with heat-inactivated sera. The results of the two runs were combined as r = 0.89, slope = 0.833, and intercept = 0.05 when the log10 titer of the second run was regressed on the log10 titer of the first run. Additionally, complement is known to be added in excess to the reaction mixture, even when the test sera are heat inactivated. NZ ESR and MC HPA retested the study sera only once more, using serum complement bridged to the plasma supplied by NIPH, which introduced an added variable to the testing procedure. Chiron did not implement changes, and its original data set was used for the repeat analysis.
Statistical analysis. MC HPA, NZ ESR, and NIPH used a starting dilution in the SBA assay of 1:2, while Chiron commenced with a dilution of 1:4. For the analyses presented here, samples with recorded titers below 4 were set to a titer of 2 for statistical analyses. For all analyses, within-subject-visit geometric means were used as the titers for NIPH (two assay runs) and Chiron (three assay runs), and single measurement determinations were used as the titers for HPA and NZ ESR. Thus, for the repeat study, the variances associated with the subject-blood draw data are theoretically different among the four laboratories. As a result, the differences in the number of replicate measurements between labs have an effect on the precision of the reported titers and thus on the comparison of results between labs. All data manipulation and statistical analyses were conducted using SAS for Windows version 9.1.3.
Pearson's chi-square test was used to determine whether the proportions of fourfold increases in SBA between the different laboratories were significantly different. This chi-square test does not account for the "paired" nature of the data (in that each of the four laboratories was testing the same subject samples). To account for the "paired" nature of the data, an analysis of variance (ANOVA) model was used to test whether the mean n-folds differed significantly by laboratory after adjusting for differences among subjects.
Geometric mean titers (GMTs) and concentrations with 95% confidence intervals (CIs) were calculated per blood draw for each laboratory. Sample means and 95% CIs were calculated using the log10 titer data. These statistics were transformed to the titer scale as GMTs and 95% CIs. Separately, for each blood draw (prevaccination, post-first dose, post-second dose, and post-third dose), an ANOVA model was used to test differences in the means of the log10 titers after adjusting for differences in means among subjects, model that blocked for subject. When the test showed significant differences between the means of the log10 titers, Dunnett's posttest procedure was conducted for pair-wise comparisons between the results from MC HPA and those from each of the other three laboratories (three pair-wise comparisons). The statistics from these comparisons were transformed to the titer scale.
Regression statistics, including the Pearson correlation coefficient (r), were calculated by using log10-transformed titer data. Least-squares regression was used to estimate the slope, intercept, and correlation coefficient separately for each of the NZ ESR, NIPH, and Chiron log10 titers regressed on MC HPA log10 titers.
|
|
|---|
4 were discrepant between laboratories in the initial study across all four blood draws (with the exception of post-first and post-third dose data between NZ ESR and NIPH). |
View this table: [in a new window] |
TABLE 1. Percentages of subjects from initial study with SBA titers of 4 by time of blood draw and laboratory
|
|
View this table: [in a new window] |
TABLE 2. SBA titer step differences by reaction mixture motion and population type
|
Following these investigations, rocking of the reaction mixture was incorporated into the MC HPA protocol, and harmonization of the assay was completed by the resending of the target strain to all laboratories with instructions on maintenance of a mixed population. The subject samples were reassayed using the replacement target strain.
Repeat interlaboratory study.
With the implementation of methodological changes, the sera were reassayed, and the data across all four labs were found to be more consistent. The percentages of subjects with SBA titers of
4 were found to be similar across all laboratories for all blood draws per laboratory (Table 3).
|
View this table: [in a new window] |
TABLE 3. Percentages of subjects from repeat study with SBA titers of 4 by time of blood draw and laboratory
|
SBA GMTs with 95% CIs are shown in Table 4. SBA GMTs between MC HPA and NZ ESR, NIPH, and Chiron each were compared separately for prevaccination, post-first dose, post-second dose, and post-third dose samples in an ANOVA model. For post-third dose samples, Chiron's GMTs were higher (at a 5% level of significance) than the MC HPA GMTs. No other significant differences were found (Table 5).
|
View this table: [in a new window] |
TABLE 4. SBA GMTs with 95% CIs per time of blood draw for each laboratory
|
|
View this table: [in a new window] |
TABLE 5. ANOVA results from repeat study comparing mean log10 titers between laboratories within visits
|
![]() ![]() ![]() View larger version (41K): [in a new window] |
FIG. 1. Comparison of SBA titers from repeat study (n = 76) between NZ ESR and MC HPA (a), NIPH and MC HPA (b), and Chiron and MC HPA (c), with regression of y equivalent to log10(titer from first laboratory in the pair) on x equivalent to log10(titer from second laboratory in the pair).
|
2, with the MC HPA titer higher than the NZ ESR titer. Compared to results from MC HPA, 79%, 83%, and 75% of the titers showed step differences of less than ±1 with NZ ESR, NIPH, and Chiron, respectively. |
View this table: [in a new window] |
TABLE 6. Repeat study interlaboratory titer step differences for SBA titers, compared to results from MC HPA (1 run)
|
|
|
|---|
In the present study, we evaluated and optimized assay parameters for interlaboratory reproducibility. The major factor that explained discrepant results between laboratories was associated with the handling of the target strain. Following the initial distribution of the strain from NIPH, different laboratories processed the strain in different ways. It was found that taking a sweep of colonies, as opposed to picking a single colony, resulted in marked differences in measured SBA titers between labs. Maintaining a mixed population of meningococci in the SBA assay more closely mimics the natural situation than does using a highly selected population. We recommend using similar sweeps of viable colonies when preparing frozen cultures for long-term storage of strains. When strain 44/76-SL was originally prepared for the SBA assay (7), about 10 to 13% of the CFU expressed the Opc++ phenotype on colony blots. Opc-positive and Opc-negative isolates can be picked from this 44/76-SL inoculum, and these have been proven to be stable (14). SBA activity has been demonstrated against meningococci that express large amounts of Opc but not against meningococci expressing smaller amounts (13); thus, the maintenance of an inoculum with a consistent proportion of CFU strongly expressing Opc is of paramount importance.
The introduction of the gentle-rocking step in the MC HPA SBA assay during the incubation of the reaction mixture was shown to increase the SBA titer compared to that of a stationary incubation. This step was already incorporated by Chiron. NZ ESR and NIPH both rely on thorough mixing of reagents prior to incubation, followed by occasional tapping of 96-well plates containing the reaction mixture during the incubation period. This step is necessary to keep the reaction mixture thoroughly mixed.
Although the results obtained in the four laboratories were comparable, an uncontrolled variable in the repeat study was the impact of differences in the number of replicate measurements, which varied between the four laboratories. Parametric statistical methods often depend on the assumption that populations being compared all have the same variance. A population of data collected as a mean of three observations is expected to have a smaller variance than a population of single point determinations. Additional replicates of each sample would be necessary when comparing the MC HPA and NZ ESR data sets with the NIPH and Chiron data sets to correct for different variances in the data sets from the four different laboratories in the repeat study and to improve the precision of the interlaboratory comparison.
To summarize, we evaluated various parameters, including medium, bactericidal buffer, microtiter plate brand, unknown serum starting dilution, mixing of the complement reaction, and handling of strain 44/76-SL, that may affect the measurement of SBA in human sera. The standardized SBA serogroup B assay has important differences from the previously standardized serogroup A and C assays (10) due to the use of human complement and maintenance of mixed populations of target strains with comparable, noncapsular antigen expression. The standardized SBA assay gave good agreement between the four laboratories on the percentages of subjects with SBA titers of
4, the GMTs across all time points tested, and the proportions of preimmune and postimmunization titers showing fourfold or greater changes.
We thank Joanne Southern and Elizabeth Miller (Immunization Department, Centre for Infections, Health Protection Agency, United Kingdom) for organization of study MNB1, from which the serum samples in this study were collected. We also thank Lynne Joslin for actual blood collections.
|
|
|---|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»