Previous Article | Next Article ![]()
Clinical and Vaccine Immunology, January 2008, p. 42-48, Vol. 15, No. 1
1071-412X/08/$08.00+0 doi:10.1128/CVI.00211-07
Copyright © 2008, American Society for Microbiology. All Rights Reserved.

Department of Clinical Pathology and Experimental Medicine, Centocor R&D, Radnor, Pennsylvania 19087
Received 24 May 2007/ Returned for modification 16 August 2007/ Accepted 6 November 2007
|
|
|---|
|
|
|---|
The plate-based multiplex assays have the advantage of small sample volume, good sensitivity, high throughput, and the potential to measure a large number of cytokines simultaneously (15). However, as with standard ELISA, the multiplex assays are dependent upon the careful choice of the capture/detection antibody pairs, calibration curve standardization, and proper buffering of the sample to minimize matrix interference with the detection of the cytokine.
In the current study, two commercially available multiplex platforms in conjunction with standard ELISAs are compared. Eight commonly measured cytokines were chosen for the comparison: gamma interferon (IFN-
), vascular endothelial growth factor (VEGF), tumor necrosis factor alpha (TNF-
), interleukin-6 (IL-6), macrophage inflammatory protein 1β (MIP-1β), monocyte chemoattractant protein 1 (MCP-1), IL-12p40, and IL-4. The range of quantitation of the platforms, the recovery of spiked cytokines, and the detection of the cytokines in serum samples from subjects with ulcerative colitis, Crohn's disease, rheumatoid arthritis (RA), and psoriasis were examined. The findings show that the detection of the cytokines is highly dependent upon the platform, with the consistency of the detection across platforms dependent upon the cytokine being analyzed.
|
|
|---|
Whole blood drawn into a dry collection bag was allowed to clot overnight in a refrigerator and spun to serum at 2,800 x g for 20 min in a refrigerated centrifuge (5°C). A prelabeled transfer bag was attached to an available port on the collection bag, and serum was gently expressed into the transfer bag with the use of a plasma extractor device, ensuring that there was no red blood cell contamination.
Multiplex evaluations.
The multiplex assays were manufactured by Meso Scale Discovery (MSD; Gaithersburg, MD) and Pierce Endogen (Pierce Biotechnology, Woburn, MA). Each well of the 96-well plate-based assays contained antibodies to IFN-
, VEGF, TNF-
, IL-6, MIP-1β, MCP-1, IL-12p40, and IL-4. The manufacturer spotted the antibodies onto the base of the well.
The MSD platform used in this study was a 96-well plate-based assay that incorporated electrochemiluminescence as the basis for detection. Following the capture of the cytokine by the spotted antibody, labeled detection antibodies were bound to the antigen. The detection antibodies were coupled to electrochemiluminescent labels that emitted light when electrochemically stimulated via carbon-coated electrodes in the bottom of the array wells. In addition, a detection buffer that was added prior to reading of the array incorporated reactants that enhanced the electrochemical signal. The resulting signal was read using a charge-coupled device (CCD).
In brief the MSD Multi Spot Array assay was run as follows. Calibration curves were prepared in the supplied assay diluent for human serum, with a range of 40,000 pg/ml to 1.2 pg/ml, dependent upon the cytokine. Assay controls consisted of a pool of two healthy human donor serums, spiked with the MSD standard at a high or medium concentration. The acceptance ranges for the controls were set to 100% ± compared to 30% the mean of eight assays. Arrays were preincubated with 25 µl per well of assay diluent for 30 min, with shaking at room temperature. Following the preincubation, 25 µl of sample or calibrator was added in duplicate to the appropriate wells. The array was then incubated at room temperature for 2 h, with shaking. The array was then washed with phosphate-buffered saline plus 0.05% Tween 20, and 25 µl of detection antibody reagent was added. Following a 2-h room-temperature incubation with shaking, the array was washed and the detection buffer was added. The assay results were read using an MSD Sector Imager 6000 incorporating a CCD. Sample cytokine concentrations were determined with Softmax Pro Version 4.6 software, using curve fit models (log-log or four-parameter log-logistic) as suggested by the manufacturer for the specific cytokine.
The Pierce Endogen SearchLight was also a 96-well plate-based assay. The detection for this system utilized ELISA technology. In brief the Pierce SearchLight assay was performed as follows.
Calibration curves were prepared in sample diluent, with a range of 5,000 pg/ml to 0.4 pg/ml, dependent upon the cytokine being analyzed. Assay controls consisted of the sample diluent spiked with the calibration standard at high or medium concentrations. The controls were deemed acceptable if the recovery was within 100% ± 30% of the theoretical concentration. Serum samples were diluted 1:5 in sample diluent. Diluted samples or calibration curves (50 µl) were added in duplicate to the appropriate wells and incubated at room temperature for 1 h with shaking. The plates were then washed with kit wash buffer, and 50 µl of biotinylated antibody detection reagent was added. The plate was then incubated for 30 min at room temperature with shaking. Following a wash step, 50 µl streptavidin-horseradish peroxidase was added to each well and incubated at room temperature for 30 min with shaking. The array was then washed, and 50 µl of substrate solution was added. The assay results were read with the Pierce SearchLight Plus imaging system incorporating a CCD. Sample cytokine concentrations were determined with Softmax Pro 4.6 software, using curve fit models (log-log or four-parameter log-logistic) as suggested by the manufacturer for the specific cytokine.
ELISAs. Single-analyte analyses of individual cytokines were performed using R&D Systems kits (R&D Systems, Minneapolis, MN). Assays were performed according to the manufacturer's instructions.
Statistical analysis. The statistical analyses were performed using the Spearman rank correlation coefficient or paired t tests with SigmaStat software (Systat Software Inc., San Jose, CA).
|
|
|---|
|
View this table: [in a new window] |
TABLE 1. Quantitation ranges for multiplex (MSD/Pierce) and single analyte (R&D) assays
|
|
View this table: [in a new window] |
TABLE 2. Endogenous levels of cytokines in healthy human serum
|
![]() View larger version (21K): [in a new window] |
FIG. 1. Effect of sample diluent on the recovery of spiked samples. Unpooled serum samples (S1 to S10) had VEGF added at a concentration of 1,250 pg/ml or 312 pg/ml. Samples were diluted with either standard sample diluent or modified sample diluent. Samples were tested on the Pierce SearchLight System. Results are calculated as the percentages of the expected values (averages of two separate determinations). Open bars, standard diluent; solid bars, modified diluent.
|
While the exact formulation of the diluents is considered by the manufacturers to be proprietary, the diluents contained additional protein and detergent components known to minimize matrix interference. Further testing of spike recovery used the modified diluent in both platforms.
The recovery of spiked cytokines in the multiplex and single ELISA platforms is given in Table 3. For the multiplexed assays, a recovery of antigen within a 100% ± 30% range of the expected value was considered to be acceptable. With the exception of MCP-1 in both of the multiplexed platforms, incorporating the use of modified sample diluent gave acceptable recovery of the spiked cytokines. The MCP-1 assay overrecovered antigen by more than 30% in both platforms, likely due to differences in the detection of MCP-1 in serum compared to that of the standard that is prepared in assay buffer. The single ELISA platform gave acceptable recovery for all cytokines.
|
View this table: [in a new window] |
TABLE 3. Recovery of spiked cytokines by single and multiplex ELISAs
|
![]() View larger version (17K): [in a new window] |
FIG. 2. Detection of VEGF and IL-6 in samples obtained from subjects with RA, using either standard diluent or modified diluent. Samples were tested in duplicate on two separate days; the values are the averages of the data points. Open bars, standard diluent; solid bars, modified diluent.
|
The consistency of cytokine detection across all three platforms varied depending upon the cytokine being tested and the disease state. As an example of platforms giving consistent results across diseases, the recovery seen with VEGF is given in Fig. 3. In both ulcerative colitis and RA, the detection of VEGF was comparable, with similar concentrations being found across platforms.
![]() View larger version (31K): [in a new window] |
FIG. 3. Detection of VEGF in samples obtained from subjects with ulcerative colitis or RA. Samples were tested in duplicate on two separate days; the values are the averages of the data points. Samples were tested on the Pierce SearchLight System. Open bars, MSD; solid bars, Pierce; diagonally striped bars, R&D.
|
(Fig. 5) was also platform dependent. In ulcerative colitis, with the MSD and Pierce platforms, the majority of samples were near the LLOQ, while with the R&D assay two of the sample concentrations were well within the quantitation ranges of the assay. In RA samples, the Pierce platform gave much higher TNF-
quantities for seven/eight samples, compared with the MSD and R&D platforms.
![]() View larger version (34K): [in a new window] |
FIG. 4. Detection of IL-12p40 in samples obtained from subjects with ulcerative colitis or RA. Samples were tested in duplicate on two separate days; the values are the averages of the data points. Open bars, MSD; solid bars, Pierce; diagonally striped bars, R&D.
|
![]() View larger version (20K): [in a new window] |
FIG. 5. Detection of TNF- in samples obtained from subjects with ulcerative colitis or RA. Samples were tested in duplicate on two separate days; the values are the averages of the data points. Open bars, MSD; solid bars, Pierce; diagonally striped bars, R&D.
|
|
View this table: [in a new window] |
TABLE 4. Correlation between assay kit results for disease state serum samples
|
|
|
|---|
The consistency of detection of endogenous cytokine from disease state samples is of critical concern. The measurement of cytokines in serum has a bearing upon mechanism of action studies, pathway analysis, and response to treatment. The results presented in this study demonstrated both the consistency and the variation in measurement between multiplex platforms and single ELISA. Consistent measurements across platforms were seen with the VEGF, MIP-1β, and MCP-1 analysis in the four disease state samples. The remaining five cytokines were not consistent across platforms for the disease state samples. This highlights the need to validate multiplex assays and understand how the data correlate with standard ELISA results.
Having a wide quantitation range is an advantage of the multiplex platforms. The quantitation range of the platforms impacts sample analysis both in terms of LLOQ and in the necessity to repeat those samples that fall beyond the platform's ULOQ. The quantitation range of the MSD platform overall was broader than that for the other two platforms based on calibration curve. However, the MSD platform used undiluted samples for analysis, while the Pierce platform required that the samples be diluted 1:5 prior to testing. Assays to determine the true sensitivity of the platforms in serum showed that the sensitivities of the platforms were similar, although MSD still had a broader dynamic range with ULOQs well above that for the Pierce or the single-analyte ELISAs.
The quantitation assigned to the calibration curve will affect the relative quantity of cytokine detected. The VEGF analysis of ulcerative colitis and RA samples demonstrated this. The three platforms showed the same pattern of detection across samples, but the concentration of the analyte detected showed a consistent bias. The MSD recovery was slightly higher than that with the Pierce and R&D concentrations. This variation was not unexpected across platforms, and the relative difference would not affect the interpretation of results. According to the package inserts accompanying each assay, the three manufacturers used different methods of quantitation of the calibration curves. R&D Systems used in-house, purified recombinant proteins, while MSD and Pierce used vendor-supplied purified recombinant proteins.
The source of variation across platforms has been attributed to matrix effects (6), antibody cross-reactivity with other cytokines (1), the accuracy of the quantitation of the calibration curve (9), the source of the antibodies used for capture and detection (2), and the use of serum or plasma for sample collection (19). Matrix effects were shown in this study to have an effect upon the recovery of spiked cytokine in healthy donor samples and were corrected by modifying the sample diluent. However, analysis of disease samples with the modified diluent showed that the accuracy of detection was not as affected by use of the modified diluent. In the healthy donor serum, the unspiked samples had analyte concentrations near the LLOQ for both of the multiplex platforms.
Antibody cross-reactivity with similar cytokines is a potential source of variation as well. However, the package inserts and review of the cross-reactivity data with the manufacturers showed cross-reactivity of the cytokine detection in the products to be well assessed and controlled.
Another significant source of assay variation across platforms is the antibodies used for the capture and detection of antigen (6, 16). The multiplex manufacturers used a mix of in-house sources and external vendors for their antibody pairs, the source of which is held as proprietary by the manufacturer. Should the antibodies recognize the same epitopes on the target protein, then the platforms should give similar results. This is likely to be the case in the VEGF, MIP-1β, and MCP-1 assays. The remaining five antibodies in the platforms probably do not recognize the same epitopes. As an example, the IL-12p40 detection varies so significantly across platforms that the capture/detection sites of the antibodies are very likely to be distinct epitopic sites or possibly on fragmented or precursor forms of the cytokine (2).
It is known that the sample source can affect results. For example the use of plasma or serum can affect cytokine detection (19). In single ELISA, the prognostic ability of VEGF concentrations was greater in serum than it was in plasma. Differences in the performance of the platforms with regard to sample matrix are an important consideration in choosing a platform but were beyond the scope of this study, which focused on human serum analyses.
Heterophilic antibodies can be found in chronic inflammatory conditions such as RA. These antibodies can produce false-positive results or interfere in detection when serum is being analyzed by antigen-capture ELISA methods (4, 8, 12). The variable response seen in the cytokine detection in some of the disease samples could be due to the presence of heterophilic antibodies. Methods to reduce the nonspecific binding of these antibodies are recommended when testing disease samples with poor spike recovery on multiplex platforms. The preincubation of serum with mouse antibody or the depletion of heterophilic antibodies with protein L (4) has been shown to be effective.
In a comparison of multiplex bead arrays Khan et al. (9) found that although the cytokine levels follow similar patterns, the absolute levels of the cytokines measured varied by manufacturer. It was suggested that the quantitative values obtained from within a specific platform were reproducible but that across platforms there was enough variation that comparison of results would be difficult.
Urbanowska et al. (18) developed a plate-based multiplex consisting of six cytokines. The development of the assay included measures of the accuracy and precision and the LLOQ and ULOQ and a comparison with single ELISA technology. The correlation between multiplex and single ELISA was found to be good, with the correlation coefficients above 0.9 for all but one of the cytokines. Pooled serum was used for the development work, which tends to give more consistent results than does unpooled serum but is not reflective of the intended use of the assay for individual serum analyses.
We have found in this study that the solid-phase multiplex assays can perform reliably within a platform. However, certain steps must be taken when using these assays to obtain optimal data. It is important to work closely with the manufacturer of the platform chosen for the work. The manufacturers should, prior to supplying the multiplex array, test the possible combinations of antibodies on their array. This will reduce the incidence of cross-reactions and will combine analytes that require similar serum dilutions to be placed upon the same array.
The multiplex array should be validated in-house prior to study use. Additional validation steps should include spike recovery, dilutional linearity, stability of samples, the inter- and intraobserver variability, and measurement of the endogenous analyte. While assay validation is a multistep procedure, the recovery of spiked sample should be within predetermined ranges, typically within 100% ± 30% of the expected value. Pooled samples typically give better recovery than single samples. However, while pooled serum is useful for certain validation procedures, using pooled samples can lead to erroneous conclusions regarding the recovery of spiked antigen. It is important to understand the individual variation in recovery in normal sera as well as in available sera from the patient population(s) of interest. Through the use of single samples, we found that the recovery of antigen could be significantly affected due to inherent variability between subjects and that this could be improved by modifying the sample diluent.
The use of multiplex platforms for sample analysis has been increasing. The advantages of multiplex analysis, such as small sample volume, time savings, and the ability to simultaneously obtain data from a large number of cytokines, have been a great advancement in immunoassays. Due to the differences in the detection of cytokines across different platforms, a careful examination of the platform assay performance must be made prior to comparing results across platforms. While some cytokines will give similar patterns of results across platforms, others will be highly variable. Therefore, the use of the same platform across a study should be considered. While the assay results may be biased compared with other platforms, internally the results should be consistent. As the use of these assays increases and the volume of data in serum and plasma increases, the interpretation of data across platforms will be important and as such looking at relative change rather than absolute quantitation may be necessary. The expression of results as the percent change from a baseline level may be required for reliable interpretation.
Published ahead of print on 14 November 2007. ![]()
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»