Previous Article | Next Article ![]()
Clinical and Vaccine Immunology, October 2007, p. 1349-1355, Vol. 14, No. 10
1071-412X/07/$08.00+0 doi:10.1128/CVI.00214-07
Copyright © 2007, American Society for Microbiology. All Rights Reserved.

Enteric Virus Unit, Virus Reference Department, Centre for Infections, Health Protection Agency, 61 Colindale Ave., London NW9 5HT, United Kingdom,1 Laboratoire de Virologie, CHU du Brocage, 21034 Dijon Cedex, France,2 Dipartimento di Sanitá Alimentare e Animale, Instituto Superiore di Sanitá, V. le Regina Elena 299, 00161 Rome, Italy,3 Diagnostic Laboratory for Infectious Diseases and Perinatal Screening, National Institute for Public Health and the Environment, Antonie van Leeuwenhoeklaan 9, P.O. Box 1, 3720BA Bilthoven, The Netherlands,4 Centro Nacional de Microbiologia Instituto de Salud Carlos III, Madrid, Spain,5 Department for Molecular Epidemiology of Viral Pathogens, Robert Koch-Institut, Berlin, Germany6
Received 22 May 2007/ Returned for modification 16 July 2007/ Accepted 15 August 2007
|
|
|---|
|
|
|---|
Reverse transcription-PCR (RT-PCR) testing is used to identify NoV outbreaks and is now regarded as the "gold standard" (6, 10). However, the genetic diversity of NoVs makes it difficult to design oligonucleotide primers capable of allowing the amplification of sequences from all genotypes in a single assay. Although RT-PCR increases the sensitivity of detection, it may be compromised by the lability of single-stranded viral RNA and difficulties in extracting RNA from fecal samples. Also, the exquisite sensitivity offered by RT-PCR allows the detection of virus in samples from asymptomatic patients and in samples from symptomatic patients whose symptoms are associated with another, coinfecting enteric pathogen.
Antigen detection enzyme immunoassays (EIAs), based on the use of hyperimmune antisera raised against recombinant NoV capsids, are predominantly type specific and may detect only strains of the same or genetically similar genotypes (12). The production of monoclonal antibodies to recombinant NoV capsid proteins (1, 11) allows the construction of a multivalent antibody panel with wide-ranging reactivities capable of detecting a broad range of NoV genotypes within the two NoV genogroups.
Evaluations of three commercially available EIAs [SRSV(II)-AD (Denka Seiken, Chuo-Ku, Japan), IDEIA Norovirus (Dako, Ely, United Kingdom), and RIDASCREEN Norovirus (R-BioPharm, Darmstadt, Germany)] for the detection of NoV antigen have been conducted previously in a number of countries, and several reports have been published (2-5, 17-19). These published evaluations are based on the results of testing 244, 137, 158, 479, 52, 130, and 130 clinical samples, respectively, and give widely varying sensitivities and specificities ranging from <30 to >70% and 69.0 to 100%, respectively. Further unpublished studies undertaken in several European countries have provided equally conflicting results, with calculated sensitivities and specificities ranging from 40 to 92.7% and 40.9 to 97.6%, respectively (personal communication).
These data are difficult to reconcile, as the results of the evaluations may have been affected by several factors, including the diversity of genotypes examined, variable sensitivities of the RT-PCR assays used as the gold standard, sample storage conditions, the numbers of fecal samples examined, and the methods of preanalytical preparation of the samples in each evaluation. Also, newer versions of these kits, for which the manufacturers claim increased sensitivity and specificity, have become available.
A multicenter European evaluation of the IDEIA Norovirus (version 2; Dako, Ely, United Kingdom) and RIDASCREEN Norovirus (R-BioPharm, Darmstadt, Germany) EIAs was undertaken, and samples well characterized as positive or negative for NoV by RT-PCR were analyzed. Discrepant results were resolved through repeat PCR and EIA testing.
|
|
|---|
Evaluation sites. The multicenter evaluation included laboratories in the United Kingdom, France, Spain, Germany, Italy, and The Netherlands. All participating laboratory personnel had experience performing RT-PCRs for the detection of NoV RNA, and training to familiarize the operators with the EIA methods was provided by the manufacturers. The multicenter evaluation allowed the examination of more samples within a specified time frame and the inclusion of a more diverse range of NoV genotypes than a single-center study.
Samples. A total of 2,254 fecal specimens collected during the 2004-to-2005 and 2005-to-2006 NoV seasons from patients with symptoms of gastroenteritis were included in the evaluation. Samples from a total of 273 outbreaks with various sample group sizes, from 2 to >7 samples per outbreak; 509 samples from which the NoV strains had been characterized by genotyping; 274 samples collected in sporadic cases of gastroenteritis; and 144 samples in which another enteric pathogen had been identified were included in the study (Table 1).
|
View this table: [in a new window] |
TABLE 1. Fecal samples used in the evaluation
|
NoV antigen detection EIAs. The IDEIA Norovirus (Dako) and RIDASCREEN Norovirus (R-BioPharm) EIAs were evaluated against the screening RT-PCR assays currently used in each laboratory (Table 2). EIAs were performed according to the manufacturers instructions, and RT-PCR assays were performed according to validated laboratory standard operating procedures. All tests were performed with the following manufacturers lots: IDEIA Norovirus, lot number X025091, and RIDASCREEN, lot number 05245. It should be noted that the IDEIA Norovirus assay used in this evaluation is an update of the previous commercial assay version and that all studies published before the present study report on the earlier version. The latest version of the IDEIA Norovirus assay is a single-plate assay with microwells coated with monoclonal antibodies to both GI and GII NoV strains.
|
View this table: [in a new window] |
TABLE 2. Oligonucleotide primers for the PCR assays used in the evaluationa
|
Statistical analysis. The sensitivity and specificity of each EIA was determined by comparison with the results of RT-PCR, and 95% confidence intervals (CI) were calculated (www.healthstrategy.com/epiperl/epiperl.htm). The ability of each EIA to detect a range of genotypes was determined by calculating the percentage of strains of each genotype detected and the 95% CI. Significant differences were confirmed by calculating P values using the chi-square test (www.graphpad.com/quickcalcs/contingency1.cfm).
|
|
|---|
The sensitivity and specificity of the IDEIA Norovirus assay ranged from 44.63 to 75.86% and 88.05 to 98.01%, respectively, when the results were analyzed by country. Similarly, the sensitivity and specificity of the RIDASCREEN assay ranged from 36.33 to 69.54% and 83.33 to 99.20%, respectively (Table 3). The analysis of the total data set gave sensitivities for the IDEIA Norovirus and RIDASCREEN assays of 58.93 and 43.81%, respectively, and specificities of 93.91 and 96.37%, respectively (Table 3). Equivocal results were excluded from the analysis of sensitivity and specificity, but when they were included as representing either a positive or a negative result, no significant change was detected (data not shown).
|
View this table: [in a new window] |
TABLE 3. Sensitivities and specificities of the IDEIA Norovirus and RIDASCREEN Norovirus EIAs compared with RT-PCR
|
|
View this table: [in a new window] |
TABLE 4. Abilities of the IDEIA Norovirus and RIDASCREEN Norovirus EIAs to detect NoVs in RT-PCR-positive samples collected in sporadic cases and in two or more positive samples from outbreaks
|
The positive predictive values (PPVs) and the negative predictive values (NPVs) of the IDEIA Norovirus assay were 92.3 and 64.9%, respectively, when the results for individual samples were analyzed and 97.9 and 47.10%, respectively, when the results for outbreaks were analyzed (Table 5). Similarly, the PPVs and NPVs of the RIDASCREEN assay were 93.7 and 58.2%, respectively, for individual samples and 98.4 and 40.9%, respectively, for outbreaks.
|
View this table: [in a new window] |
TABLE 5. PPVs and NPVsa
|
|
View this table: [in a new window] |
TABLE 6. Detection of strains representative of NoV genotypes within GI, GII, and GIV
|
|
View this table: [in a new window] |
TABLE 7. Nonspecific reactivity detected with the EIAs and results of RT-PCR tests to confirm the presence of NoV
|
|
|
|---|
A study in which 50% of the fecal samples were positive and which was performed at more than one site (clustered study) would reach the 95% confidence level when >780 samples were tested. In this study, a sample size of >2,000 fecal samples was chosen to take into account not only the performance of testing at multiple sites but also the potential for multiple genotypes of the virus to be detected with different degrees of efficiency. This sample size and multicenter approach also allowed for comparisons among countries in which different mixes of virus genotypes may have been circulating and comparisons with the results of previous studies carried out in those countries.
Overall, the sensitivity of the IDEIA Norovirus assay was significantly higher than that of the RIDASCREEN Norovirus assay, and although a higher specificity was measured with the RIDASCREEN Norovirus assay in some countries, this difference was not statistically significant. The sensitivities of the IDEIA and RIDASCREEN Norovirus assays ranged from 44.63 to 75.86% and 36.33 to 69.54%, respectively, when the results were analyzed by country. The variation in the IDEIA Norovirus assay was characterized by the measurement of significantly lower sensitivities in Italy and the United Kingdom than in all the other countries and a significantly higher sensitivity in Spain than in France, Italy, and the United Kingdom. Similarly, the sensitivity of the RIDASCREEN Norovirus assay was significantly higher in Spain than in all other countries.
A comparison of data from previously published studies, unpublished data, and data from this study, analyzed using the same method, which takes into account the numbers of false-negative results (sensitivity) and false-positive results (specificity) and incorporates the 95% CI, is shown in Table 8. Significant differences in sensitivity were detected when the results of the published studies of the IDEIA Norovirus version 1 assay were analyzed (Table 8). Results of previous studies of the IDEIA Norovirus version 1 assay by Richards et al. and Dimitriadis et al. (4, 5, 18) were comparable and showed higher sensitivity than the results of studies by Rabenau et al., Burton-MacLeod et al., and de Bruin et al (2, 3, 17). The IDEIA Norovirus version 2 assay was significantly more sensitive than the version 1 assay in The Netherlands but was significantly less sensitive when tested in the United Kingdom. There was no statistically significant difference in the specificities of the two IDEIA Norovirus assays.
|
View this table: [in a new window] |
TABLE 8. Comparison of the results of this study with those from previously published and unpublished studiesa
|
The failure to detect NoVs in clinical samples is often associated with the wide genetic and antigenic diversity of NoV strains. The RIDASCREEN assay was statistically significantly less able to detect GI-2, GI-6, GII-1, GII-3, GII-7, and rGII strains than the IDEIA Norovirus assay (Table 6). The RIDASCREEN assay was unable to detect GI-4, GI-5, and GII-6 strains, and both assays failed to detect GI-7, GII-8, and GIV-1 strains, although the number of samples containing these genotypes was too small to reach statistical significance (Table 6). Also, among the genotypes detected, the IDEIA Norovirus assay was able to detect a higher proportion of the strains within a genotype than the RIDASCREEN assay (Table 6). Interestingly, this difference was less pronounced for GII-4 strains, which were detected by the IDEIA Norovirus assay and the RIDASCREEN Norovirus assay in 67.44 and 61.79% of the RT-PCR-positive GII-4 samples, respectively (Table 6). This finding would suggest that the RIDASCREEN assay has a higher sensitivity for GII-4 strains than for those of other genotypes. The analysis of the results for 299 GII-4 strains and 206 non-GII-4 strains indicated that the sensitivities of detection of GII-4 strains and non-GII-4 strains by the RIDASCREEN assay were significantly different (GII-4, 61.87% [95% CI, 56.25 to 67.19%]; non-GII-4, 34.47% [95% CI, 28.31 to 41.19%]) from the sensitivities of detection of these strains by the IDEIA Norovirus assay (GII-4, 67.57% [95% CI, 62.04 to 72.65%]; non-GII-4, 65.22% [95% CI, 58.51 to 71.37%]). This suggests that differences in sensitivity values obtained in different countries are likely to be associated with the mixes of genotypes included in the evaluation panels. It was not possible to have a set of standard methods for nucleic acid extraction, RT, and PCR used in all countries or source reagents from a single supplier, and for this reason it was decided that a second PCR amplifying another region of the NoV genome would be included in the protocol in order to mitigate the differences in sensitivity measurements associated with a single PCR. Also, the incorporation of a second PCR would mitigate differences in the efficiency of amplification of different genogroups and even genotypes. PCRs targeting the Orf1-Orf2 junction region and used in each of the countries were likely to amplify genogroups with the same efficiency, as genogroup-specific assays were used, and also genotypes as there is a high degree of conservation within this region among the genogroups.
The sensitivities of the IDEIA Norovirus and the RIDASCREEN assays for detecting NoV in samples collected in sporadic cases of gastroenteritis were 46.32 and 31.58%, respectively. The improvement in the ability of each of the assays to identify the cause of an outbreak when increased numbers of samples per outbreak were tested and the sensitivity and specificity results for samples collected in sporadic cases suggest that these assays are inappropriate for the detection of NoV in samples collected in sporadic cases of gastroenteritis.
It is clear from the results of this study and other published studies that both the IDEIA Norovirus and the RIDASCREEN assays have limitations when used to detect NoV in clinical samples. They should be regarded as screening assays which have the benefit of speed and, in many instances, can be performed closer to the patient or the site of the outbreak. The confidence provided by the detection of NoV antigen in multiple samples collected during an outbreak suggests that when a sufficient number of samples (six or more) were collected, these assays would be appropriate for use in the military, on cruise ships, and during institutional outbreaks in hospitals or nursing homes. Nevertheless, they should be used in conjunction with RT-PCR and proper referral patterns established in order to confirm positive findings and further test negative samples.
Published ahead of print on 22 August 2007. ![]()
|
|
|---|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»