![[Feedback]](/icons/banner/feedbackACT.gif){kind=icon}
![[For Subscribers]](/icons/banner/subscriberACT.gif){kind=icon}
![[Archive]](/icons/banner/archiveACT.gif){kind=icon}
![[Search]](/icons/banner/searchACT.gif){kind=icon}
![[Contents]](/icons/banner/tocACT.gif){kind=icon}
Previous Article | Next Article 
Clinical and Diagnostic Laboratory Immunology, May 2004, p. 615-617, Vol. 11, No. 3
1071-412X/04/$08.00+0 DOI: 10.1128/CDLI.11.3.615-617.2004
Copyright © 2004, American Society for Microbiology. All Rights Reserved.
Department of Epidemiology, University of Washington,1 Division of Public Health Sciences, Fred Hutchinson Cancer Research Center,2 Center for Health Studies, Group Health Cooperative, Seattle, Washington,3 Division of Infectious Diseases, Johns Hopkins University, Baltimore, Maryland4
Received 17 September 2003/ Returned for modification 29 October 2003/ Accepted 23 January 2004
 |
ABSTRACT |
|---|
 Top Abstract TextReferences |
|---|
16 versus <16) were 0.39 for IgA and 0.53 for IgG. Measurement error likely attenuates C. pneumoniae-disease associations; the magnitude of attenuation can be estimated from results of studies such as this one. |
TEXT |
|---|
|
TopAbstractTextReferences |
|---|
We are investigating the relationship between C. pneumoniae IgA titers of 16 and subsequent lung cancer risk. Circumstances required us to switch laboratories after about 40% of the samples had been assayed. We chose to redo all of the assays at the second laboratory, providing us with the opportunity to assess the reliability of IgA and IgG antibody titers at two laboratories.
We selected 392 serum samples from participants in a randomized trial designed to study the effectiveness of supplemental beta-carotene and retinyl palmitate in preventing lung cancer incidence and mortality (10). Participants in the parent study ranged in age from 50 to 74 years at entry and were current or former smokers (women and men), persons with significant occupational exposure to asbestos (men only), or both. Sixty percent of reliability study participants were male, and the mean age was 58.5 years; 72% were current smokers, and the median pack-years among current and former smokers was 43. Informed consent was obtained from patients, and human experimentation guidelines of the U.S. Department of Health and Human Services and/or those of the authors' institutions were followed in the conduct of the clinical research.
MIF tests to detect C. pneumoniae-specific IgA and IgG antibodies were conducted at two academic laboratories, A and B, that are leaders in the development and implementation of the MIF test. The MIF test is an indirect fluorescent antibody test that measures antibodies to epitopes in the cell wall of C. pneumoniae elementary bodies, and it is described in detail elsewhere (11). Antigens used in both laboratories were obtained from Washington Research Foundation. Titers are expressed as reciprocals of serum dilutions. Samples were tested in serial twofold dilutions, from 8 or 16 (varying by laboratory) to 1,024. For consistency, titers of 8 were categorized as <16, because we assumed that samples with antibodies measured at 8 (but not 16) would be categorized as <16 at the other laboratory. Titers of 16 or greater were considered seropositive. A positive reaction required typical fluorescence associated with evenly distributed Chlamydia organisms. A single technician from each laboratory tested all samples at that laboratory and was blinded to the results from the other laboratory. Positive and negative controls were included in all test series. Ten percent of samples were retested at laboratory B; 90% were found to be within one dilution of the first test.
We calculated percent agreement that was exact or within a twofold dilution (e.g., titer values of 32 and 128 would be considered within a twofold dilution of 64), in order to be compatible with the results from other studies (2, 7, 8). To evaluate the amount of agreement observed beyond that expected by chance, we also calculated the weighted kappa statistic, with 95% confidence intervals (1). Kappa equals one when there is exact agreement for the two measures for all subjects. Weighted kappa gives a higher reliability, i.e., "partial credit," to titers that are close. Since we planned to analyze our data as a dichotomous variable (16 versus <16), we calculated kappa using these categories as well.
While laboratory B was more likely to detect IgA antibody titers of 16 (45% versus 24% at laboratory A), laboratory A was more likely to detect IgG antibody titers of 16 (77% versus 59% at laboratory B) (Fig. 1). Kappas were higher for IgG than IgA and for the categorical measures than the dichotomous measures (Table 1). Specifically, kappas for the dichotomous measures were 0.39 for IgA antibodies and 0.53 for IgG antibodies.
|
|
We are unable to explain the reason for the differences in the results from the two laboratories. Both technicians had participated in the same training workshop. The reagents and antigens were of the same type and purchased from the same supplier. However, a noted limitation of the MIF test is that it is difficult to perform, and reading of slides is subjective. Regardless, in the absence of a gold standard, it is not possible to adjudicate differing results. Thus, we assumed that both laboratories measured C. pneumoniae-specific antibodies with equivalent error. Because laboratories A and B are leaders in the conduct of the MIF assay, we anticipate the kappa between them is higher than it would be between less-experienced laboratories.
Only one other interlaboratory reliability study of C. pneumoniae-specific titers using MIF testing has been published (8). The investigators of that study focused on the reliability of detecting stable low IgG antibody titers and IgM antibodies in a single sample or fourfold changes in IgG antibody titers in paired samples. Each of 14 participating laboratories analyzed up to 10 serum sets, where each set included two or three samples from the same individual at different times (8). The overall percent agreement, defined as differing by less than a twofold dilution with the reference titers, was 80%. However, because expected agreement might also be high, percent agreement alone may present an overly optimistic picture of the reliability between laboratories. Suppose, for example, that one laboratory classified 75% of samples as positive and 25% as negative, but a second laboratory, which had problems with reagents, called all samples positive. The agreement would be 75%, which does not reflect the poor reliability of the measure. Observed agreement for IgA in our study was nearly as high (75%) yet kappa was 0.50, indicating only 50% agreement beyond that expected by chance alone (6).
Strengths of our study include its size, examination of the reliability of IgA antibody titers, and inclusion of laboratories that conduct MIF tests frequently. Limitations include the use of only two laboratories and the fact that we assessed reliability, when ideally we would have assessed validity (i.e., the ability of a test to measure the true exposure of interest). Regardless, a measure which lacks reliability also must lack validity, and information on reliability can be used to determine attenuation of measures of association in epidemiologic studies. For example, if the true relative risk (RR) for the association between lung cancer and C. pneumoniae-specific antibody titers of 16 was 2.5, reliability of the magnitude observed in this study (kappa = 0.39) would result in an attenuated RR of at most 2.50.39, or an RR equal to or less than 1.8 (9).
In conclusion, we found sufficient lack of reliability of IgA and IgG titer levels from MIF tests to obscure moderate epidemiologic associations. Inconsistent results or false null findings of C. pneumoniae-disease relations may be explained in part by errors in measuring antibody titers from MIF testing. Further research to develop reliable and accurate measures of infection is warranted. Development of accurate commercial kits or additional technician training and calibration of slide reading may help to standardize MIF tests. Furthermore, automated techniques, which will eliminate the subjective reading of test results, may also provide an important improvement.
|
ACKNOWLEDGMENTS |
|---|
We thank the laboratory technicians, especially Billie Jo Wood, Jeff Holden, and Elsie Lee, whose efforts made this study possible. Cim Edelstein, Matt Barnett, Stacy Cannon, Paula Filipcic, Grace Powell, and Marty Stiller provided administrative and technical support.
We have no commercial or other association that might pose a conflict of interest (e.g., pharmaceutical stock ownership or consultancy).
|
FOOTNOTES |
|---|
|
REFERENCES |
|---|
|
TopAbstractTextReferences |
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Antimicrob. Agents Chemother. | Clin. Microbiol. Rev. | Infect. Immun. |
|---|---|---|
| J. Clin. Microbiol. | J. Virol. | ALL ASM JOURNALS |
