Previous Article | Next Article ![]()
Clinical and Vaccine Immunology, January 2006, p. 53-58, Vol. 13, No. 1
1071-412X/06/$08.00+0 doi:10.1128/CVI.13.1.53-58.2006
Copyright © 2006, American Society for Microbiology. All Rights Reserved.
Department of Family and Community Medicine, The University of Texas Health Science Center, Houston, Texas,1 Division of Environmental and Occupational Health, The University of Texas School of Public Health, Houston, Texas,2 Center for Human Bacterial Pathogenesis Research, Department of Pathology, Baylor College of Medicine, Houston, Texas,3 Department of Medicine, Baylor College of Medicine, Houston, Texas4
Received 8 September 2005/ Returned for modification 20 October 2005/ Accepted 1 November 2005
| ABSTRACT |
|---|
|
|
|---|
) assay. LTBI prevalence was 9.0 and 5.4% as determined by TST and IFN-
assay, respectively. Overall, agreement between test results was 90% (
= 0.25). Positive TST results were significantly associated with increased age (odds ratio [OR], 1.04; 95% confidence interval [CI], 1.01 to 1.08), African-American ethnicity (OR, 4.97; 95% CI, 1.58 to 15.68), foreign birth (OR, 20.20; 95% CI, 4.21 to 97.02) and prior incarceration (OR, 6.19; 95% CI, 1.48 to 25.95). Positive IFN-
assay results were significantly associated with African-American ethnicity (OR, 5.58; 95% CI, 1.16 to 26.74). Factors associated with statistically significant discordance between TST and IFN-
assay results were African-American ethnicity (OR, 0.29; 95% CI, 0.11 to 0.77), foreign birth (OR, 0.23; 95% CI, 0.07-0.80), and prior incarceration (OR, 0.06; 95% CI, 0.01-0.50). Among subjects born in the United States, African-American ethnicity was the only variable significantly associated with positive test results for both TST (OR, 4.26; 95% CI, 1.38 to 13.16) and IFN-
assay (OR, 5.74; 95% CI, 1.19 to 27.75) and remained associated with statistically significant discordance between TST and IFN-
assay results. The reactivity of the new IFN-
assay is unaffected by prior BCG vaccination or serial TSTs but may be diminished in African-Americans. Future longitudinal studies are needed to assess the sensitivity and specificity of this new assay in detecting LTBI. | INTRODUCTION |
|---|
|
|
|---|
Screening for persons at risk for latent tuberculosis infection (LTBI) is an essential step in a comprehensive approach to TB control and elimination (2, 18). The tuberculin skin test (TST) is currently the standard method of screening for LTBI in the United States despite its limitations, including the need for at least two patient contacts, uncertainty about the immune status of the person tested, false-positive results because of cross-reactivity with BCG vaccine and mycobacteria other than M. tuberculosis (MOTT), and errors related to subjectivity and technical difficulties in administering the test or reading the results (1, 3, 12, 21).
A new whole-blood interferon-gamma (IFN-
) assay has been approved by the U.S. Food and Drug Administration for the detection of LTBI and is commercially available as QuantiFERON-TB-GOLD (37). This assay detects in vitro cell-mediated immune responses to TB infection by quantifying the amount of the IFN-
that is released in the plasma of whole blood incubated overnight with mixtures of overlapping peptides spanning the sequence of the early-secreted antigenic target 6-kDa protein (ESAT-6) and culture filtrate protein 10 (CFP-10) (QuantiFERON-TB-GOLD; Cellestis Ltd., Carnegie, Victoria, Australia). These antigens are the products of a genomic region (RD1) that is present in all M. tuberculosis and pathogenic M. bovis strains but absent in all BCG vaccine strains and nearly all MOTT (6, 25). Consequently, IFN-
assays utilizing ESAT-6 and CFP-10 either as recombinant antigens (5, 7, 38) or mixtures of overlapping peptides (8, 27, 37) have been shown to be significantly more specific than TST. In addition, these assays offer several advantages over TST, including the need for only a single patient contact, simultaneous measurement of a subject's immune reactivity to mitogen (phytohemagglutinin) and nil control (normal saline) antigens, elimination of subjectivity in administering the test or reading the result, and the availability of test results within 24 h. IFN-
assays utilizing ESAT-6 and CFP-10 antigens have been studied in the general population in several countries including India, Korea, Italy, Denmark, The Netherlands, and Japan (5, 7, 8, 15, 23, 27, 29, 30, 38). To date, there are no published reports on comparison of TST to the newly approved IFN-
assay in studies within the United States. The purpose of this cross-sectional study was to evaluate the performance of IFN-
assay compared to TST for tuberculosis screening in a moderate-risk population in the United States.
| MATERIALS AND METHODS |
|---|
|
|
|---|
assay to TST for tuberculosis screening. The institutional Committee for the Protection of Human Subjects approved the research protocol for the present study. All inmates gave written informed consent.
Study site and selection criteria.
Adult inmates (
18 years of age) at the Harris County Jail (HCJ) in Houston, Texas were invited to participate in the present study during the months of June and July of 2004. Subjects with known history of LTBI (prior positive TST) or current tuberculosis disease and those on chronic immunosuppressive therapies (corticosteroids, chemotherapy, etc.) were excluded from the present study. All subjects were tested for human immunodeficiency virus infection.
Procedures.
After we obtained informed consent and authorization for the release of protected health information from each subject, sociodemographic data, past medical history (including history of BCG vaccination), and prior TB exposure information were obtained. A total of 10 ml of blood was then collected from each subject by venipuncture. No personal identifiers or clinical histories were available to laboratory personnel. IFN-
assay testing was initiated within 12 h and in accordance with the manufacturer's recommendations (Quanti- FERON-TB-GOLD; Cellestis, Ltd.). Briefly, blood samples were incubated with the stimulating antigens as part of the first stage of the IFN-
assay. Plasma samples were harvested after 16 to 24 h of incubation, and the amount of IFN-
was quantified by enzyme-linked immunoassay (ELISA) method. Raw optical densities were measured by using Molecular Devices' SpectraMax M2 (Sunnyvale, CA), and data from the ELISA reader were interpreted by using assay specific software provided by Cellestis, Inc. (Valencia, CA). IFN-
assay results were interpreted as described in the Product Package Insert (QuantiFERON-TB-GOLD; Cellestis, Ltd.).
After the blood samples for the IFN-
assay were collected, trained nursing staff at the HCJ administered the TST (one-step method) according to the guidelines established by the Centers for Disease Control and Prevention (1). Briefly, 0.1 ml of the tuberculin PPD (TUBERSOL; Aventis Pasteur Ltd., Toronto, Ontario, Canada) containing five tuberculin units was injected intradermally on the volar surface of inmates' forearms. After 48 to 72 h, the diameter of the area of induration around the injection site was measured across the forearm and was reported in millimeters. Reactions of
10 mm were considered positive. Treatment for LTBI among the study subjects was based solely on the TST results.
Statistical analysis.
The primary outcome of the present study was the difference in the prevalence of LTBI according to TST and IFN-
assay as indicated by the frequency of positive results for each test. We then assessed the level of concordance between TST and IFN-
assay results. Concordance was calculated as the overall percent agreement between the results of the two assays using 2x2 contingency tables. The strength of this agreement was examined by using Cohen's kappa (
) with
values of >0.75 representing excellent agreement beyond chance, 0.40 to 0.75 representing fair to good agreement beyond chance, and <0.40 representing poor agreement beyond chance (16).
Multivariable logistic regression models were used to identify variables significantly associated with positive results for each assay and those variables associated with discordance between assay results.
The independent variables included in the multiple logistic regression models were gender, age (as a continuous variable), ethnicity, birth country, prior incarceration, close contact with a TB case, and living in a shelter which included housing in congregate settings such as drug rehab units, "bunk houses," nursing homes, etc. All statistical analyses were conducted by using SAS statistical software (version 9.1; SAS, Inc., Cary, NC).
| RESULTS |
|---|
|
|
|---|
assay results. Only three subjects (0.6%) tested positive for HIV infection. These subjects were not included in the final analysis in order to maintain the homogeneity of data. Concomitant TST and IFN-
assay results were available for 409 subjects. The average age of the subjects in years was 31.0 (median, 29.0 years). Subjects were predominantly male, African-American, born in the United States, and had a history of prior incarceration (Table 1).
|
assay (Table 2). The concordance between the TST and IFN-
assay results in the present study was 90.0% (95% confidence interval [CI], 87.1 to 93.0%) with a
value of 0.25 (95% CI, 0.10 to 0.41) (Table 2). Variables that were significantly associated with discordance between TST and IFN-
assay results were African-American ethnicity (odds ratio [OR], 0.29; 95% CI, 0.11 to 0.77), foreign birth (OR, 0.23; 95% CI, 0.07 to 0.80), and prior incarceration (OR, 0.06; 95% CI, 0.01 to 0.50) (Table 1). In other words, subjects with discordant TST and IFN-
assay results were 3.4 times more likely to be African-American, 4.3 times more likely to be foreign-born, and 16.7 times more likely to have a history of prior incarceration.
|
assay negative than TST negative, IFN-
assay positive.
|
assay, only African-American ethnicity (OR, 5.58; 95% CI, 1.16 to 26.74) was significantly associated with positive test results (Table 4).
|
assay, respectively) and the only variable associated with statistically significant discordance between TST and IFN-
assay results (OR, 0.28; 95% CI, 0.11 to 0.75). | DISCUSSION |
|---|
|
|
|---|
assay, respectively. This is consistent with the <10% LTBI prevalence among the population of U.S. City and County Jail Systems according to a recent joint National Institute of Justice/CDC survey (19). This is also consistent with the 3.3 to 10% monthly rates of positive TSTs at the HCJ over the past several years (unpublished data).
The overall agreement between TST and IFN-
assay was high at 90% with a low
value of 0.25 (Table 1). Our results with an overall high percent agreement between TST and IFN-
assay with low
are consistent with and support the findings by other studies that have reported overall agreements of 81.4 to 95.0% with
values of 0.08 to 0.87 (8, 23, 29, 30).
Kappa statistics have been accepted and widely used as a test of interobserver agreement (16). When one is assessing variation between assays or interobserver variation, kappa statistics not only present the level of agreement but also make adjustments for the amount of agreement that can be expected by chance alone ("proportion of chance agreement") (14). A seldom-mentioned but frequently encountered problem in using kappa as a measure of the strength of agreement between assays or observers is the dependence of kappa on the underlying population prevalence of a measured outcome. Thus, even when different studies reach the same high percentage of agreement, the strength of their agreement can range from poor to substantial because of a difference in prevalence of themeasured outcome (33, 36). As a result, kappa statistics are seldom comparable across studies or populations (14, 35). Because of this limitation, the kappa statistics cannot stand alone as a simple measure of assay variation in the present study.
Compared to the general public, inmates of correctional facilities have been recognized as having a disproportionately higher number of personal risk factors for TB (19). In our subjects, only African-American ethnicity was significantly associated with positive IFN-
assay results (Table 4). Older age, African-American ethnicity, foreign birth, and prior incarceration were significantly associated with positive TST results (Table 4). African-American ethnicity, foreign birth, and prior incarceration were also significantly associated with discordance between the TST and IFN-
assay results.
Although older age had a significant association with increased frequency of positive results for TST and not the IFN-
assay, this effect was very small (OR = 1.04). In addition, older age was not significantly associated with increased discordance between the results of these assays. Therefore, any clinical significance of the observed difference between these assays related to older age is unclear and may simply relate to our sample size.
All foreign-born subjects in the present study were from member countries of the World Health Organization's Expanded Program on Immunization, where BCG vaccine is routinely offered shortly after birth and again in early childhood and adolescence (40). These countries were Mexico, Jamaica, Nicaragua, Ecuador, El Salvador, Honduras, The Philippines, and Brazil (40). Studies have shown that self-reporting of BCG vaccination or even checking for BCG vaccination scars are poor indicators of the BCG vaccination status of individuals. People who have been given other vaccinations but not BCG may mistakenly report that they have had the BCG vaccine. People who have had BCG in infancy may not be aware of it. People who have had a previous skin test may have assumed that it was a "TB vaccination" and mistakenly report that they have had the BCG vaccine (28). In addition, while most BCG injection sites heal within 6 to 12 weeks leaving a scar, some persons who have been vaccinated with the BCG vaccine do not develop a scar and, in many individuals, the scar becomes less obvious with age (28). For these reasons, foreign birth in the present study was considered a more accurate albeit imperfect estimate of the BCG vaccination status among our subjects and therefore a possible source of false-positive TST results. This was supported by our finding of only 8.9% discordant results in the United States-born subjects compared to 21% discordant results among the foreign-born subjects (Table 3). In addition, while the difference in the ratio of United Sates-born subjects with positive TST, negative IFN-
assay results versus those with negative TST, positive IFN-
assay results was minimal (5.7% versus 3.2%), the ratio of foreign-born subjects with positive TST, negative IFN-
assay results was six times that of subjects with negative TST, positive IFN-
assay results (18% versus 2.6%) (Table 3). Even more significantly, when foreign-birth (as an index of BCG vaccination) was excluded from our logistical regression models (n = 39), African-American ethnicity became the only variable significantly associated with positive test results for both TST and IFN-
assay.
A competing interpretation of the above findings in our foreign-born subjects could be that the IFN-
assay is less sensitive than TST. Foreign-born subjects in the present study were from countries with TB prevalence of 25 to 300 per 100,000 population compared to a TB prevalence of less than 10 per 100,000 population in the United States (4). This interpretation, however, would be in contrast to data showing that the sensitivity of IFN-
assay has been directly estimated in patients with known TB disease (27). A more likely explanation of the apparent underestimation of LTBI by the IFN-
assay among the foreign-born subjects in the present study is the distinct immunological mechanisms that are responsible for positive results in either the TST or the IFN-
assay. Although positive TST results are primarily medicated by the actions of memory T cells, positive IFN-
assay results are mainly due to the presence of effector T cells (23, 39). Upon an initial exposure to the tubercle bacilli, effector T cells are formed to kill the bacilli. If successful, the effector T cells soon clear from the circulation after a small subset of them are programmed to become memory T cells. Memory T cells, in contrast, live a long life and patrol the body in small numbers only to become activated again upon re-encountering antigenic stimuli of the pathogen. Thus, a positive IFN-
assay result indicates a more recent or an ongoing TB infection, whereas a positive TST result indicates a remote TB infection. In our foreign-born subjects with TST-positive, IFN-
-negative assay results, the discordant results may then primarily point to these subjects' remote tuberculosis exposure in their home countries.
Because inmates at HCJ undergo repeat tuberculin skin testing each time they are incarcerated more than 90 days after their last release, multiple incarcerations, while a moderate risk factor for TB infection, can also lead to a misleading increase in the frequency of positive TST results. This is because of the "booster" response of repeat TSTs within 1 year after an initially negative TST (26). This can be due to either false-positive TST results because of remote exposure to atypical mycobacteria, BCG vaccination, hypersensitivity to PPD antigens or remote TB infections. This is consistent with our findings of only one subject with discordant TST and IFN-
assay results among subjects with no prior incarceration history versus 40 subjects with discordant TST and IFN-
assay results among subjects with multiple prior incarcerations (Table 3).
Our finding that among United States-born subjects, African-American ethnicity is the only variable associated with statistically significant discordance between TST and IFN-
assay results has not been previously reported. Our subjects with African-American ethnicity were significantly more likely to be TST positive, IFN-
assay negative than TST negative, IFN-
assay positive, adjusting for all other TB risk factors previously mentioned. This observation is consistent with the finding by Hill and coworkers that among a group of close TB contacts in Gambia, enzyme-linked immunospot assay utilizing ESAT-6 and CFP-10 antigens was less sensitive than TST for the diagnosis of tuberculosis infection (20). This phenomenon may be related to differences in the expression of major histocompatibility complexes in persons of African ancestry, making the ESAT-6 and CFP-10 antigens less likely to be recognized by this population. This hypothesis needs further investigation in future studies.
Weaknesses of the present study include the cross-sectional study design, the relatively small sample size, and the use of a convenience sampling scheme. In addition, the present study suffers from the same major weakness of all studies investigating new diagnostic assays for tuberculosis infection, namely, the lack of a true "gold standard" test, which limits our ability to make unequivocal assessments of the sensitivity and specificity of the new assays. In the face of our inability to follow individuals at risk for developing tuberculosis, because of the cost and the ethical issues of not treating LTBI suspects, we are left with the option of comparing the new assays to TST in order to determine which assay agrees most with the likelihood of true tuberculosis infection based on the clinical and epidemiological characteristics of individuals.
In summary, our study showed that the new MTB-specific IFN-
assay was unaffected by prior BCG vaccination or serial TSTs but that it may be less sensitive than TST in African-Americans. The improved specificity of the new MTB specific IFN-
assay is particularly important in individuals with multiple risk factors for TB who are also at increased risk of false-positive screening results due to prior BCG vaccinations and serial TSTs such as the correctional facility inmates and health care workers. Future prospective studies are required to determine the sensitivity and specificity of the new generation of tuberculosis screening assays and the potential costs and benefits associated with replacing the TST.
| ACKNOWLEDGMENTS |
|---|
We thank Jeffery Baker, Allison Boyle, and Michelle Chong for their invaluable contribution to this effort.
| FOOTNOTES |
|---|
| REFERENCES |
|---|
|
|
|---|
test for tuberculosis diagnosis based on PPD or the specific antigen ESAT-6 and CFP-10. Int. J. Tuberc. Lung Dis. 5:462-467.[Medline]
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Antimicrob. Agents Chemother. | Clin. Microbiol. Rev. | Infect. Immun. |
|---|---|---|
| J. Clin. Microbiol. | J. Virol. | ALL ASM JOURNALS |