Clinical and Vaccine Immunology, October 2007, p. 1389-1391, Vol. 14, No. 10
1071-412X/07/$08.00+0 doi:10.1128/CVI.00280-07
Copyright © 2007, American Society for Microbiology. All Rights Reserved.
| LETTERS TO THE EDITOR |
| LETTER |
|---|
|
|
|---|
We read with interest the study by the investigators at MiraVista Diagnostics (MVD) and MiraBella Technologies (4) evaluating the IMMY ALPHA histoplasma antigen enzyme immunoassay (EIA). Working together, IMMY and ARUP Laboratories developed this test, which has been used in production at ARUP daily since March 2006. Our experience (J.L.C. and E.R.A.) with this assay gives us insights that others may not have. We believe that the MVD study suffers from both technical and clinical flaws.
First, the assay results with control specimens reported by the MVD group are vastly different from those from our experience. In clinical specimens, our positivity rate is 2.9% (based on over 10,000 patient specimens tested), yet LeMonte et al. (4) reported that 16% of control specimens were positive by the IMMY assay. We suspect that lack of experience in using the IMMY reagents allowed the authors to accept technically flawed runs. At ARUP, the IMMY stock calibrator is diluted to make a working calibration set of 2, 10, 30, 100, 300, and 1,000 units. A typical absorbance for the 2.0-unit calibrator is 0.020 and is highly reproducible. The calibration absorbances are fitted to a four-parameter log-logit curve having typical R2 values of 0.998 to 1.000 (1a). Specimens are run in duplicate, and results must agree within 10%. Only specimens having an absorbance greater than the average 2.0-unit calibrator absorbance are considered positive.
Second, the values of the positive results in the LeMonte study appear to be overly rounded (e.g., four values at 2, seven values at 5, and two values at 10, etc., instead of 2.1, 2.5, 3.6, 4.8, 4.9, and 5.0, etc.). This observation and the figure in MVD's poster on this topic (4a) showing a very flat calibration curve lead us to conclude that the IMMY reagents may have been stored improperly or that the substrate color was not allowed to develop properly. Furthermore, IMMY has no records of MVD purchasing reagents, so reagent delivery may have been circuitous enough to compromise their stability. Thus, we suspect that the MVD laboratory used the IMMY reagents in a technically flawed fashion. We (J.L.C. and E.R.A.) would be pleased to test all of the MVD study specimens in the IMMY assay to help resolve the discrepancies. In addition, if MVD would allow ARUP to purchase the MVD reagents, we would be willing to perform the MVD EIA.
On the clinical side, MVD has used one immunoassay to define a true positive without the benefit of other supporting evidence (PCR, serology, or clinical condition and course). Only 22 of 50 cases were positive using the IMMY assay. The authors assumed that any sample that tested positive by their MVD EIA was definitively positive for histoplasmosis. However, the authors had previously reported that specimens from patients confirmed positive for coccidioidomycosis, blastomycosis, penicilliosis, aspergillosis, or paracoccidioidomycosis had tested positive for the histoplasma antigen using the MVD polyclonal EIA (3, 11, 12). The histoplasma antigen-positive specimens were determined to be positive solely on the basis that they generated a positive result using the MVD EIA, which could have been false positive due to cross-reactivity. Culture, serology, histopathology, and clinical information might have been used to definitively assess infection and ultimately confirm histoplasmosis, but these alternative tests were not included in this study. Furthermore, the MVD EIA has been reported to have a false-negative rate of 15 to 30% for urine specimens (10, 13). It is possible that the MVD EIA may have a lower limit of detection (LOD) than the IMMY assay, but studies to determine the LOD were not reported (e.g., the dilution of a moderate positive below the limit of the lowest calibrator in both assays.) An LOD experiment would be valuable but would require parallel testing of a dilution series in both assays.
Third, LeMonte et al. (4) obtained a set of data that included several discrepancies, yet they did not report how the discrepancies were resolved. A new lot number of IMMY reagents should have been tested to see if there was reagent degradation. Aside from the reagent issue, there remains the issue of competency. How was competency for performing the IMMY EIA validated? ARUP Laboratories has had over 1.5 years of experience performing the IMMY EIA after completing an extensive validation. It is advisable that MVD validate the IMMY assay before drawing the conclusions that they have.
We strongly suspect a conflict of interest for MVD, which introduces a significant bias in their study. We would welcome any reagents, regardless of manufacturer, that would lead to an improved histoplasma antigen assay. At this time, both the MVD and IMMY assays have shortcomings, but the LeMonte study does not demonstrate which is best. Currently, if either the MVD EIA or the IMMY EIA is performed, clinical information and patient history are a necessary component of test interpretation. Alternative testing, such as serology, histopathology, and culture, may be suggested as well, if the samples are available. Because antigen testing is fast and requires noninvasive specimens, we will continue working to build a better assay for antigen detection and welcome any research collaborations to make this happen. Until then, we encourage transparency of information and broad collaborations to discover better targets and improved technology for a specific and sensitive antigen detection assay.
Finally, we comment on the philosophy of tightly holding the intellectual property of laboratory tests. Refusing to provide reagents for purchase so that an unbiased evaluation can be performed stifles the advancement of test improvement and stifles the demand for clinically useful tests. We support a philosophy of licensing technology to all interested clinical laboratories and encourage test improvement for those willing to invest the resources. The current histoplasma antigen assays are in need of improvement. That task is best enhanced by the collaboration of interested investigators.
| REFERENCES |
|---|
|
|
|---|
|
Joann L. Cloud*
ARUP Institute for Clinical and Experimental Pathology 500 Chipeta Way Salt Lake City, Utah 84108
Sean K. Bauman
Edward R. Ashwood
|
||||||
| * Phone: (801) 583-2787, ext. 2439, Fax: (801) 584-5109, E-mail: cloudjl{at}aruplab.com |
| LETTER |
|---|
|
|
|---|
They claim that the false-positive rate that we observed (16%) (3) is inconsistent with their positivity rate of 2.9% in over 10,000 specimens. Please note that they reported an 8% false-positive rate, similar to our 16% rate considering the small sample size (n = 50), when testing specimens that were negative at MVD (1). We were surprised at the low sensitivity and specificity, prompting us to repeat the experiment, at which time we verified the earlier findings using a different kit.
They claim that "the MVD EIA has been reported to have a false-negative rate of 15 to 30% for urine specimens." In fact, the sensitivity with urine in our second-generation assay has been 98% or greater in specimens from patients with AIDS and disseminated histoplasmosis, the only group studied to date (6).
They further claim that "the MVD EIA may have a lower limit of detection (LOD) than the IMMY assay, but studies to determine the LOD were not reported." We have reported that the antigen detected in patients with histoplasmosis is a galactomannan, which can be quantified in the MVD Histoplasma antigen EIA. The LOD for Histoplasma galactomannan is about 0.3 ng/ml in the MVD assay, compared to 29 ng/ml in the IMMY kit (Fig. 1).
|
| REFERENCES |
|---|
|
|
|---|
|
L. Joseph Wheat* Ann LeMonte MiraVista Diagnostics 4444 Decatur Blvd. Indianapolis, Indiana 46241
| ||||||
| * Phone: (317) 856-2681, ext. 452, E-mail: jwheat{at}miravistalabs.com |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Antimicrob. Agents Chemother. | Clin. Microbiol. Rev. | Infect. Immun. |
|---|---|---|
| J. Clin. Microbiol. | J. Virol. | ALL ASM JOURNALS |