Skip directly to site content Skip directly to page options Skip directly to A-Z link Skip directly to A-Z link Skip directly to A-Z link
Volume 10, Number 6—June 2004
Dispatch

Reference Group Choice and Antibiotic Resistance Outcomes

Author affiliations: *Duke University Medical Center, Durham, North Carolina, USA; †Pfizer, New York, New York, USA; ‡Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA

Cite This Article

Abstract

Two types of cohort studies examining patients infected with methicillin-resistant Staphylococcus aureus (MRSA) and vancomycin-resistant enterococci (VRE) were contrasted, using different reference groups. Cases were compared to uninfected patients and patients infected with the corresponding, susceptible organism. VRE and MRSA were associated with adverse outcomes. The effect was greater when uninfected control patients were used.

Although several investigators have performed outcomes studies of patients infected or colonized with antimicrobial resistant bacteria, the design and interpretation of results with various methods has not been discussed (1). Typically, these outcomes studies use a cohort design and study patients infected with resistant bacteria (the exposure of interest for cases), who are compared either to patients without infection selected from a similar population (26) or to patients infected with corresponding, susceptible bacteria (e.g., comparing patients with methicillin-resistant Staphylococcus aureus [MRSA] to patients with methicillin-susceptible S. aureus [MSSA]) (713) (Appendix). When cases are compared to an uninfected reference group or “control group,” the effect of a new, antimicrobial-resistant bacterial infection is assessed. When case-patients are compared to reference patients or “controls” infected with the corresponding susceptible bacteria, the impact of acquiring a resistance determinant is measured. Both types of comparison are valid and important, but they address different clinical scenarios.

We examined how the choice of the reference group might influence results of outcomes studies pertaining to antimicrobial resistant bacteria. We compared and contrasted the results of outcomes cohort studies for resistant bacteria by using the two different reference groups discussed previously. We used results from original studies of MRSA and vancomycin-resistant enterococci (VRE) (9,10) that initially used one reference group. In our study, we performed additional analyses comparing case-patients to different reference patients and contrasted the results.

The Study

Both MRSA and VRE studies were designed as cohort studies and are discussed in detail elsewhere (9,10) (Appendix). Cases were defined as patients with MRSA surgical site infection (SSI) (i.e., the exposure of interest for study 1) and VRE wound infection (i.e., the exposure of interest for study 2). In each study, two different reference groups were used in separate analyses. Control group A included patients who did not have an infection caused by the target pathogen (S. aureus or enterococci). Control group B included patients with infection caused by the susceptible phenotype of the target pathogen (i.e., MSSA and vancomycin-susceptible enterococci [VSE]).

In both studies, three outcomes were examined: death, length of hospital stay, and total hospital charges. Hospital charges were variable direct charges obtained from hospital financial databases and are a surrogate for cost. Hospital costs were estimated using a cost-to-charge ratio of 0.7 (14).

Outcomes studies of antimicrobial drug resistance are notoriously hard to perform because of confounding variables related to underlying coexisting conditions (1). To control for confounding, we analyzed several variables, including individual coexisting conditions, the Charlson score, the American Society of Anesthesiologists-Physical Status (ASA) score, and duration of hospitalization before infection (Appendix). These variables were analyzed in multivariable analysis. Each of the outcomes was analyzed independently. The inverse log value was calculated for β coefficients of variables included in the predictor models, and these effect measures were described as the odds ratio (OR) for death rate and the multiplicative effects (ME) on length of stay and charges.

In the analysis comparing patients with SSI caused by MRSA to uninfected controls, the study cohort included 314 patients: 121 MRSA SSI cases and 193 uninfected surgical controls (Appendix). In multivariable analysis, MRSA SSI was significantly associated with death (OR = 11.4, p < 0.001). In the analysis comparing patients with MRSA SSI to patients with SSI caused by MSSA, the same 121 MRSA case-patients were compared to 165 control-patients with MSSA SSI. In multivariable analysis, MRSA SSI was significantly associated with death (OR = 3.4, p = 0.003). Additional covariates included in the adjusted models for death are listed in the footnotes of Table 1 and are discussed in the Appendix. The effect of MRSA on deaths was approximately threefold greater for the analysis using uninfected controls than for the analysis using MSSA controls.

In the analysis comparing patients with SSI caused by MRSA to uninfected controls, multivariable modeling demonstrated that MRSA SSI was significantly associated with an increased length of stay (ME = 3.2, p < 0.001). Having an MRSA SSI was associated with an average adjusted attributable increase of 13.4 hospital days per case. In the analysis comparing patients with MRSA SSI to controls with SSI due to MSSA, a trend was seen toward an association between MRSA SSI and total hospital days (ME = 1.20, p = 0.11). Methicillin resistance was associated with an average adjusted attributable increase of 2.6 days per case, although this did not reach statistical significance. Additional covariates included in the adjusted models for length of stay are listed in the footnotes of Table 1 and are discussed in the Appendix. The effect of MRSA on length of stay was approximately threefold greater (11 days) for the analysis using uninfected controls than for analysis B using MSSA controls.

In the analysis comparing patients with SSI due to MRSA to uninfected controls, multivariable modeling showed that MRSA SSI was significantly associated with increased hospital charges (ME = 2.2, p < 0.001). MRSA was associated with mean adjusted additional attributable charges of $41,274 per case and an attributable cost of $28,891 per case. In the analysis comparing patients with SSI due to MRSA to controls with SSI due to MSSA, MRSA was significantly associated with increased hospital charges (ME = 1.2, p = 0.03). Methicillin resistance was associated with mean adjusted additional attributable charges of $13,901 per MRSA SSI case and an attributable cost of $9,731 per case. Additional covariates included in the adjusted models for cost are listed in the footnotes of Table 1 and are discussed in the Appendix. The effect of MRSA on cost was approximately twofold greater ($15,000) for the analysis using uninfected controls than for the analysis using controls with SSI due to MSSA.

In the analysis comparing patients with wound infection due to VRE to uninfected controls, 99 patients with VRE wound infection were compared to 280 matched controls who were not infected with enterococci (Appendix). In adjusted analysis, VRE wound infection was not an independent predictor of deaths (OR 2.0, p = 0.13). In the analysis comparing patients with wound infection due to VRE to control patients with wound infection due to VSE, the same 99 VRE wound infection cases were compared to 213 control patients with VSE wound infections. In multivariable analysis, VRE was significantly associated with mortality (OR 2.5, p = 0.04). Additional covariates included in the adjusted models for death rates are listed in the footnotes of Table 2 and are discussed in the Appendix. The magnitude of effect of VRE on deaths was similar for both analyses.

In the analysis comparing patients with wound infection due to VRE to uninfected controls, multivariable modeling showed a significantly longer duration of hospitalization after inclusion in the cohort for VRE cases than for controls not infected with enterococci (ME 1.8, p < 0.001, average adjusted attributable increase of 6.2 days in length of stay). In the analysis comparing patients with wound infection due to VRE to control patients with VSE wound infection, length of stay after isolation of enterococci was similar among VRE cases and VSE controls (mean of 15.2 vs. 13.6 days, p = 0.5) and the differences in length of stay remained non-significant in multivariate analysis (ME = 1.0, p = 0.5). Additional covariates included in the adjusted models for length of stay are listed in the footnotes of Table 2 and are discussed in the Appendix. The effect of VRE on length of stay was approximately twofold greater (6 days) for the analysis using uninfected controls than for the analysis that used VSE controls.

In the analysis comparing patients with wound infection due to VRE to uninfected controls, multivariable modeling demonstrated that VRE cases generated significantly greater hospital charges than controls (adjusted ME = 1.5, p < 0.001, mean adjusted additional attributable charges of $13,884 per VRE wound infection and attributable cost of $9,719 per infection). In the analysis comparing patients with wound infection due to VRE to controls with VSE wound infection, VRE wound infection was associated with increased hospital charges (ME = 1.4, p < 0.001, average adjusted additional attributable charges of $12,766 per infection and attributable cost of $8,936 per infection). Additional covariates included in the adjusted models for cost are listed in the footnotes of Table 2 and are discussed in the Appendix. The effect of VRE on cost was similar in both analyses.

Conclusions

We examined how the criteria used to select a reference group (i.e., a comparison or control group for cases) influenced outcomes study results. Two types of control patients were studied, and in both types of analyses, VRE and MRSA were associated with significant, adverse clinical outcomes. In general, the effects (i.e., OR or ME) were of greater magnitude when controls not infected with the target organism (and thus representative of a random sample of the source population) were used. This is logical since analyses using uninfected controls assess the effect of acquiring a new infection and a resistant pathogen. When patients who are infected with a susceptible organism are used as controls, the analysis quantifies only the effect of acquiring a resistance trait.

The differences in results between the two analyses were much greater for the MRSA SSI study than for the VRE wound infection study. The impact on clinical outcomes was two- to threefold greater when patients with MRSA SSI were compared to an uninfected control group as opposed to comparison with control patients infected with MSSA SSI. In contrast, when patients with VRE wound infection were compared to uninfected patients, similar results were obtained as when patients with VSE wound infections were used as controls. We believe that the magnitude of differences in results for the two analyses is directly related to the virulence of the infecting organism (Appendix).

The studies were performed in two different geographic locales and by using slightly different analytic methods. While this is a limitation in that cost results are not directly comparable, we feel including these two studies improves the generalizability of our results and strengthens our findings.

For studies of antimicrobial resistance, a reference group must be chosen on the basis of the investigators’ objective. From a public health perspective, results from outcomes studies pertaining to antimicrobial resistance are frequently used to help allocate resources for interventions. If the objective of a study is to investigate the independent effects of a resistance trait or phenotype (e.g., methicillin resistance) then the most appropriate control group would consist of patients infected with a susceptible corresponding organism. If the goal is to assess the effect of a new infection caused by a particular pathogen, uninfected control patients would be the preferable comparison group. Alternatively, a complete analysis might include both types of control groups; this analysis would allow the reader to assess the effect of acquiring a resistance phenotype alone and the impact of acquiring a new infection caused by a resistant bacteria.

Dr. Kaye is an assistant professor of medicine at Duke University Medical Center, where he is director of Hospital Epidemiology and Infection Control and chair of the Antibiotic Evaluation Committee. His research interests include antimicrobial resistance, antimicrobial utilization, and selective antimicrobial pressure, surgical site infections, infections in the elderly, and hospital-acquired infections.

Top

References

  1. Cosgrove  SE, Carmeli  Y. The impact of antimicrobial resistance on health and economic outcomes. Clin Infect Dis. 2003;36:14337. DOIPubMedGoogle Scholar
  2. Chaix  C, Durand-Zaleski  I, Alberti  C, Brun-Buisson  C. Control of endemic methicillin-resistant Staphylococcus aureus: a cost-benefit analysis in an intensive care unit. JAMA. 1999;282:174551. DOIPubMedGoogle Scholar
  3. Edmond  MB, Ober  JF, Dawson  JD, Weinbaum  DL, Wenzel  RP. Vancomycin-resistant enterococcal bacteremia: natural history and attributable mortality. Clin Infect Dis. 1996;23:12349.PubMedGoogle Scholar
  4. Menon  KV, Whiteley  MS, Burden  P, Galland  RB. Surgical patients with methicillin resistant Staphylococcus aureus infection: an analysis of outcome using P-POSSUM. J R Coll Surg Edinb. 1999;44:1613.PubMedGoogle Scholar
  5. Montecalvo  MA, Jarvis  WR, Uman  J, Shay  DK, Petrullo  C, Horowitz  HW, Costs and savings associated with infection control measures that reduced transmission of vancomycin-resistant enterococci in an endemic setting. Infect Control Hosp Epidemiol. 2001;22:43742. DOIPubMedGoogle Scholar
  6. Newell  KA, Millis  JM, Arnow  PM, Bruce  DS, Woodle  ES, Cronin  DC, Incidence and outcome of infection by vancomycin-resistant Enterococcus following orthotopic liver transplantation. Transplantation. 1998;65:43942. DOIPubMedGoogle Scholar
  7. Abramson  MA, Sexton  DJ. Nosocomial methicillin-resistant and methicillin-susceptible Staphylococcus aureus primary bacteremia: at what costs? Infect Control Hosp Epidemiol. 1999;20:40811. DOIPubMedGoogle Scholar
  8. Auburtin  M, Porcher  R, Bruneel  F, Scanvic  A, Trouillet  JL, Bedos  JP, Pneumococcal meningitis in the intensive care unit: prognostic factors of clinical outcome in a series of 80 cases. Am J Respir Crit Care Med. 2002;165:7137.PubMedGoogle Scholar
  9. Carmeli  Y, Eliopoulos  G, Mozaffari  E, Samore  M. Health and economic outcomes of vancomycin-resistant enterococci. Arch Intern Med. 2002;162:22238. DOIPubMedGoogle Scholar
  10. Engemann  JJ, Carmeli  Y, Cosgrove  SE, Fowler  VG, Bronstein  MZ, Trivette  SL, Adverse clinical and economic outcomes attributable to methicillin resistance among patients with Staphylococcus aureus surgical site infection. Clin Infect Dis. 2003;36:5928. DOIPubMedGoogle Scholar
  11. Harbarth  S, Rutschmann  O, Sudre  P, Pittet  D. Impact of methicillin resistance on the outcome of patients with bacteremia caused by Staphylococcus aureus. Arch Intern Med. 1998;158:1829. DOIPubMedGoogle Scholar
  12. Stosor  V, Peterson  LR, Postelnick  M, Noskin  GA. Enterococcus faecium bacteremia: does vancomycin resistance make a difference? Arch Intern Med. 1998;158:5227. DOIPubMedGoogle Scholar
  13. Vergis  EN, Hayden  MK, Chow  JW, Snydman  DR, Zervos  MJ, Linden  PK, Determinants of vancomycin resistance and mortality rates in enterococcal bacteremia. A prospective multicenter study. Ann Intern Med. 2001;135:48492.PubMedGoogle Scholar
  14. Howard  D, Cordell  R, McGowan  JE Jr, Packard  RM, Scott  RD, Solomon  SL, Measuring the economic costs of antimicrobial resistance in hospital settings: summary of the Centers for Disease Control and Prevention–Emory Workshop. Clin Infect Dis. 2001;33:15738. DOIPubMedGoogle Scholar

Top

Tables

Top

Cite This Article

DOI: 10.3201/eid1006.020665

Table of Contents – Volume 10, Number 6—June 2004

EID Search Options
presentation_01 Advanced Article Search – Search articles by author and/or keyword.
presentation_01 Articles by Country Search – Search articles by the topic country.
presentation_01 Article Type Search – Search articles by article type and issue.

Top

Comments

Please use the form below to submit correspondence to the authors or contact them at the following address:

Keith S. Kaye, Box 3152, Durham, NC 27710, USA; fax: 919-684-3137

Send To

10000 character(s) remaining.

Top

Page created: February 22, 2011
Page updated: February 22, 2011
Page reviewed: February 22, 2011
The conclusions, findings, and opinions expressed by authors contributing to this journal do not necessarily reflect the official position of the U.S. Department of Health and Human Services, the Public Health Service, the Centers for Disease Control and Prevention, or the authors' affiliated institutions. Use of trade names is for identification only and does not imply endorsement by any of the groups named above.
file_external