Advertisement

Administrative coding data, compared with CDC/NHSN criteria, are poor indicators of health care–associated infections

      Background

      ICD-9-CM coding alone has been proposed as a method of surveillance for health care-associated infections (HAIs). The accuracy of this method, however, relative to accepted infection control criteria is not known.

      Methods

      Retrospective analysis of patients at an academic medical center in 2005 who underwent surgical procedures or who were at risk for catheter-associated bloodstream infections or ventilator-associated pneumonia was performed. Patients previously identified with HAIs by Centers for Disease Control and Prevention's National Healthcare Safety Network surveillance methods were compared with those of the same risk group identified by secondary infection ICD-9-CM codes. Discordant cases identified by only coding were all rereviewed and adjusted prior to final analysis. When coding and surveillance were both negative, a sample of patients was used to estimate the proportion of false negatives in this group.

      Results

      The positive predictive values (PPVs) ranged from 0.14 to 0.51 with an aggregate of 0.23, even after adjustment for additional cases detected on subsequent medical record review. The negative predictive values (NPVs) ranged from 0.91 to 1.00, with an aggregate of 0.96. The estimates of the true variance of PPVs and NPVs across surgical procedures were small (0.0129, standard error, 0.009; 0.000145, standard error, 0.00019, respectively) and could be mostly explained by variation in prevalence of surgical site infections.

      Conclusion

      Administrative coding alone appears to be a poor tool to be used as an infection control surveillance method. Its proposed use for routine HAI surveillance, public reporting of HAIs, interfacility comparisons, and nonpayment for performance should be seriously questioned.
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to American Journal of Infection Control
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Gaynes R.P.
        Surveillance of nosocomial infections: a fundamental ingredient for quality.
        Infect Control Hosp Epidemiol. 1997; 18: 475-478
        • Haley R.W.
        • Culver D.H.
        • White J.W.
        The efficacy of infection surveillance and control programs in preventing nosocomial infections in US hospitals.
        Am J Epidemiol. 1985; 121: 182-205
        • Centers for Disease Control and Prevention
        Public health focus: surveillance, prevention, and control of nosocomial infections.
        MMWR. 1992; 41: 783-787
        • Roy M.C.
        • Perl T.M.
        Basics of surgical-site infection surveillance.
        Infect Control Hosp Epidemiol. 1997; 18: 659-668
        • Misset B.
        • Timsit J.F.
        • Dumay M.F.
        • Garrouste M.
        • Chalfine A.
        • Flouriot I.
        • et al.
        A continuous quality-improvement program reduces nosocomial infection rates in the ICU.
        Intensive Care Med. 2004; 30: 395-400
        • Gaynes R.P.
        • Culver D.H.
        • Emori T.G.
        • Horan T.C.
        • Banerjee S.N.
        • Edwards J.R.
        • et al.
        The National Nosocomial Infections Surveillance System: plans for the 1990s and beyond.
        Am J Med. 1991; 91: S116-S120
        • Centers for Disease Control and Prevention
        Monitoring hospital-acquired infections to promote patient safety-United States, 1990-1999.
        MMWR. 2000; 49: 149-153
        • Archibald L.K.
        • Gaynes R.P.
        Hospital-acquired infections in the United States: the importance of interhospital comparisons.
        Infect Dis Clin North Am. 1997; 11: 245-255
        • Garner J.S.
        • Jarvis W.R.
        • Emori T.G.
        • Horan T.C.
        • Hughes J.M.
        CDC definitions for nosocomial infections, 1988.
        Am J Infect Control. 1988; 16: 28-40
        • Horan T.C.
        • Gaynes R.P.
        • Martone W.J.
        • Jarvis W.R.
        • Emori T.G.
        CDC definitions of nosocomial surgical site infections, 1992: a modification of CDC definitions of surgical wound infections.
        Infect Control Hosp Epidemiol. 1992; 13: 606-608
        • Horan T.
        • Gaynes R.
        Surveillance of nosocomial infections.
        in: Hospital epidemiology and infection control. Williams & Wilkins, Philadelphia2004: 1659-1702
        • Burke J.P.
        Infection control—a problem for patient safety.
        N Engl J Med. 2003; 348: 651-656
        • Gerberding J.L.
        Hospital-onset infections: a patient safety issue.
        Ann Intern Med. 2002; 137: 665-670
        • Pittet D.
        • Donaldson L.
        Challenging the world: patient safety and health care-associated infection.
        Int J Qual Health Care. 2006; 18: 4-8
        • Wong E.S.
        • Rupp M.E.
        • Mermel L.
        • Perl T.M.
        • Bradley S.
        • Ramsey K.M.
        • et al.
        Public disclosure of healthcare-associated infections: the role of the Society for Healthcare Epidemiology of America.
        Infect Control Hosp Epidemiol. 2005; 26: 210-212
        • McKibben L.
        • Horan T.C.
        • Tokars J.I.
        • Fowler G.
        • Cardo D.M.
        • Pearson M.L.
        • et al.
        Guidance on public reporting of healthcare-associated infections: recommendations of the Healthcare Infection Control Practices Advisory Committee.
        Infect Control Hosp Epidemiol. 2005; 26: 580-587
        • Moro M.L.
        • Morsillo F.
        Can hospital discharge diagnoses be used for surveillance of surgical-site infections?.
        J Hosp Infect. 2004; 56: 239-241
        • Aronsky D.
        • Haug P.J.
        • Lagor C.
        • Dean N.C.
        Accuracy of administrative data for identifying patients with pneumonia.
        Am J Med Qual. 2005; 20: 319-328
        • Sherman E.R.
        • Heydon K.H.
        • St. John K.H.
        • Teszner E.
        • Rettig S.L.
        • Alexander S.K.
        • et al.
        Administrative data fail to accurately identify cases of healthcare-associated infection.
        Infect Control Hosp Epidemiol. 2006; 27: 332-337
        • Julian K.G.
        • Brumbach A.M.
        • Chicora M.K.
        • Houlihan C.
        • Riddle A.M.
        • Umberger T.
        • et al.
        First year of mandatory reporting of healthcare-associated infections, Pennsylvania: an infection control-chart abstractor collaboration.
        Infect Control Hosp Epidemiol. 2006; 27: 926-930
        • Romano P.S.
        • Chan B.K.
        • Schembri M.E.
        • Rainwater J.A.
        Can administrative data be used to compare postoperative complication rates across hospitals?.
        Med Care. 2002; 40: 856-867
        • Wright S.B.
        • Huskins W.C.
        • Dokholyan R.S.
        • Goldmann D.A.
        • Platt R.
        Administrative databases provide inaccurate data for surveillance of long-term central venous catheter-associated infections.
        Infect Control Hosp Epidemiol. 2003; 24: 946-949
        • Sands K.E.
        • Yokoe D.S.
        • Hooper D.C.
        • Tully J.L.
        • Horan T.C.
        • Gaynes R.P.
        • et al.
        Detection of postoperative surgical-site infections: comparison of health plan-based surveillance with hospital-based programs.
        Infect Control Hosp Epidemiol. 2003; 24: 741-743
        • Madsen K.M.
        • Schonheyder H.C.
        • Kristensen B.
        • Nielsen G.L.
        • Sorensen H.T.
        Can hospital discharge diagnosis be used for surveillance of bacteremia? A data quality study of a Danish hospital discharge registry.
        Infect Control Hosp Epidemiol. 1998; 19: 175-180
        • Stone P.W.
        • Horan T.C.
        • Shih H.C.
        • Mooney-Kane C.
        • Larson E.
        Comparisons of health care-associated infections identification using two mechanisms for public reporting.
        Am J Infect Control. 2007; 35: 145-149
      1. Agency for Healthcare Research and Quality. Patient Safety Indicators. Technical Specifications. AHRQ Quality Indicators. Available at: http://www.qualityindicators.ahrqgov/downloads/psi/psi_technical_specs_v31.pdf. March 2007. Accessed November 7, 2007.

        • Edmond M.B.
        • Bearman G.M.
        Mandatory public reporting in the USA: an example to follow?.
        J Hosp Infect. 2007; 65: 182-188
      2. Medicare program: changes to the hospital inpatient prospective payment systems and fiscal year 2008 rates.
        Fed Regist. 2007; 72: 47379-47428
        • Rosenthal M.B.
        Nonpayment for performance? Medicare's new reimbursement rule.
        N Engl J Med. 2007; 357: 1573-1575
        • Weiss N.S.
        Clinical epidemiology. The study of outcomes of illness.
        Oxford University Press, New York1996
        • Whittle J.
        • Fine M.J.
        • Joyce D.Z.
        • et al.
        Community-acquired pneumonia: can it be defined with claims data?.
        Am J Med Qual. 1997; 12: 187-193
        • Marrie T.J.
        • Durant H.
        • Sealy E.
        Pneumonia—the quality of medical records data.
        Med Care. 1987; 25: 20-24
        • Platt R.
        • Yokoe D.S.
        • Sands K.E.
        Automated methods for surveillance of surgical site infections.
        Emerg Infect Dis. 2001; 7: 212-216
        • Yokoe D.S.
        • Noskin G.A.
        • Cunnigham S.M.
        • Zuccotti G.
        • Plaskett T.
        • Fraser V.J.
        • et al.
        Enhanced identification of postoperative infections among inpatients.
        Emerg Infect Dis. 2004; 10: 1924-1930
        • Begg C.B.
        • Greenes R.A.
        Assessment of diagnostic tests when disease verification is subject to selection bias.
        Biometrics. 1983; 39: 207-215
        • Greenes R.A.
        • Begg C.B.
        Assessment of diagnostic technologies: methodology for unbiased estimation from samples of selectively verified patients.
        Invest Radiol. 1985; 20: 751-756
        • Emori T.G.
        • Edwards J.R.
        • Culver D.H.
        • Sartor C.
        • Stroud L.A.
        • Gaunt E.E.
        • et al.
        Accuracy of reporting nosocomial infections in intensive-care-unit patients to the National Nosocomial Infections Surveillance System: a pilot study.
        Infect Control Hosp Epidemiol. 1998; 19: 308-316
        • Pennsylvania Health Care Cost Containment Council (PHC4)
        Hospital-acquired infections in Pennsylvania.
        PHC4 Research Briefs. 2005; 5: 1-4
        • Brennan P.J.
        In the beginning there was… heat.
        Infect Control Hosp Epidemiol. 2006; 27: 329-331
        • McKibben L.
        • Fowler G.
        • Horan T.
        • Brennan P.J.
        Ensuring rational public reporting systems for health care-associated infections: systematic literature review and evaluation recommendations.
        Am J Infect Control. 2006; 34: 142-149