Fixed Effects High-Dimensional Profiling Models in Low Information Context

Authors

  • Jason P. Estes Mountain View, CA 94043, USA
  • Damla Sentürk Department of Biostatistics, University of California, Los Angeles, CA 90095, USA
  • Esra Kürüm Department of Statistics, University of California, Riverside, CA 92521, USA
  • Connie M. Rhee Department of Medicine, University of California Irvine, Orange, CA 92868, USA
  • Danh V. Nguyen Department of Medicine, University of California Irvine, Orange, CA 92868, USA

DOI:

https://doi.org/10.6000/1929-6029.2021.10.11

Keywords:

End-stage renal disease, fixed effects, high-dimensional parameters, logistic regression, infrequent events, Firth’s correction

Abstract

Profiling or evaluation of health care providers, including hospitals or dialysis facilities, involves the application of hierarchical regression models to compare each provider’s performance with respect to a patient outcome, such as unplanned 30-day hospital readmission. This is achieved by comparing a specific provider’s estimate of unplanned readmission rate, adjusted for patient case-mix, to a normative standard, typically defined as an “average” national readmission rate across all providers. Profiling is of national importance in the United States because the Centers for Medicare and Medicaid Services (CMS) policy for payment to providers is dependent on providers’ performance, which is part of a national strategy to improve delivery and quality of patient care. Novel high dimensional fixed effects (FE) models have been proposed for profiling dialysis facilities and are more focused towards inference on the tail of the distribution of provider outcomes, which is well-suited for the objective of identifying sub-standard (“extreme”) performance. However, the extent to which estimation and inference procedures for FE profiling models are effective when the outcome is sparse and/or when there are relatively few patients within a provider, referred to as the “low information” context, have not been examined. This scenario is common in practice when the patient outcome of interest is cause-specific 30-day readmissions, such as 30-day readmission due to infections in patients on dialysis, which is only about ~ 8% compared to the > 30% for all-cause 30-day readmission. Thus, we examine the feasibility and effectiveness of profiling models under the low information context in simulation studies and propose a novel correction method to FE profiling models to better handle sparse outcome data

References

United States Renal Data System. Annual Data Report: Epidemiology of Kidney Disease and in the United States. National Institutes of Health, National Institute of Diabetes and Digestive and Kidney Diseases, Bethesda, MD. [cited 2020]: Available from https://adr.usrds.org/2020/

Ash AS, Fienberg SE, Louis TA, Normand ST, Stukel TA, Utts J. Statistical issues in assessing hospital performance. The COPSS-CMS White Paper Committee, CMS, Washington D.C. [cited 2012]: Available from https://www.cms.gov/medicare/quality-initiatives-patient-assessment-instruments/hospitalqualityinits/downloads/ statistical-issues-in-assessing-hospital-performance.pdf.

Centers for Medicare & Medicaid Services (CMS)/UM-KECC. Report for the standardized readmission ratio. [cited 2017]: Available from https://www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-Instruments/ESRDQIP/ Downloads/SRR_Methodology_Report_June2017.pdf

Horwitz L, Partovain C, Lin ZQ, et al. Development and use of an administrative claims measure for profiling hospital-wide performance on 30-day unplanned readmission. Annals of Internal Medicine 2014; 161: S66-75. https://doi.org/10.7326/M13-3000 DOI: https://doi.org/10.7326/M13-3000

Krumholz HM, Lin Z, Drye EE, et al. An administrative claims measure suitable for profiling hospital performance based on 30-day all-cause readmission rates among patients with acute myocardial infarction. Circulation Cardiovascular Quality and Outcomes 2011; 4: 243-252. https://doi.org/10.1161/CIRCOUTCOMES.110.957498 DOI: https://doi.org/10.1161/CIRCOUTCOMES.110.957498

Normand S, Glickman ME, Gatsonis CA. Statistical methods for profiling providers of medical care: Issues and applications. Journal of the American Statistical Association 1997; 92: 803-814. https://doi.org/10.1080/01621459.1997.10474036 DOI: https://doi.org/10.1080/01621459.1997.10474036

Normand ST, Shahian DM. Statistical and clinical aspects of hospital outcomes profiling. Statistical Science 2007; 22: 206-226. https://doi.org/10.1214/088342307000000096 DOI: https://doi.org/10.1214/088342307000000096

Kalbfleisch JD, Wolfe RA. On monitoring outcomes of medical providers. Statistics in Biosciences 20113; 5: 286-302. https://doi.org/10.1007/s12561-013-9093-x DOI: https://doi.org/10.1007/s12561-013-9093-x

Chen Y, Senturk D, Estes JP, Campos LF, Rhee CM, Dalrymple LS, Kalantar-Zadeh K, Nguyen DV. Performance characteristics of profiling methods and the impact of inadequate case-mix adjustment. Communications in Statistics - Simulation and Computation 2021; 50: 1854-1871. https://doi.org/10.1080/03610918.2019.1595649 DOI: https://doi.org/10.1080/03610918.2019.1595649

Senturk D, Chen Y, Estes JP, Campos LF, Rhee CM, Kalantar-Zadeh K, Nguyen DV. Impact of case-mix measurement error on estimation and inference in profiling of health care providers. Communications in Statistics - Simulation and Computation 2020; 49: 2206-2224. https://doi.org/10.1080/03610918.2018.1515360 DOI: https://doi.org/10.1080/03610918.2018.1515360

Estes JP, Chen Y, Senturk D, Rhee CM, Kurum E, You AS, Streja E, Kalantar-Zadeh K, Nguyen DV. Profiling dialysis facilities for adverse recurrent events. Statistics in Medicine 2020; 39: 1374-1389. https://doi.org/10.1002/sim.8482 DOI: https://doi.org/10.1002/sim.8482

Estes JP, Nguyen DV, Chen Y, Dalrymple LS, Rhee CM, Kalantar-Zadeh K, Senturk D. Time-dynamic profiling with application to hospital readmission among patients on dialysis (with discussion). Biometrics 2018; 74: 1383-1394. https://doi.org/10.1111/biom.12908 DOI: https://doi.org/10.1111/biom.12908

Estes JP, Nguyen DV, Chen Y, Dalrymple LS, Rhee CM, Kalantar-Zadeh K, Senturk D. Rejoinder: Time-dynamic profiling with application to hospital readmission among patients on dialysis. Biometrics 2018b; 74: 1404-1406. https://doi.org/10.1111/biom.12905 DOI: https://doi.org/10.1111/biom.12905

Chen Y, Rhee CM, Senturk D, Kurum E, Campos LF, Li Y, Kalantar-Zadeh K, Nguyen DV. Association of U.S. dialysis facility staffing with profiling of hospital-wide 30-day unplanned readmission. Kidney Diseases 2019; 5: 153-162. https://doi.org/10.1159/000496147 DOI: https://doi.org/10.1159/000496147

He K, Kalbfleisch JD, Li Y, Li Y. Evaluating hospital readmission rates in dialysis facilities; adjusting for hospital effects. Lifetime Data Analysis 2013; 19: 490-512. https://doi.org/10.1007/s10985-013-9264-6 DOI: https://doi.org/10.1007/s10985-013-9264-6

Firth D. Bias reduction of maximum likelihood estimates. Biometrika 1993; 80: 27-38. https://doi.org/10.1093/biomet/80.1.27 DOI: https://doi.org/10.1093/biomet/80.1.27

Heinze G, Schemper M. A solution to the problem of separation in logistic regression. Statistics in Medicine 2002; 21: 2409-2419. https://doi.org/10.1002/sim.1047 DOI: https://doi.org/10.1002/sim.1047

Jeffreys H. An invariant form of the prior probability in estimation problems. Proceedings of the Royal Society of London, Series A 1946; 186(1007): 453-461. https://doi.org/10.1098/rspa.1946.0056 DOI: https://doi.org/10.1098/rspa.1946.0056

Downloads

Published

2021-09-27

How to Cite

Estes, J. P., Sentürk, D. ., Kürüm, E., Rhee, C. M., & Nguyen, D. V. (2021). Fixed Effects High-Dimensional Profiling Models in Low Information Context. International Journal of Statistics in Medical Research, 10, 118–131. https://doi.org/10.6000/1929-6029.2021.10.11

Issue

Section

General Articles