Fixed Effects High-Dimensional Profiling Models in Low Information Context
DOI:
https://doi.org/10.6000/1929-6029.2021.10.11Keywords:
End-stage renal disease, fixed effects, high-dimensional parameters, logistic regression, infrequent events, Firth’s correctionAbstract
Profiling or evaluation of health care providers, including hospitals or dialysis facilities, involves the application of hierarchical regression models to compare each provider’s performance with respect to a patient outcome, such as unplanned 30-day hospital readmission. This is achieved by comparing a specific provider’s estimate of unplanned readmission rate, adjusted for patient case-mix, to a normative standard, typically defined as an “average” national readmission rate across all providers. Profiling is of national importance in the United States because the Centers for Medicare and Medicaid Services (CMS) policy for payment to providers is dependent on providers’ performance, which is part of a national strategy to improve delivery and quality of patient care. Novel high dimensional fixed effects (FE) models have been proposed for profiling dialysis facilities and are more focused towards inference on the tail of the distribution of provider outcomes, which is well-suited for the objective of identifying sub-standard (“extreme”) performance. However, the extent to which estimation and inference procedures for FE profiling models are effective when the outcome is sparse and/or when there are relatively few patients within a provider, referred to as the “low information” context, have not been examined. This scenario is common in practice when the patient outcome of interest is cause-specific 30-day readmissions, such as 30-day readmission due to infections in patients on dialysis, which is only about ~ 8% compared to the > 30% for all-cause 30-day readmission. Thus, we examine the feasibility and effectiveness of profiling models under the low information context in simulation studies and propose a novel correction method to FE profiling models to better handle sparse outcome data
References
United States Renal Data System. Annual Data Report: Epidemiology of Kidney Disease and in the United States. National Institutes of Health, National Institute of Diabetes and Digestive and Kidney Diseases, Bethesda, MD. [cited 2020]: Available from https://adr.usrds.org/2020/
Ash AS, Fienberg SE, Louis TA, Normand ST, Stukel TA, Utts J. Statistical issues in assessing hospital performance. The COPSS-CMS White Paper Committee, CMS, Washington D.C. [cited 2012]: Available from https://www.cms.gov/medicare/quality-initiatives-patient-assessment-instruments/hospitalqualityinits/downloads/ statistical-issues-in-assessing-hospital-performance.pdf.
Centers for Medicare & Medicaid Services (CMS)/UM-KECC. Report for the standardized readmission ratio. [cited 2017]: Available from https://www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-Instruments/ESRDQIP/ Downloads/SRR_Methodology_Report_June2017.pdf
Horwitz L, Partovain C, Lin ZQ, et al. Development and use of an administrative claims measure for profiling hospital-wide performance on 30-day unplanned readmission. Annals of Internal Medicine 2014; 161: S66-75. https://doi.org/10.7326/M13-3000 DOI: https://doi.org/10.7326/M13-3000
Krumholz HM, Lin Z, Drye EE, et al. An administrative claims measure suitable for profiling hospital performance based on 30-day all-cause readmission rates among patients with acute myocardial infarction. Circulation Cardiovascular Quality and Outcomes 2011; 4: 243-252. https://doi.org/10.1161/CIRCOUTCOMES.110.957498 DOI: https://doi.org/10.1161/CIRCOUTCOMES.110.957498
Normand S, Glickman ME, Gatsonis CA. Statistical methods for profiling providers of medical care: Issues and applications. Journal of the American Statistical Association 1997; 92: 803-814. https://doi.org/10.1080/01621459.1997.10474036 DOI: https://doi.org/10.1080/01621459.1997.10474036
Normand ST, Shahian DM. Statistical and clinical aspects of hospital outcomes profiling. Statistical Science 2007; 22: 206-226. https://doi.org/10.1214/088342307000000096 DOI: https://doi.org/10.1214/088342307000000096
Kalbfleisch JD, Wolfe RA. On monitoring outcomes of medical providers. Statistics in Biosciences 20113; 5: 286-302. https://doi.org/10.1007/s12561-013-9093-x DOI: https://doi.org/10.1007/s12561-013-9093-x
Chen Y, Senturk D, Estes JP, Campos LF, Rhee CM, Dalrymple LS, Kalantar-Zadeh K, Nguyen DV. Performance characteristics of profiling methods and the impact of inadequate case-mix adjustment. Communications in Statistics - Simulation and Computation 2021; 50: 1854-1871. https://doi.org/10.1080/03610918.2019.1595649 DOI: https://doi.org/10.1080/03610918.2019.1595649
Senturk D, Chen Y, Estes JP, Campos LF, Rhee CM, Kalantar-Zadeh K, Nguyen DV. Impact of case-mix measurement error on estimation and inference in profiling of health care providers. Communications in Statistics - Simulation and Computation 2020; 49: 2206-2224. https://doi.org/10.1080/03610918.2018.1515360 DOI: https://doi.org/10.1080/03610918.2018.1515360
Estes JP, Chen Y, Senturk D, Rhee CM, Kurum E, You AS, Streja E, Kalantar-Zadeh K, Nguyen DV. Profiling dialysis facilities for adverse recurrent events. Statistics in Medicine 2020; 39: 1374-1389. https://doi.org/10.1002/sim.8482 DOI: https://doi.org/10.1002/sim.8482
Estes JP, Nguyen DV, Chen Y, Dalrymple LS, Rhee CM, Kalantar-Zadeh K, Senturk D. Time-dynamic profiling with application to hospital readmission among patients on dialysis (with discussion). Biometrics 2018; 74: 1383-1394. https://doi.org/10.1111/biom.12908 DOI: https://doi.org/10.1111/biom.12908
Estes JP, Nguyen DV, Chen Y, Dalrymple LS, Rhee CM, Kalantar-Zadeh K, Senturk D. Rejoinder: Time-dynamic profiling with application to hospital readmission among patients on dialysis. Biometrics 2018b; 74: 1404-1406. https://doi.org/10.1111/biom.12905 DOI: https://doi.org/10.1111/biom.12905
Chen Y, Rhee CM, Senturk D, Kurum E, Campos LF, Li Y, Kalantar-Zadeh K, Nguyen DV. Association of U.S. dialysis facility staffing with profiling of hospital-wide 30-day unplanned readmission. Kidney Diseases 2019; 5: 153-162. https://doi.org/10.1159/000496147 DOI: https://doi.org/10.1159/000496147
He K, Kalbfleisch JD, Li Y, Li Y. Evaluating hospital readmission rates in dialysis facilities; adjusting for hospital effects. Lifetime Data Analysis 2013; 19: 490-512. https://doi.org/10.1007/s10985-013-9264-6 DOI: https://doi.org/10.1007/s10985-013-9264-6
Firth D. Bias reduction of maximum likelihood estimates. Biometrika 1993; 80: 27-38. https://doi.org/10.1093/biomet/80.1.27 DOI: https://doi.org/10.1093/biomet/80.1.27
Heinze G, Schemper M. A solution to the problem of separation in logistic regression. Statistics in Medicine 2002; 21: 2409-2419. https://doi.org/10.1002/sim.1047 DOI: https://doi.org/10.1002/sim.1047
Jeffreys H. An invariant form of the prior probability in estimation problems. Proceedings of the Royal Society of London, Series A 1946; 186(1007): 453-461. https://doi.org/10.1098/rspa.1946.0056 DOI: https://doi.org/10.1098/rspa.1946.0056
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution 4.0 International License.
Policy for Journals/Articles with Open Access
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are permitted and encouraged to post links to their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work
Policy for Journals / Manuscript with Paid Access
Authors who publish with this journal agree to the following terms:
- Publisher retain copyright .
- Authors are permitted and encouraged to post links to their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work .