Paradigm Shift in Digital Health Assessment: Reconstructing the Causal Logic of Telemedicine Effectiveness Research
DOI:
https://doi.org/10.54097/nn7t5x04Keywords:
Telemedicine; Causal Inference; Selection Bias; Target Trial Emulation; Structural Confounding.Abstract
The COVID-19 pandemic resulted in a dramatic change to healthcare around the world due to the rapid scaling of the use of telemedicine into a central position within the healthcare systems. However, with this rapid scaling, the available scientific evidence as it relates to the clinical effectiveness, cost-effectiveness, and equity of telemedicine presents disturbing fragmentation and heterogeneity. The crisis in the evidence is largely due to the statistical bias generated by the bidirectional selection processes inherently present in much of the observational data that exists on telemedicine, as well as the structural bias resulting from the digital divide. The objective of this article is to systematically reorganize the methodological landscape concerning causal inference within the field of telemedicine research. To accomplish this goal, this article follows four steps. First, it describes how "healthy user bias" and "severity bias" interfere with traditional association analyses. Second, it assesses the evolution of empirical paradigms from classic causal adjustment techniques to quasi-experimental methods. Third, it examines the potential of Causal Machine Learning (Causal ML) in capturing heterogeneous treatment effects. Finally, it proposes the Target Trial Emulation (TTE) framework as the "gold standard" for enhancing evidence quality. As shown in this review of current research practices, the more rigorous the causal inference design, the better the elimination of complex confounding factors and thereby the more evidence available for formulating digital health policy.
Downloads
References
[1] Greenhalgh T, Wherton J, Shaw S, et al. Video consultations for covid-19. Bmj, 2020, 368.
[2] Ekeland A G, Bowes A, Flottorp S. Methodologies for assessing telemedicine: a systematic review of reviews. International journal of medical informatics, 2012, 81(1): 1-11.
[3] Topol E J. High-performance medicine: the convergence of human and artificial intelligence. Nature medicine, 2019, 25(1): 44-56.
[4] Shrank W H, Patrick A R, Alan Brookhart M. Healthy user and related biases in observational studies of preventive interventions: a primer for physicians. Journal of general internal medicine, 2011, 26(5): 546-550.
[5] Adler N E, Newman K. Socioeconomic disparities in health: pathways and policies. Health affairs, 2002, 21(2): 60-76.
[6] Watson J D, Xia B, Dini M E, et al. Barriers and facilitators to physicians’ telemedicine uptake during the beginning of the COVID-19 pandemic. PLOS Digital Health, 2025, 4(4): e0000818.
[7] Chang E, Penfold R B, Berkman N D. Patient characteristics and telemedicine use in the US, 2022. JAMA network open, 2024, 7(3): e243354-e243354.
[8] Ramsetty A, Adams C. Impact of the digital divide in the age of COVID-19. Journal of the American Medical Informatics Association, 2020, 27(7): 1147-1148.
[9] Bhatt J, Bathija P. Ensuring access to quality health care in vulnerable communities. Academic medicine, 2018, 93(9): 1271-1275.
[10] Rosenbaum P R, Rubin D B. The central role of the propensity score in observational studies for causal effects. Biometrika, 1983, 70(1): 41-55.
[11] Alkhuzaee F, Alsharif S, Shukry M. Telemedicine-based medical care compared to in-person medical care for warfarin follow-up: A retrospective propensity score matching cohort study. American Journal of Health-System Pharmacy, 2024, 81(7): e166-e173.
[12] Downey C L, Chapman S, Randell R, et al. The impact of continuous versus intermittent vital signs monitoring in hospitals: a systematic review and narrative synthesis. International journal of nursing studies, 2018, 84: 19-27.
[13] Ellis K B, Keogh R H, Clarke G M, et al. Investigating impacts of health policies using staggered difference-in-differences: the effects of adoption of an online consultation system on prescribing patterns of antibiotics. arXiv preprint arXiv:2305.19878, 2023.
[14] Callaway B, Sant’Anna P H. Difference-in-differences with multiple time periods. Journal of econometrics, 2021, 225(2): 200-230.
[15] Angrist J, Imbens G. Identification and estimation of local average treatment effects. 1995.
[16] Bertrand M, Duflo E, Mullainathan S. How much should we trust differences-in-differences estimates?. The Quarterly journal of economics, 2004, 119(1): 249-275.
[17] Cooper Z, Gibbons S, Jones S, et al. Does competition improve public hospitals’ efficiency?: evidence from a quasi-experiment in the English National Health Service. 2012.
[18] Abadie A, Diamond A, Hainmueller J. Synthetic control methods for comparative case studies: Estimating the effect of California’s tobacco control program. Journal of the American statistical Association, 2010, 105(490): 493-505.
[19] Athey S, Imbens G. Recursive partitioning for heterogeneous causal effects. Proceedings of the National Academy of Sciences, 2016, 113(27): 7353-7360.
[20] Boutilier J J, Yoeli E, Rathauser J, et al. Can digital adherence technologies reduce inequity in tuberculosis treatment success? Evidence from a randomised controlled trial. BMJ global health, 2022, 7(12): e010512.
[21] Chernozhukov V, Chetverikov D, Demirer M, et al. Double/debiased machine learning for treatment and structural parameters. 2018.
[22] Hernán M A, Robins J M. Using big data to emulate a target trial when a randomized trial is not available. American journal of epidemiology, 2016, 183(8): 758-764.
[23] Sterne J A, Hernán M A, Reeves B C, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. Bmj, 2016, 355.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Highlights in Science, Engineering and Technology

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.







