A Caltech Library Service

Methodological variations in lagged regression for detecting physiologic drug effects in EHR data

Levine, Matthew E. and Albers, David J. and Hripcsak, George (2018) Methodological variations in lagged regression for detecting physiologic drug effects in EHR data. Journal of Biomedical Informatics, 86 . pp. 149-159. ISSN 1532-0464.

Full text is not posted in this repository. Consult Related URLs below.

Use this Persistent URL to link to this item:


We studied how lagged linear regression can be used to detect the physiologic effects of drugs from data in the electronic health record (EHR). We systematically examined the effect of methodological variations ((i) time series construction, (ii) temporal parameterization, (iii) intra-subject normalization, (iv) differencing (lagged rates of change achieved by taking differences between consecutive measurements), (v) explanatory variables, and (vi) regression models) on performance of lagged linear methods in this context. We generated two gold standards (one knowledge-base derived, one expert-curated) for expected pairwise relationships between 7 drugs and 4 labs, and evaluated how the 64 unique combinations of methodological perturbations reproduce the gold standards. Our 28 cohorts included patients in the Columbia University Medical Center/NewYork-Presbyterian Hospital clinical database, and ranged from 2820 to 79,514 patients with between 8 and 209 average time points per patient. The most accurate methods achieved AUROC of 0.794 for knowledge-base derived gold standard (95%CI [0.741, 0.847]) and 0.705 for expert-curated gold standard (95% CI [0.629, 0.781]). We observed a mean AUROC of 0.633 (95%CI [0.610, 0.657], expert-curated gold standard) across all methods that re-parameterize time according to sequence and use either a joint autoregressive model with time-series differencing or an independent lag model without differencing. The complement of this set of methods achieved a mean AUROC close to 0.5, indicating the importance of these choices. We conclude that time-series analysis of EHR data will likely rely on some of the beneficial pre-processing and modeling methodologies identified, and will certainly benefit from continued careful analysis of methodological perturbations. This study found that methodological variations, such as pre-processing and representations, have a large effect on results, exposing the importance of thoroughly evaluating these components when comparing machine-learning methods.

Item Type:Article
Related URLs:
URLURL TypeDescription
Additional Information:© 2018 Elsevier Inc. Received 3 January 2018, Revised 20 July 2018, Accepted 29 August 2018, Available online 30 August 2018.
Funding AgencyGrant Number
NIHR01 LM006910
Record Number:CaltechAUTHORS:20190320-161530831
Persistent URL:
Official Citation:Matthew E. Levine, David J. Albers, George Hripcsak, Methodological variations in lagged regression for detecting physiologic drug effects in EHR data, Journal of Biomedical Informatics, Volume 86, 2018, Pages 149-159, ISSN 1532-0464, (
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:94012
Deposited By: Tony Diaz
Deposited On:20 Mar 2019 23:27
Last Modified:03 Oct 2019 20:59

Repository Staff Only: item control page