Publications

Google Scholar Citations – Full List of Publications

IML (Interpretable ML): Scoring System / Shapley Value IML Application: Emergency Medicine / Obstetrics and Gynecology / Out-of-Hospital Cardiac Arrest / Renal Medicine / Trauma

AI in Health: AI Fairness & Ethics / Large Language Model & GenAI / Time Series / Viewpoint and Review Biomedical Engineering: HRV (Heart Rate Variability) / HRV Application

IML Method

IML Method: Scoring System

• Xie F, Chakraborty B, Ong MEH, Goldstein B, Liu N. AutoScore: A machine learning-based automatic clinical score generator and its application to mortality prediction using electronic health records. JMIR Medical Informatics 2020; 8(10): e21798. [Code]
• Xie F, Ning Y, Yuan H, Goldstein BA, Ong MEH, Liu N, Chakraborty B. AutoScore-Survival: developing interpretable machine learning-based time-to-event scores with right-censored survival data. Journal of Biomedical Informatics 2022 Jan; 125: 103959. [Code]
• Yuan H, Xie F, Ong MEH, Ning Y, Chee ML, Saffari SE, Abdullah HR, Goldstein BA, Chakraborty B, Liu N. AutoScore-Imbalance: An interpretable machine learning tool for development of clinical scores with rare events data. Journal of Biomedical Informatics 2022 May; 129: 104072. [Code]
• Ning Y, Li S, Ong MEH, Xie F, Chakraborty B, Ting DSW, Liu N. A novel interpretable machine learning system to generate clinical risk scores: An application for predicting early mortality or unplanned readmission in a retrospective cohort study. PLOS Digital Health 2022 Jun; 1(6): e0000062. [Code]
• Saffari SE, Ning Y, Xie F, Chakraborty B, Volovici V, Vaughan R, Ong MEH, Liu N. AutoScore-Ordinal: An interpretable machine learning framework for generating scoring models for ordinal outcomes. BMC Medical Research Methodology 2022 Nov; 22: 286. [Code]
• Li S, Ning Y, Ong MEH, Chakraborty B, Hong C, Xie F, Yuan H, Liu M, Buckland DM, Chen Y, Liu N. FedScore: A privacy-preserving framework for federated scoring system development. Journal of Biomedical Informatics 2023. [Code]
• Xie F, Ning Y, Liu M, Li S, Saffari SE, Yuan H, Volovici V, Ting DSW, Goldstein BA, Ong MEH, Vaughan R, Chakraborty B, Liu N. A universal AutoScore framework to develop interpretable scoring systems for predicting common types of clinical outcomes. STAR Protocols 2023 Jun; 4(2): 102302. [Code]

IML Method: Shapley Value

• Ning Y, Ong MEH, Chakraborty B, Goldstein BA, Ting DSW, Vaughan R, Liu N. Shapley variable importance cloud for interpretable machine learning. Patterns 2022 Apr; 3: 100452. [Code]
• Liu M, Ning Y, Yuan H, Ong MEH, Liu N. Balanced background and explanation data are needed in explaining deep learning models with SHAP: An empirical study on clinical decision making. arXiv:2206.04050. [Code]
• Ning Y, Li S, Ng YY, Chia MYC, Gan HN, Tiah L, Mao DR, Ng WM, Leong BSH, Doctor N, Ong MEH, Liu N. Variable importance analysis with interpretable machine learning for fair risk prediction. PLOS Digital Health 2024 Jul; 3(7): e0000542.

IML Application

IML Application: Emergency Medicine

• Xie F, Ong MEH, Liew JNMH, Tan KBK, Ho AFW, Nadarajan GD, Low LL, Kwan YH, Goldstein BA, Matchar DB, Chakraborty B, Liu N. Development and assessment of an interpretable machine learning triage tool for estimating mortality after emergency admissions. JAMA Network Open 2021 Aug; 4(8): e2118467.
• Liu N, Xie F, Siddiqui FJ, Ho AFW, Chakraborty B, Nadarajan GD, Tan KBK, Ong MEH. Leveraging large-scale electronic health records and interpretable machine learning for clinical decision making at the emergency department: Protocol for system development and validation. JMIR Research Protocols 2022 Mar; 11(3): e34201.
• Xie F, Liu N, Yan L, Ning Y, Lim KK, Gong C, Ho AFW, Low LL, Chakraborty B, Ong MEH. Development and validation of an interpretable machine learning scoring tool for estimating time to emergency readmissions. eClinicalMedicine 2022 Mar; 45: 101315.
• Xie F, Zhou J, Lee JW, Tan M, Li SQ, Rajnthern L, Chee ML, Chakraborty B, Wong AKI, Dagan A, Ong MEH, Gao F, Liu N. Benchmarking emergency department triage prediction models with machine learning and large public electronic health records. Scientific Data 2022 Oct; 9: 658. [Code]

IML Application: Obstetrics and Gynecology

• Tan HS, Liu N, Tan CW, Sia ATH, Sng BL. Developing the BreakThrough Pain Risk Score: an interpretable machine-learning-based risk score to predict breakthrough pain with labour epidural analgesia. Canadian Journal of Anesthesia 2022 Oct; 69(10): 1315-1317.

IML Application: Out-of-Hospital Cardiac Arrest

• Wong XY, Ang YK, Li K, Chin YH, Lam SSW, Tan KBK, Chua MCH, Ong MEH, Liu N, Pourghaderi AR, Ho AFW. Development and validation of the SARICA score to predict survival after return of spontaneous circulation in out of hospital cardiac arrest using an interpretable machine learning framework. Resuscitation 2022 Jan; 170: 126-133.
• Liu N, Liu M, Chen X, Ning Y, Lee JW, Siddiqui FJ, Saffari SE, Matthew M, Shin SD, Tanaka, Ho AFW, Ong MEH. Development and validation of interpretable prehospital return of spontaneous circulation (P-ROSC) score for out-of-hospital cardiac arrest patients using machine learning. eClinicalMedicine 2022 Jun; 48: 101422.

IML Application: Renal Medicine

• Ang Y, Li S, Ong MEH, Xie F, Teo SH, Choong L, Koniman R, Chakraborty B, Ho AFW, Liu N. Development and validation of an interpretable clinical score for early identification of acute kidney injury at the emergency department. Scientific Reports 2022 May; 12: 7111.

IML Application: Trauma

• Yu JY, Heo S, Xie F, Liu N, Yoon SY, Chang HS, Kim T, Lee SU, Ong MEH, Ng YY, Shin SD, Kajino K, Cha WC. Development and Asian-wide validation of the Grade for Interpretable Field Triage (GIFT) for predicting mortality in pre-hospital patients using the Pan-Asian Trauma Outcomes Study (PATOS). The Lancet Regional Health – Western Pacific 2023 May; 34: 100733.

AI in Health

AI Fairness & Ethics

• Liu M, Ning Y, Teixayavong S, Mertens M, Xu J, Ting DSW, Cheng LTE, Ong JCL, Teo ZL, Tan TF, RaviChandran N, Wang F, Celi LA, Ong MEH, Liu N. A translational perspective towards clinical AI fairness. npj Digital Medicine 2023 Sep; 6: 172.
• Yang R, Nair SV, Ke Y, D’Agostino D, Liu M, Ning Y, Liu N. Disparities in clinical studies of AI enabled applications from a global perspective. npj Digital Medicine 2024 Aug; 7: 209.
• Liu M, Ning Y, Ke Y, Shang Y, Chakraborty B, Ong MEH, Vaughan R, Liu N. FAIM: Fairness-aware interpretable modeling for trustworthy machine learning in healthcare. Patterns 2024 Sep. [Code]
• Ning Y, Teixayavong S, Shang Y, Savulescu J, Nagaraj V, Miao D, Mertens M, Ting DSW, Ong JCL, Liu M, Cao J, Dunn M, Vaughan R, Ong MEH, Sung JJY, Topol EJ, Liu N. Generative artificial intelligence and ethical considerations in health care: a scoping review and ethics checklist. The Lancet Digital Health 2024 Sep.
• Ning Y, Liu X, Collins GS, Moons KGM, McGradden M, Ting DSW, Ong JCL, Goldstein BA, Wagner SK, Keane PA, Topol EJ, Liu N. An ethics assessment tool for artificial intelligence implementation in healthcare: CARE-AI. Nature Medicine 2024 Oct.

Large Language Model & Generative AI

• Yang R, Tan TF, Lu W, Thirunavukarasu AJ, Ting DSW, Liu N. Large language models in health care: Development, applications, and challenges. Health Care Science 2023 Aug; 2(4): 255-263.

Time Series

• Panja M, Chakraborty T, Nadim SS, Ghosh I, Kumar U, Liu N. An ensemble neural network approach to forecast Dengue outbreak based on climatic condition. Chaos, Solitons and Fractals 2023 Feb; 167: 113124.
• Panja M, Chakraborty T, Kumar U, Liu N. Epicasting: An ensemble wavelet neural network for forecasting epidemics. Neural Networks 2023 Aug; 165: 185-212.

Viewpoint and Review

• Xie F, Yuan H, Ning Y, Ong MEH, Feng M, Hsu W, Chakraborty B, Liu N. Deep learning for temporal data representation in electronic health records: A systematic review of challenges and methodologies. Journal of Biomedical Informatics 2022 Feb; 126: 103980.
• Volovici V, Syn NL, Ercole A, Zhao JJ, Liu N. Steps to avoid overuse and misuse of machine learning in clinical research. Nature Medicine 2022 Oct; 28(10): 1996-1999.
• Liu M, Li S, Yuan H, Ong MEH, Ning Y, Xie F, Saffari SE, Shang Y, Volovici V, Chakraborty B, Liu N. Handling missing values in healthcare data: A systematic review of deep learning-based imputation techniques. Artificial Intelligence in Medicine 2023 Aug; 142: 102587.
• Li S, Liu P, Nascimento G, Wang X, Leite FRM, Chakraborty B, Hong C, Ning Y, Xie F, Teo ZL, Ting DSW, Haddadi H, Ong MEH, Peres MA, Liu N. Federated and distributed learning applications for electronic health records and structured medical data: A scoping review. Journal of the American Medical Informatics Association 2023.

Biomedical Engineering

HRV (Heart Rate Variability)

• Liu N, Guo DG, Koh ZX, Ho AFW, Xie F, Tagami T, Sakamoto JT, Pek PP, Chakraborty B, Lim SH, Tan JWC, Ong MEH. Heart rate n-variability (HRnV) with its application to risk stratification of chest pain patients in the emergency department. BMC Cardiovascular Disorders 2020; 20: 168. [Code]
• Niu C, Guo D, Ong MEH, Koh ZX, Marie-Alix GAL, Ho AFW, Lin Z, Liu C, Clifford DG, Liu N. HRnV-Calc: A software for heart rate n-variability and heart rate variability analysis. Journal of Open Source Software 2023 May; 8(85): 5391. [Code]

HRV Application

• Liu N, Lin Z, Cao J, Koh ZX, Zhang T, Huang GB, Ser W, Ong MEH. An intelligent scoring system and its application to cardiac arrest prediction. IEEE Transactions on Information Technology in Biomedicine 2012; 16(6): 1324-1331.
• Liu N, Koh ZX, Chua EC, Tan LM, Lin Z, Mirza B, Ong MEH. Risk scoring for prediction of acute cardiac complications from imbalanced clinical data. IEEE Journal of Biomedical and Health Informatics 2014; 18(6): 1894-1902.
• Liu N, Koh ZX, Goh J, Lin Z, Haaland B, Ting BP, Ong MEH. Prediction of adverse cardiac events in emergency department patients with chest pain using machine learning for variable selection. BMC Medical Informatics and Decision Making 2014; 14(1): 75.
• Liu T, Lin Z, Ong MEH, Koh ZX, Pek PP, Yeo YK, Oh B, Ho AFW, Liu N. Manifold ranking based scoring system with its application to cardiac arrest prediction: a retrospective study in emergency department patients. Computers in Biology and Medicine 2015; 67: 74-82.
• Heldeweg MLA, Liu N, Koh ZX, Fook-Chong S, Lye WK, Harms M, Ong MEH. A novel cardiovascular risk stratification model incorporating ECG and heart rate variability for patients presenting to the emergency department with chest pain. Critical Care 2016; 20(1): 179.
• Liu N, Sakamoto JT, Cao J, Koh ZX, Ho AFW, Lin Z, Ong MEH. Ensemble-based risk scoring with extreme learning machine for prediction of adverse cardiac events. Cognitive Computation 2017; 9(4): 545-554.
• Sakamoto JT, Liu N, Koh ZX, Guo DG, Heldeweg MLA, Ng JCJ, Ong MEH. Integrating heart rate variability, vital signs, electrocardiogram, and troponin to triage chest pain patients in the ED. American Journal of Emergency Medicine 2018; 36(2): 185-192.23.
• Liu N, Chee ML, Koh ZX, Leow SL, Ho AFW, Guo DG, Ong MEH. Utilizing machine learning dimensionality reduction for risk stratification of chest pain patients in the emergency department. BMC Medical Research Methodology 2021 Apr; 21: 74.
• Liu N, Chee ML, Foo M, Pong JZ, Guo DG, Koh ZX, Niu C, Chong SL, Ong MEH. Heart rate n-variability (HRnV) measures for prediction of mortality in sepsis patients presenting at the emergency department. PLOS ONE 2021 Aug; 16(8): e0249868.