Accelerating Hyperparameter Tuning in Machine Learning for Alzheimer's Disease With High Performance Computing

Date

2021-12-08

Authors

Zhang, Fan
Petersen, Melissa E.
Johnson, Leigh A.
Hall, James R.
O'Bryant, Sid E.

ORCID

0000-0003-0582-5266 (O'Bryant, Sid E.)
0000-0001-7769-8417 (Johnson, Leigh A.)
0000-0002-3920-5877 (Petersen, Melissa E.)

Journal Title

Journal ISSN

Volume Title

Publisher

Frontiers Media S.A.

Abstract

Driven by massive datasets that comprise biomarkers from both blood and magnetic resonance imaging (MRI), the need for advanced learning algorithms and accelerator architectures, such as GPUs and FPGAs has increased. Machine learning (ML) methods have delivered remarkable prediction for the early diagnosis of Alzheimer's disease (AD). Although ML has improved accuracy of AD prediction, the requirement for the complexity of algorithms in ML increases, for example, hyperparameters tuning, which in turn, increases its computational complexity. Thus, accelerating high performance ML for AD is an important research challenge facing these fields. This work reports a multicore high performance support vector machine (SVM) hyperparameter tuning workflow with 100 times repeated 5-fold cross-validation for speeding up ML for AD. For demonstration and evaluation purposes, the high performance hyperparameter tuning model was applied to public MRI data for AD and included demographic factors such as age, sex and education. Results showed that computational efficiency increased by 96%, which helped to shed light on future diagnostic AD biomarker applications. The high performance hyperparameter tuning model can also be applied to other ML algorithms such as random forest, logistic regression, xgboost, etc.

Description

Citation

Zhang, F., Petersen, M., Johnson, L., Hall, J., & O'Bryant, S. E. (2021). Accelerating Hyperparameter Tuning in Machine Learning for Alzheimer's Disease With High Performance Computing. Frontiers in artificial intelligence, 4, 798962. https://doi.org/10.3389/frai.2021.798962