Data Management for Machine Learning: A Survey

Chengliang Chai, Jiayi Wang, Yuyu Luo*, Zeping Niu, Guoliang Li*

*此作品的通讯作者

科研成果: 期刊稿件文章同行评审

32 引用 (Scopus)

摘要

Machine learning (ML) has widespread applications and has revolutionized many industries, but suffers from several challenges. First, sufficient high-quality training data is inevitable for producing a well-performed model, but the data is always human expensive to acquire. Second, a large amount of training data and complicated model structures lead to the inefficiency of training and inference. Third, given an ML task, one always needs to train lots of models, which are hard to manage in real applications. Fortunately, database techniques can benefit ML by addressing the above three challenges. In this paper, we review existing studies from the following three aspects along with the pipeline highly related to ML. (1) Data preparation (Pre-ML): it focuses on preparing high-quality training data that can improve the performance of the ML model, where we review data discovery, data cleaning and data labeling. (2) Model training & inference (In-ML): researchers in ML community focus on improving the model performance during training, while in this survey we mainly study how to accelerate the entire training process, also including feature selection and model selection. (3) Model management (Post-ML): in this part, we survey how to store, query, deploy and debug the models after training. Finally, we provide research challenges and future directions.

源语言英语
页(从-至)4646-4667
页数22
期刊IEEE Transactions on Knowledge and Data Engineering
35
5
DOI
出版状态已出版 - 1 5月 2023
已对外发布

指纹

探究 'Data Management for Machine Learning: A Survey' 的科研主题。它们共同构成独一无二的指纹。

引用此

Chai, C., Wang, J., Luo, Y., Niu, Z., & Li, G. (2023). Data Management for Machine Learning: A Survey. IEEE Transactions on Knowledge and Data Engineering, 35(5), 4646-4667. https://doi.org/10.1109/TKDE.2022.3148237