- Statistics for Machine Learning
- Pratap Dangeti
- 300字
- 2021-07-02 19:05:54
Steps in machine learning model development and deployment
The development and deployment of machine learning models involves a series of steps that are almost similar to the statistical modeling process, in order to develop, validate, and implement machine learning models. The steps are as follows:
- Collection of data: Data for machine learning is collected directly from structured source data, web scrapping, API, chat interaction, and so on, as machine learning can work on both structured and unstructured data (voice, image, and text).
- Data preparation and missing/outlier treatment: Data is to be formatted as per the chosen machine learning algorithm; also, missing value treatment needs to be performed by replacing missing and outlier values with the mean/median, and so on.
- Data analysis and feature engineering: Data needs to be analyzed in order to find any hidden patterns and relations between variables, and so on. Correct feature engineering with appropriate business knowledge will solve 70 percent of the problems. Also, in practice, 70 percent of the data scientist's time is spent on feature engineering tasks.
- Train algorithm on training and validation data: Post feature engineering, data will be divided into three chunks (train, validation, and test data) rather than two (train and test) in statistical modeling. Machine learning are applied on training data and the hyperparameters of the model are tuned based on validation data to avoid overfitting.
- Test the algorithm on test data: Once the model has shown a good enough performance on train and validation data, its performance will be checked against unseen test data. If the performance is still good enough, we can proceed to the next and final step.
- Deploy the algorithm: Trained machine learning algorithms will be deployed on live streaming data to classify the outcomes. One example could be recommender systems implemented by e-commerce websites.
推薦閱讀
- 程序員面試筆試寶典(第3版)
- 小程序?qū)崙?zhàn)視頻課:微信小程序開發(fā)全案精講
- Machine Learning with R Cookbook(Second Edition)
- Magento 2 Theme Design(Second Edition)
- 碼上行動(dòng):零基礎(chǔ)學(xué)會(huì)Python編程(ChatGPT版)
- Functional Programming in JavaScript
- 微信小程序項(xiàng)目開發(fā)實(shí)戰(zhàn)
- Solr Cookbook(Third Edition)
- Getting Started with Python and Raspberry Pi
- Hands-On Kubernetes on Windows
- C++ Fundamentals
- Unity 2017 Game AI Programming(Third Edition)
- SAP Web Dynpro for ABAP開發(fā)技術(shù)詳解:基礎(chǔ)應(yīng)用
- Java Script從入門到精通(第5版)
- Swift iOS Programming for Kids