官术网_书友最值得收藏!

Steps in machine learning model development and deployment

The development and deployment of machine learning models involves a series of steps that are almost similar to the statistical modeling process, in order to develop, validate, and implement machine learning models. The steps are as follows:

  1. Collection of data: Data for machine learning is collected directly from structured source data, web scrapping, API, chat interaction, and so on, as machine learning can work on both structured and unstructured data (voice, image, and text).
  2. Data preparation and missing/outlier treatment: Data is to be formatted as per the chosen machine learning algorithm; also, missing value treatment needs to be performed by replacing missing and outlier values with the mean/median, and so on.
  3. Data analysis and feature engineering: Data needs to be analyzed in order to find any hidden patterns and relations between variables, and so on. Correct feature engineering with appropriate business knowledge will solve 70 percent of the problems. Also, in practice, 70 percent of the data scientist's time is spent on feature engineering tasks.
  4. Train algorithm on training and validation data: Post feature engineering, data will be divided into three chunks (train, validation, and test data) rather than two (train and test) in statistical modeling. Machine learning are applied on training data and the hyperparameters of the model are tuned based on validation data to avoid overfitting.
  1. Test the algorithm on test data: Once the model has shown a good enough performance on train and validation data, its performance will be checked against unseen test data. If the performance is still good enough, we can proceed to the next and final step.
  2. Deploy the algorithm: Trained machine learning algorithms will be deployed on live streaming data to classify the outcomes. One example could be recommender systems implemented by e-commerce websites.
主站蜘蛛池模板: 张家港市| 桦南县| 桃园县| 浦县| 射阳县| 三亚市| 永昌县| 嘉善县| 吉木乃县| 鹤庆县| 宣武区| 合肥市| 澄江县| 永胜县| 华安县| 紫云| 崇州市| 三都| 汝阳县| 万源市| 湖州市| 西丰县| 延寿县| 搜索| 乌拉特后旗| 仪陇县| 石台县| 安龙县| 汶上县| 邮箱| 嘉祥县| 贵阳市| 同德县| 伽师县| 都匀市| 余干县| 荔波县| 大竹县| 海盐县| 宣城市| 珠海市|