官术网_书友最值得收藏!

Machine learning losses

The loss function or cost function in machine learning is a function that maps the values of variables onto a real number intuitively representing some cost associated with the variable values. Optimization methods are applied to minimize the loss function by changing the parameter values, which is the central theme of machine learning.

Zero-one loss is L0-1 = 1 (m <= 0); in zero-one loss, value of loss is 0 for m >= 0 whereas 1 for m < 0. The difficult part with this loss is it is not differentiable, non-convex, and also NP-hard. Hence, in order to make optimization feasible and solvable, these losses are replaced by different surrogate losses for different problems.

Surrogate losses used for machine learning in place of zero-one loss are given as follows. The zero-one loss is not differentiable, hence approximated losses are being used instead:

  • Squared loss (for regression)
  • Hinge loss (SVM)
  • Logistic/log loss (logistic regression)

Some loss functions are as follows:

主站蜘蛛池模板: 积石山| 漳浦县| 济宁市| 漳浦县| 安图县| 永善县| 兴城市| 云和县| 饶平县| 麻阳| 富裕县| 西充县| 景泰县| 华宁县| 察雅县| 丘北县| 黄陵县| 普宁市| 武乡县| 德庆县| 辽阳县| 庆城县| 青岛市| 玉门市| 渭南市| 平潭县| 武义县| 饶平县| 九寨沟县| 黄陵县| 清水河县| 都昌县| 武冈市| 绥宁县| 三门峡市| 东方市| 商河县| 连云港市| 启东市| 额尔古纳市| 万年县|