官术网_书友最值得收藏!

Machine learning losses

The loss function or cost function in machine learning is a function that maps the values of variables onto a real number intuitively representing some cost associated with the variable values. Optimization methods are applied to minimize the loss function by changing the parameter values, which is the central theme of machine learning.

Zero-one loss is L0-1 = 1 (m <= 0); in zero-one loss, value of loss is 0 for m >= 0 whereas 1 for m < 0. The difficult part with this loss is it is not differentiable, non-convex, and also NP-hard. Hence, in order to make optimization feasible and solvable, these losses are replaced by different surrogate losses for different problems.

Surrogate losses used for machine learning in place of zero-one loss are given as follows. The zero-one loss is not differentiable, hence approximated losses are being used instead:

  • Squared loss (for regression)
  • Hinge loss (SVM)
  • Logistic/log loss (logistic regression)

Some loss functions are as follows:

主站蜘蛛池模板: 尼木县| 濉溪县| 海阳市| 泾源县| 康乐县| 澳门| 康平县| 色达县| 富裕县| 扶沟县| 庆安县| 白河县| 博爱县| 腾冲县| 香河县| 新闻| 东至县| 五台县| 凤城市| 沽源县| 托里县| 正宁县| 扶绥县| 玉田县| 商南县| 临西县| 大同市| 田林县| 安达市| 无为县| 荥阳市| 奇台县| 宁晋县| 昌平区| 滨海县| 社旗县| 江川县| 莎车县| 石阡县| 琼结县| 天门市|