官术网_书友最值得收藏!

Machine learning losses

The loss function or cost function in machine learning is a function that maps the values of variables onto a real number intuitively representing some cost associated with the variable values. Optimization methods are applied to minimize the loss function by changing the parameter values, which is the central theme of machine learning.

Zero-one loss is L0-1 = 1 (m <= 0); in zero-one loss, value of loss is 0 for m >= 0 whereas 1 for m < 0. The difficult part with this loss is it is not differentiable, non-convex, and also NP-hard. Hence, in order to make optimization feasible and solvable, these losses are replaced by different surrogate losses for different problems.

Surrogate losses used for machine learning in place of zero-one loss are given as follows. The zero-one loss is not differentiable, hence approximated losses are being used instead:

  • Squared loss (for regression)
  • Hinge loss (SVM)
  • Logistic/log loss (logistic regression)

Some loss functions are as follows:

主站蜘蛛池模板: 和林格尔县| 颍上县| 侯马市| 凤城市| 麦盖提县| 彝良县| 衡南县| 玉环县| 荥经县| 温州市| 高陵县| 大渡口区| 钟祥市| 宁河县| 义马市| 自治县| 昌图县| 双鸭山市| 禹州市| 新津县| 仁化县| 姚安县| 本溪| 五寨县| 禹城市| 新邵县| 陆川县| 潢川县| 湘潭市| 上饶市| 克拉玛依市| 巫山县| 云和县| 五台县| 玉门市| 河源市| 仁寿县| 江西省| 佛教| 保靖县| 阳山县|