官术网_书友最值得收藏!

Tanh or hyperbolic tangent function

The mathematical formula of tanh is as follows:

Its output is centered at zero with a range of -1 to 1. Therefore, optimization is easier and thus in practice, it is preferred over a sigmoid activation function. However, it still suffers from the vanishing gradient problem.

主站蜘蛛池模板: 玉溪市| 称多县| 社会| 东阳市| 绩溪县| 沿河| 邻水| 如东县| 合水县| 合阳县| 广饶县| 汕尾市| 彭阳县| 阜阳市| 沙洋县| 霍山县| 镇坪县| 太和县| 乌恰县| 德庆县| 重庆市| 顺昌县| 密云县| 石河子市| 肇源县| 三门县| 景洪市| 汉中市| 页游| 福贡县| 邵武市| 儋州市| 牡丹江市| 揭阳市| 绍兴县| 泰宁县| 资中县| 定襄县| 盘山县| 洛扎县| 砀山县|