- Deep Learning with PyTorch
- Vishnu Subramanian
- 53字
- 2021-06-24 19:16:27
Tanh
The tanh non-linearity function squashes a real-valued number in the range of -1 and 1. The tanh also faces the same issue of saturating gradients when tanh outputs extreme values close to -1 and 1. However, it is preferred to sigmoid, as the output of tanh is zero centered:
Image source: http://datareview.info/article/eto-nuzhno-znat-klyuchevyie-rekomendatsii-po-glubokomu-obucheniyu-chast-2/
推薦閱讀
- ATmega16單片機項目驅動教程
- 深入理解Spring Cloud與實戰
- INSTANT Wijmo Widgets How-to
- 深入淺出SSD：固態存儲核心技術、原理與實戰（第2版）
- 電腦軟硬件維修從入門到精通
- 微服務分布式架構基礎與實戰：基于Spring Boot + Spring Cloud
- 固態存儲：原理、架構與數據安全
- OpenGL Game Development By Example
- Wireframing Essentials
- Spring Security 3.x Cookbook
- IP網絡視頻傳輸：技術、標準和應用
- 嵌入式系統原理及應用：基于ARM Cortex-M4體系結構
- 可編程邏輯器件項目開發設計
- Blender 3D By Example
- USB應用開發寶典