 |
||||||||
Hyperbolic Tangent (Tanh) function - Python Automation and Machine Learning for ICs - - An Online Book - |
||||||||
| Python Automation and Machine Learning for ICs http://www.globalsino.com/ICs/ | ||||||||
| Chapter/Index: Introduction | A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z | Appendix | ||||||||
================================================================================= The term "sigmoid" is a more general term that refers to any S-shaped curve. The Tanh activation function is defined as follows: This function squashes input values to be in the range (−1,1), mapping large positive values to close to 1 and large negative values to close to -1. The function is zero-centered, which can help mitigate the vanishing gradient problem compared to the sigmoid function. The logistic function is an example of a sigmoid function because it has an S-shaped curve when plotted. Other sigmoid functions include the hyperbolic tangent function (tanh) and the arctangent function (arctan), among others (see Figure 3729a).
============================================
|
||||||||
| ================================================================================= | ||||||||
|
|
||||||||
------------------------------- [3729] 