常用的激活函数总结
激活函数名表达式导数表达式sigmoidf(x)11e−x\frac{1}{1e^-x}1e−x1f’(x)f(x)(1-f(x))Tanhf(x) tanh(x) ex−e−xexe−x\frac{e^x-e^-x}{e^xe^-x}exe−xex−e−xf’(x)1-((fx))2((fx))^2((fx))2Reluf(x)max(0,x){0x≤0xx>0f(x)max(0,x) \begin{cases}0&\te…
2026/7/28 18:18:59