Analysis of information sources in references of the Wikipedia article "正規化線形関数" in Japanese language version.
Rectifier and softplus activation functions. The second one is a smooth version of the first.
Since the sigmoid h has a positive first derivative, its primitive, which we call softplus, is convex