US Patent Issued to GOOGLE on Jan. 27 for "Smooth continuous piecewise constructed activation functions" (California, Pennsylvania Inventors)

ALEXANDRIA, Va., Jan. 28 -- United States Patent no. 12,536,426, issued on Jan. 27, was assigned to GOOGLE LLC (Mountain View, Calif.).

"Smooth continuous piecewise constructed activation functions" was invented by Gil Shamir (Sewickley, Pa.), Dong Lin (Mountain View, Calif.) and Sergey Ioffe (San Francisco).

According to the abstract* released by the U.S. Patent & Trademark Office: "Aspects of the present disclosure are directed to novel activation functions which enable improved reproducibility and accuracy tradeoffs in neural networks. In particular, the present disclosure provides a family of activation functions that, on one hand, are smooth with continuous gradient and optionally monotonic but, on the other hand, also mimic the math...