US Patent Issued to Google on March 18 for "Attention neural networks with linear units" (California Inventor)

ALEXANDRIA, Va., March 19 -- United States Patent no. 12,254,411, issued on March 18, was assigned to Google LLC (Mountain View, Calif.).

"Attention neural networks with linear units" was invented by Noam M. Shazeer (Palo Alto, Calif.).

According to the abstract* released by the U.S. Patent & Trademark Office: "Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for performing a machine learning task on a network input to generate a network output. In one aspect, one of the systems includes an attention neural network configured to perform the machine learning task, the attention neural network including one or more attention layers, each attention layer comprising an attention sub-layer and ...