US Patent Issued to Google on Sept. 23 for "Attention neural networks with N-grammer layers" (California Inventors)

ALEXANDRIA, Va., Sept. 23 -- United States Patent no. 12,423,518, issued on Sept. 23, was assigned to Google LLC (Mountain View, Calif.).

"Attention neural networks with N-grammer layers" was invented by Rohan Anil (San Francisco) and Aurko Roy (San Francisco).

According to the abstract* released by the U.S. Patent & Trademark Office: "Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for performing a machine learning task on a network input to generate a network output. In one aspect, one of the systems includes a neural network configured to perform the machine learning task, the neural network comprising an N-grammer layer and an output neural network, the N-grammer layer configured to: ...