US Patent Issued to DeepMind Technologies on July 8 for "Gated attention neural networks" (British, Swiss Inventors)

ALEXANDRIA, Va., July 9 -- United States Patent no. 12,353,976, issued on July 8, was assigned to DeepMind Technologies Ltd. (London).

"Gated attention neural networks" was invented by Emilio Parisotto (London), Hasuk Song (London), Jack William Rae (London), Siddhant Madhu Jayakumar (London), Maxwell Elliot Jaderberg (London), Razvan Pascanu (Letchworth Garden City, Great Britain) and Caglar Gulcehre (Lausanne, Switzerland).

According to the abstract* released by the U.S. Patent & Trademark Office: "A system including an attention neural network that is configured to receive an input sequence and to process the input sequence to generate an output is described. The attention neural network includes: an attention block configured to recei...