US Patent Issued to THE BANK OF NEW YORK MELLON on Dec. 23 for "Differential attention for neural networks" (New York, Pennsylvania, New Jersey Inventors)

ALEXANDRIA, Va., Dec. 23 -- United States Patent no. 12,505,310, issued on Dec. 23, was assigned to THE BANK OF NEW YORK MELLON (New York).

"Differential attention for neural networks" was invented by Christopher Policastro (Wynnewood, Pa.), Yikai Feng (New York) and Abhinav Prasad (Edison, N.J.).

According to the abstract* released by the U.S. Patent & Trademark Office: "The disclosure relates to systems and methods of improved attention for neural networks. A system may access a first array of entries and a second array of entries, wherein the first array represents a first word embedding generated from one or more first characters of an input and the second array represents a second word embedding from the one or more second characters...