US Patent Issued to Microsoft Technology Licensing on March 25 for "Transformer-based neural network including a mask attention network" (American, Chinese Inventors)

ALEXANDRIA, Va., March 26 -- United States Patent no. 12,260,338, issued on March 25, was assigned to Microsoft Technology Licensing LLC (Redmond, Wash.).

"Transformer-based neural network including a mask attention network" was invented by Jian Jiao (Bellevue, Wash.), Yeyun Gong (Beijing), Nan Duan (Beijing), Ruofei Zhang (Mountain View, Calif.) and Ming Zhou (Beijing).

According to the abstract* released by the U.S. Patent & Trademark Office: "A transformer-based neural network includes at least one mask attention network (MAN). The MAN computes an original attention data structure that expresses influence between pairs of data items in a sequence of data items. The MAN then modifies the original data structure by mask values in a mask ...