US Patent Issued to Microsoft Technology Licensing on Aug. 5 for "Forcing weights of transformer model layers" (California, Washington Inventors)

ALEXANDRIA, Va., Aug. 6 -- United States Patent no. 12,380,332, issued on Aug. 5, was assigned to Microsoft Technology Licensing LLC (Redmond, Wash.).

"Forcing weights of transformer model layers" was invented by Andy Wagner (Cupertino, Calif.), Tiyasa Mitra (San Jose, Calif.) and Marc Tremblay (Bellevue, Wash.).

According to the abstract* released by the U.S. Patent & Trademark Office: "Embodiments of the present disclosure include systems and methods for forcing weights of transformer model layers when training a transformer model. In some embodiments, input data is received at a first layer included in a transformer model. The input data is processed through the first layer of the transformer model to produce a first output data. The f...