US Patent Issued to Microsoft Technology Licensing on April 15 for "Cross-attention between sparse external features and contextual word embeddings to improve text classification" (Canadian Inventors)

ALEXANDRIA, Va., June 5 -- United States Patent no. 12,277,391, issued on April 15, was assigned to Microsoft Technology Licensing LLC (Redmond, Wash.).

"Cross-attention between sparse external features and contextual word embeddings to improve text classification" was invented by Jean-Michel Attendu (Montreal, Canada), Alexandre Jules Dos Santos (Montreal, Canada) and Francois Duplessis Beaulieu (Montreal, Canada).

According to the abstract* released by the U.S. Patent & Trademark Office: "There is provided a method that includes obtaining (a) a dense representation of external features, (b) a dense representation of text, and (c) a mask that associates the external features to tokens of the text, and employing a cross-attention process ...