US Patent Issued to Microsoft Technology Licensing on Sept. 9 for "Token packing for sequence models" (California, Washington Inventors)

ALEXANDRIA, Va., Sept. 10 -- United States Patent no. 12,412,035, issued on Sept. 9, was assigned to Microsoft Technology Licensing LLC (Redmond, Wash.).

"Token packing for sequence models" was invented by Andy Wagner (Cupertino, Calif.), Tiyasa Mitra (San Jose, Calif.) and Marc Tremblay (Bellevue, Wash.).

According to the abstract* released by the U.S. Patent & Trademark Office: "Embodiments of the present disclosure include systems and methods for packing tokens to train sequence models. In some embodiments, a plurality of datasets for training a sequence model is received. Each dataset in the plurality of datasets includes a sequence of correlated tokens. A set of training data is generated that includes a subset of a sequence of token...