ALEXANDRIA, Va., June 16 -- United States Patent no. 12,306,906, issued on May 20, was assigned to Microsoft Technology Licensing LLC (Redmond, Wash.).
"Adaptive token sampling for efficient transformer" was invented by Mohsen Fayyaz (Bonn, Germany), Soroush Abbasi Koohpayegani (Baltimore), Eric Chris Wolfgang Sommerlade (Oxford, Great Britain) and Hamidreza Vaezi Joze (Redmond, Wash.).
According to the abstract* released by the U.S. Patent & Trademark Office: "A transformer is described herein for using transformer-based technology to process data items (e.g., image items). The transformer increases the efficiency of the transformer-based technology by using a modified attention component. In operation, the modified attention component a...