US Patent Issued to SAMSUNG ELECTRONICS on May 13 for "Efficiency of vision transformers with adaptive token pruning" (California Inventors)

ALEXANDRIA, Va., June 12 -- United States Patent no. 12,299,960, issued on May 13, was assigned to SAMSUNG ELECTRONICS Co. LTD. (South Korea).

"Efficiency of vision transformers with adaptive token pruning" was invented by Ling Li (Sunnyvale, Calif.) and Ali Shafiee Ardestani (Santa Clara, Calif.).

According to the abstract* released by the U.S. Patent & Trademark Office: "A system and a method are disclosed for training a vision transformer. A token distillation loss of an input image based on a teacher network classification token and a token importance score of a student network (the vision transformer during training) are determined at a pruning layer of the vision transformer. When a current epoch number is odd, sparsification of tok...