ALEXANDRIA, Va., Feb. 11 -- United States Patent no. 12,548,317, issued on Feb. 10, was assigned to SAMSUNG ELECTRONICS Co. Ltd. (Suwon-si, South Korea).
"Structured pruning of vision transformer" was invented by Miao Yin (Plainsboro, N.J.), Burak Uzkent (Sunnyvale, Calif.), Yilin Shen (San Jose, Calif.) and Hongxia Jin (San Jose, Calif.).
According to the abstract* released by the U.S. Patent & Trademark Office: "In one embodiment, a method includes accessing a batch B of a plurality of images, wherein each image in the batch is part of a training set of images used to train a vision transformer comprising a plurality of attention heads. The method further includes determining, for each attention head A, a similarity between (1) the outp...