ALEXANDRIA, Va., Jan. 28 -- United States Patent no. 12,536,408, issued on Jan. 27, was assigned to Google LLC (Mountain View, Calif.).
"Universal transformers" was invented by Mostafa Dehghani (Amsterdam), Stephan Gouws (Barking, Great Britain), Oriol Vinyals (London), Jakob D. Uszkoreit (Berlin) and Lukasz Mieczyslaw Kaiser (San Francisco).
According to the abstract* released by the U.S. Patent & Trademark Office: "Methods, systems, and apparatus, including computer programs encoded on computer storage media, for implementing a sequence-to-sequence model that is recurrent in depth while employing self-attention to combine information from different parts of sequences."
The patent was filed on Dec. 18, 2023, under Application No. 18/544...