US Patent Issued to QUALCOMM on July 29 for "Speculative decoding in autoregressive generative artificial intelligence models" (Canadian, American Inventors)

ALEXANDRIA, Va., July 30 -- United States Patent no. 12,373,494, issued on July 29, was assigned to QUALCOMM Inc. (San Diego).

"Speculative decoding in autoregressive generative artificial intelligence models" was invented by Christopher Lott (San Diego), Mingu Lee (San Diego), Wonseok Jeon (San Diego) and Roland Memisevic (Toronto).

According to the abstract* released by the U.S. Patent & Trademark Office: "Certain aspects of the present disclosure provide techniques and apparatus for generating a response to a query input in a generative artificial intelligence model. An example method generally includes receiving a plurality of sets of tokens generated based on an input prompt and a first generative artificial intelligence model, each ...