US Patent Issued to MICROSOFT TECHNOLOGY LICENSING on Feb. 17 for "KV cache block-quantization oriented data handling" (Israeli Inventors)

ALEXANDRIA, Va., Feb. 17 -- United States Patent no. 12,554,398, issued on Feb. 17, was assigned to MICROSOFT TECHNOLOGY LICENSING LLC (Redmond, Wash.).

"KV cache block-quantization oriented data handling" was invented by Ori Laslo (Rehovot, Israel) and Gilad Kirshenboim (Petach Tiqva, Israel).

According to the abstract* released by the U.S. Patent & Trademark Office: "A computing system for performing runtime data handling optimization for generative models is provided. The computing system comprises at least one processor and memory comprising a first memory and a second memory, wherein the memory stores instructions that, when executed by the at least one processor, cause the at least one processor to execute a generative model. The co...