US Patent Issued to Microsoft Technology Licensing on Jan. 13 for "Hybrid inference system for COGS reduction" (Washington Inventors)

ALEXANDRIA, Va., Jan. 13 -- United States Patent no. 12,524,210, issued on Jan. 13, was assigned to Microsoft Technology Licensing LLC (Redmond, Wash.).

"Hybrid inference system for COGS reduction" was invented by Shengyu Fu (Redmond, Wash.), Jin Woo Jang (Kirkland, Wash.), Neelakantan Sundaresan (Bellevue, Wash.) and Alexey Svyatkovskiy (Bellevue, Wash.).

According to the abstract* released by the U.S. Patent & Trademark Office: "A hybrid inference system for a coding assistant utilizes a routing model to predict whether output generated by a large language model for a given prompt would be accepted by a user of the coding assistant. The routing model routes the prompt when the routing model indicates that the output generated by the lar...