US Patent Issued to Inventus Holdings on March 25 for "Caching large language model (LLM) responses using hybrid retrieval and reciprocal rank fusion" (Florida Inventors)

ALEXANDRIA, Va., March 26 -- United States Patent no. 12,259,913, issued on March 25, was assigned to Inventus Holdings LLC (Juno Beach, Fla.).

"Caching large language model (LLM) responses using hybrid retrieval and reciprocal rank fusion" was invented by Brien H Muschett (Palm Beach Gardens, Fla.) and Justin G Odom (Jupiter, Fla.).

According to the abstract* released by the U.S. Patent & Trademark Office: "A system and method for improving computer functionality by retrieving answers/responses to questions/input from a cache such as those used with chatbots and generative AI systems. Disclosed is a multi-layered caching strategy that focuses on the relevance of a cache hit by improving the quality of the answer. The approach demonstrate...