US Patent Issued to FRIENDLIAI on Jan. 13 for "Dynamic batching for inference system for transformer-based generation tasks" (South Korean Inventors)

ALEXANDRIA, Va., Jan. 13 -- United States Patent no. 12,524,266, issued on Jan. 13, was assigned to FRIENDLIAI CORP. (Redwood City, Calif.).

"Dynamic batching for inference system for transformer-based generation tasks" was invented by Gyeongin Yu (Seoul, South Korea), Geon-Woo Kim (Seoul, South Korea), Joo Seong Jeong (Seoul, South Korea), Soojeong Kim (Seoul, South Korea) and Byung-Gon Chun (Seoul, South Korea).

According to the abstract* released by the U.S. Patent & Trademark Office: "An inference system applies a machine-learning transformer model to a batch of requests with variable input length or variable target length or variable internal sate length by selectively batching a subset of operations in the transformer model but proc...