US Patent Issued to Salesforce on Nov. 4 for "Parameter utilization for language pre-training" (Singaporean, American Inventors)

ALEXANDRIA, Va., Nov. 6 -- United States Patent no. 12,461,993, issued on Nov. 4, was assigned to Salesforce Inc. (San Francisco).

"Parameter utilization for language pre-training" was invented by Chen Xing (Palo Alto, Calif.), Wenhao Liu (Redwood City, Calif.), Chu Hong Hoi (Singapore), Nitish Shirish Keskar (San Francisco) and Caiming Xiong (Menlo Park, Calif.).

According to the abstract* released by the U.S. Patent & Trademark Office: "Embodiments are directed to pre-training a transformer model using more parameters for sophisticated patterns (PSP++). The transformer model is divided into a held-out model and a main model. A forward pass and a backward pass are performed on the held-out model, where the forward pass determines self-at...