ALEXANDRIA, Va., Feb. 26 -- United States Patent no. 12,236,206, issued on Feb. 25, was assigned to Meta Platforms Inc. (Menlo Park, Calif.).

"Pretraining a language machine-learning model" was invented by Michael William Lewis (Seattle), Marjan Ghazvini Nejad (Seattle), Gargi Ghosh (Bellevue, Wash.), Armen Aghajanyan (Bellevue, Wash.), Sida Wang (Bellevue, Wash.) and Luke Zettlemoyer (Seattle).

According to the abstract* released by the U.S. Patent & Trademark Office: "In one embodiment, a method includes accessing a first document, accessing a plurality of second documents, calculating a relevance score for each of the plurality of second documents indicating a degree of relevance of the second document to the first document using an en...