US Patent Issued to Oracle International on Sept. 9 for "Path dropout for natural language processing" (Australian Inventors)

ALEXANDRIA, Va., Sept. 10 -- United States Patent no. 12,412,563, issued on Sept. 9, was assigned to Oracle International Corp. (Redwood Shores, Calif.).

"Path dropout for natural language processing" was invented by Thanh Tien Vu (Brisbane, Australia), Tuyen Quang Pham (Melbourne, Australia), Mark Edward Johnson (Sydney) and Thanh Long Duong (Melbourne, Australia).

According to the abstract* released by the U.S. Patent & Trademark Office: "Techniques are provided for improved training of a machine-learning model that includes multiple layers and is configured to process textual language input. The machine-learning model includes one or more blocks in which each block includes a multi-head self-attention network, a first connection for pr...