US Patent Issued to Oracle International on Dec. 30 for "Fine-tuning multi-head network from a single transformer layer of pre-trained language model" (Australian Inventors)

ALEXANDRIA, Va., Dec. 31 -- United States Patent no. 12,512,091, issued on Dec. 30, was assigned to Oracle International Corp. (Redwood Shores, Calif.).

"Fine-tuning multi-head network from a single transformer layer of pre-trained language model" was invented by Thanh Tien Vu (Brisbane, Australia), Tuyen Quang Pham (Springvale, Australia), Omid Mohamed Nezami (Sydney), Mark Edward Johnson (Sydney), Thanh Long Duong (Seabrook, Australia) and Cong Duy Vu Hoang (Wantirna South, Australia).

According to the abstract* released by the U.S. Patent & Trademark Office: "Techniques are provided for customizing or fine-tuning a pre-trained version of a machine-learning model that includes multiple layers and is configured to process audio or textua...