US Patent Issued to Huawei Technologies'Co., 'Ltd.' on Dec. 23 for "Methods, devices and media for improving knowledge distillation using intermediate representations" (Canadian Inventors)

ALEXANDRIA, Va., Dec. 23 -- United States Patent no. 12,505,351, issued on Dec. 23, was assigned to Huawei Technologies'Co.'Ltd.' (Shenzhen., China).

"Methods, devices and media for improving knowledge distillation using intermediate representations" was invented by Md Akmal Haidar (Montreal) and Mehdi Rezagholizadeh (Montreal).

According to the abstract* released by the U.S. Patent & Trademark Office: "Methods, devices and processor-readable media for knowledge distillation using intermediate representations are described. A student model is trained using a Dropout-KD approach in which intermediate layer selection is performed efficiently such that the skip, search, and overfitting problems in intermediate layer KD may be solved. Teacher...