US Patent Issued to Huawei Technologies'Co., 'Ltd.' on Feb. 3 for "Knowledge distillation by utilizing backward pass knowledge in neural networks" (Canadian Inventors)

ALEXANDRIA, Va., Feb. 3 -- United States Patent no. 12,541,689, issued on Feb. 3, was assigned to Huawei Technologies'Co.'Ltd.' (Shenzhen, China).

"Knowledge distillation by utilizing backward pass knowledge in neural networks" was invented by Aref Jafari (Waterloo, Canada), Mehdi Rezagholizadeh (Montreal) and Ali Ghodsi (Waterloo, Canada).

According to the abstract* released by the U.S. Patent & Trademark Office: "Methods and systems are provided for compressing a deep neural network (NN) model using knowledge distillation. The method includes training a student NN model to minimize a first loss between student model output values generated by the student NN model for a set of original input values and teacher model output values generat...