ALEXANDRIA, Va., Sept. 30 -- United States Patent no. 12,430,560, issued on Sept. 30, was assigned to Huawei Technologies Co. Ltd. (Shenzhen, China).
"Distributed synchronous training architecture using stale weights" was invented by Hui Zang (Cupertino, Calif.) and Xiaolin Cheng (San Ramon, Calif.).
According to the abstract* released by the U.S. Patent & Trademark Office: "A computer-implemented method for distributed synchronous training of a neural network model includes performing, by a worker machine of a plurality of worker machines, a forward computation of a training data set using a plurality of N layers of the neural network model. The forward computation starts at Layer 1 and proceeds through Layer N of the neural network mode...