EXPERT LOAD BALANCING IN TRANSFORMER MODELS
案件概要
出願人
ADVANCED MICRO DEVICES, INC.; Xilinx, Inc.
発明者
Venkata Pavan Kumar Miriyala; Lucian Petrica; Kenneth O'Brien
IPC分類
CPC分類
In response to one or more conditions, a processing system determines whether transferring one or more experts to different processing units would improve load balancing at the processing system. The processing system determines an amount of variance between the utilization for each expert relative to the average utilization of all experts at their currently-assigned processing units. The processing system then measures the amount of variance under one or more different configurations of expert-processing unit assignments. If so, the processing system transfers one or more of the experts to different processing units.
原文（中国語）
In response to one or more conditions, a processing system determines whether transferring one or more experts to different processing units would improve load balancing at the processing system. The processing system determines an amount of variance between the utilization for each expert relative to the average utilization of all experts at their currently-assigned processing units. The processing system then measures the amount of variance under one or more different configurations of expert-processing unit assignments. If so, the processing system transfers one or more of the experts to different processing units.
外部リソース