TRANSMISSION AND PROCESSING OF DATA IN PARALLEL SYSTEMS

原文（中国語）

Systems and methods for transmitting and processing data can use representations of data portions (e.g., blocks, chunks, or other subunits of data) that match a specified pattern, such as zero gradients in a machine learning training algorithm. These representations can allow different parts of a system to communicate the existence of these data portions to each other without actually transmitting the data portions while also allowing for the transmission of data portions that do not match the specified pattern. Processing of data can also use these representations or indicators as placeholders for the omitted data and perform calculations based on tallies, skipped memory locations, or other ways of accounting for the omitted data. This can in some cases reduce computing resources used to process data, such as data that may have been communicated using such representations.