System and Method for Optimizing Machine Learning Inference Systems and Processes for Operating A Compiler Therefor
개요
발명자
Xiao ZHANG; Yaoyao DING; Yang HU; Gennady PEKHIMENKO
IPC 분류
CPC 분류
A computer system is provided for compiling computer programs using machine learning compilers. The method includes obtaining a first computer program written in a script with a defined programming language dialect for a particular machine learning compiler, defining a higher level intermediate representation (IR) that represents the first computer program written with the defined programming language dialect; generating a second computer program represented in the higher level IR; deriving a plurality of new optimization passes based on the higher level IR; converting the second computer program represented in the higher level IR into a third computer program represented in one or more lower-level IRs that exist in the machine learning compiler; applying a plurality of existing optimization passes to generate an optimized fourth computer program represented in the existing lower-level IR; and converting the optimized fourth computer program represented in the existing lower-level IR-to-machine instructions.
원문 (중국어)
A computer system is provided for compiling computer programs using machine learning compilers. The method includes obtaining a first computer program written in a script with a defined programming language dialect for a particular machine learning compiler, defining a higher level intermediate representation (IR) that represents the first computer program written with the defined programming language dialect; generating a second computer program represented in the higher level IR; deriving a plurality of new optimization passes based on the higher level IR; converting the second computer program represented in the higher level IR into a third computer program represented in one or more lower-level IRs that exist in the machine learning compiler; applying a plurality of existing optimization passes to generate an optimized fourth computer program represented in the existing lower-level IR; and converting the optimized fourth computer program represented in the existing lower-level IR-to-machine instructions.