TECHNIQUES FOR ADAPTIVE MULTI-LEVEL RECOMMENDATION USING HIERARCHICAL MIXTURE-OF-EXPERTS FRAMEWORK

原文（中文）

Techniques for inferencing using a hierarchical model include receiving a plurality of inputs for a first model and a second model of the hierarchical model, where the output from the first model is presented to the second model. The method involves presenting the first input to the first model to generate a first intermediate output, and presenting the second input and the first intermediate output to the second model to generate a first output for the hierarchical model. The first intermediate output is cached. Upon receiving a second plurality of inputs, the method checks if the third input matches the first input. If matched, the first intermediate output is retrieved from the cache and presented along with the fourth input to a replica of the second model to generate a second output of the hierarchical model.