Artificial Intelligence Service(s) in a Distributed Cloud Computing Network Including Function Calling

원문 (중국어)

A compute server of a distributed cloud computing network receives an inference request. The inference request triggers execution of code that is related to an AI application that interacts with the inference request and causes its input to be run through an AI model. Helper code executing on the compute server transmits an inference request to the AI model, where this inference request includes a prompt and one or more function definitions, and where the AI model is executing in the same datacenter as the compute server. The helper code receives a result of the AI model executing the inference request, where it includes structured data for calling a function. The helper code calls the function using the structured data. The helper code receives a response to the called function. The code processes a response to the inference request based at least on the received response to the called function.