RESOURCE SCHEDULING METHOD BASED ON STORAGE SYSTEM, MEDIUM, AND ELECTRONIC DEVICE
개요
출원인
Beijing Volcano Engine Technology Co., Ltd.
발명자
Yijian CHEN
IPC 분류
CPC 분류
A resource scheduling method based on a storage system, a medium, and an electronic device are provided. The method includes: acquiring a manifest file respectively corresponding to each object bucket in a storage system; performing loop traversal allocation for each object bucket based on a preset object allocation rule to obtain a target object allocation quota for each object bucket; generating a data processing task corresponding to each object bucket based on the target object allocation quota for each object bucket and the manifest file corresponding to each object bucket, where a number of expired objects in a manifest file executed by a total data processing task of an object bucket is not greater than a target object allocation quota for the object bucket; and controlling the data processing task of each object bucket to be executed in parallel.
원문 (중국어)
A resource scheduling method based on a storage system, a medium, and an electronic device are provided. The method includes: acquiring a manifest file respectively corresponding to each object bucket in a storage system; performing loop traversal allocation for each object bucket based on a preset object allocation rule to obtain a target object allocation quota for each object bucket; generating a data processing task corresponding to each object bucket based on the target object allocation quota for each object bucket and the manifest file corresponding to each object bucket, where a number of expired objects in a manifest file executed by a total data processing task of an object bucket is not greater than a target object allocation quota for the object bucket; and controlling the data processing task of each object bucket to be executed in parallel.