Application of Online Resource Allocation Based on Ray (Fang Fengbin, Ant Group)
We build online resource allocation system based on Ray, which is widely used in search recommendation advertising system of ant group. I will introduce the application scenario of online resource allocation in ant group and our work based on Ray.
Personalization Operation strategy Group control Online Resource Allocation: • Make immediate decisions on resource allocation requests. • Maximizing the overall ROI under the constraint of limited resources. 2021
! 𝑚#$ % 𝑥#$ ≤ 𝑏% 𝑀𝑎𝑥 ! 𝑐#$ 𝑥#$ 𝑐#$ : The profit value obtained by distributing the j-th resource to user 𝑖. 𝑖 : The user i. 𝑗 : The j-th resource. 𝑥#$ : The probability of assigning the j-th resource to the i-th user. 𝑏% : There are K constraints on resources. 𝑚#$ % : The consumption on the k-th resource constraint of assigning the j-th resource to the i-th user. Difficulties: • Large scale problem solving. • Future information is unpredictable and the global optimal solution cannot be determined in advance. 2021
periods are of the same distribution, so we can decompose the global problem into real-time subproblems for learning. Use the data of the previous stage to guide the online decision of the current stage. Dual Variable Resource Manager Real Time Planning Online Decision Service Model Prediction Log Store DB Constraint Scoring Snapshot 2021
Streaming Serving GPU Acceleration Distributed Programming API (Java/Python) Iterative Calculation Common Libs for Distributed Programming Calibration Traffic Prediction Constraints Reorganization … Optimization With Constraints Logical architecture of the online resource allocation system based on Ray Collective Communication Services Online Re-rank Config Manager Data Dashboard … 2021
Ray Constraint Correction Real Time Data Source Streaming Offline Data Source Correction Training Iterative Calculation Worker Master Allocation Training Iterative Calculation Worker Master Offline Data Source Cache Sample Collection Real Time Data Source Streaming Serving Virtual IP GPU Solver Storage LP Solver Serving Virtual IP Online Decision Service Ray Actor Batch Sample Lagrange Multiplier Correction Model Constraint & Target Model Real time constraints Online LP Optimization 2021
a simple and easy-to-use API • Ray supports convenient resource scheduling • Ray supports • … Future planning: • Using Ray collective communication to realize multi card data parallelization • Using Ray ML to accelerate LP solution • … 2021