Originally published at: Scaling Recommendation System Inference with Merlin Hierarchical Parameter Server | NVIDIA Technical Blog
NVIDIA Merlin introduces the Hierarchical Parameter Server (HPS), a scalable solution with multilevel adaptive storage to enable deployment of terabyte-size models under real-time latency constraints.