SHEPHERD: Serving DNNs in the Wild
📝
内容提要
Paper link: SHEPHERD: Serving DNNs in the Wild Achieving scalability, high system goodput and maximize resource utilization, at the same time is hard for an inference system. while individual...
➡️
