In-House LLM Serving at Netflix

📝

内容提要

By AI Platform’s Model Runtime team and Inference teamIntroductionMost organizations consume LLMs through hosted APIs. Netflix went further — we run the full stack ourselves, from model deployment...

🏷️

标签

➡️

继续阅读