Streamlined multi-node serving with Ray symmetric-run
📝
内容提要
Ray now has a new command: ray symmetric-run. This command makes it possible to launch the same entrypoint command on every node in a Ray cluster, simplifying the workflow to spawn vLLM servers...
🏷️
标签
➡️