修复多机训练问题 (#143)

* 修复多机训练问题 * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-11-02 10:38:45 +08:00
parent ca546c55db
commit 74467f5f73
3 changed files with 16 additions and 2 deletions
--- a/run_Mgpus.sh
+++ b/run_Mgpus.sh
@@ -0,0 +1,7 @@
+torchrun \
+    --nnodes=1:3\
+    --nproc_per_node=2\
+    --rdzv_id=1\
+    --rdzv_backend=c10d\
+    --rdzv_endpoint="ib1:8880"\
+    train_ms.py