Bringing PyTorch Monarch to AMD GPUs

https://pytorch.org/blog/bringing-pytorch-monarch-to-amd-gpus-single-controller-distributed-training-on-rocm/

Comments

mountainriverJul 25, 2026, 4:57 PM
Love monarch, amazing primitives and feels so much lighter than Ray.

Another awesome add on their part

bicepjaiJul 25, 2026, 4:38 PM
So are we at a point where we can’t train llms for fun at home on less expensive AMD cards ?
essephJul 25, 2026, 5:19 PM
Who was training LLMs on residential AMD GPUs?
MrDrMcCoyJul 25, 2026, 7:50 PM
I am. Most models that can be run locally have extraordinarily out of date training data for certain frameworks that predate breaking changes and important features, so their docs and API schemas need to be put into LoRAs.
ameliusJul 25, 2026, 4:47 PM
can't or can?
fefe23Jul 25, 2026, 6:12 PM
benchmqarks?
reindeer2Jul 25, 2026, 11:02 PM
[flagged]