Module 'torch.distributed' has no attribute 'ReduceOp'

[dusty_nv]

@qiangqiangsir the PyTorch 1.11 wheel was the last one to be built with USE_DISTRIBUTED:

PyTorch v1.11.0

• JetPack 5.0 (L4T R34.1) / JetPack 5.0.2 (L4T R35.1) / JetPack 5.1 (L4T R35.2.1) / JetPack 5.1.1 (L4T R35.3.1)
  • Python 3.8 - torch-1.11.0-cp38-cp38-linux_aarch64.whl

If you require a newer version of PyTorch with distributed enabled, please see this thread for instructions on building PyTorch from source:

PyTorch for Jetson

Below are pre-built PyTorch pip wheel installers for Jetson Nano, TX1/TX2, Xavier, and Orin with JetPack 4.2 and newer. Download one of the PyTorch binaries from below for your version of JetPack, and see the installation instructions to run on your Jetson. These pip wheels are built for ARM aarch64 architecture, so run these commands on your Jetson (not on a host PC). You can also use the pre-built l4t-pytorch and l4t-ml container images and Dockerfiles. PyTorch pip wheels JetPack 5

PyTo…

Or perhaps it’s possible to disable distributed mode in the mmpretrain library you are using?