@zergzzlun if you prefer installing the wheel as opposed to using the container, I believe this was the last PyTorch wheel built with USE_DISTRIBUTED enabled:
PyTorch v1.11.0
- JetPack 5.0 (L4T R34.1) / JetPack 5.0.2 (L4T R35.1) / JetPack 5.1 (L4T R35.2.1) / JetPack 5.1.1 (L4T R35.3.1)
- Python 3.8 -
torch-1.11.0-cp38-cp38-linux_aarch64.whl
For newer versions, you would need to build PyTorch from source to enable distributed mode (see this post for build instructions: PyTorch for Jetson)
Also, the reason that you get torch.cuda.is_available = False when you install it with conda, is because those upstream wheels from PyPi/conda/pip were not built for JetPack or with CUDA enabled.