Hi @ayhmdalilabzns - you can find the PyTorch pip wheels that were built with CUDA enabled for Jetson here:
There are also containers like l4t-pytorch and various ones in jetson-containers that you can use with torchvision, transformers, ect and lots of other packages built on top of PyTorch using GPU.