jetson orin nx 16G
$ nvcc -V
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2024 NVIDIA Corporation
Built on Wed_Aug_14_10:14:07_PDT_2024
Cuda compilation tools, release 12.6, V12.6.68
Build cuda_12.6.r12.6/compiler.34714021_0
y$ python
Python 3.10.0 | packaged by conda-forge | (default, Nov 20 2021, 02:50:31) [GCC 9.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import torch
>>> print(torch.__version__)
2.6.0+cu126
>>> print(torch.cuda.is_available())
True
When I install vllm from https://pypi.jetson-ai-lab.dev/jp6/cu126 I get the following error
ERROR: Wheel ‘vllm’ located at /xxxx/vllm-0.8.6 cu126-cp310-cp310-linux_aarch64.whl is invalid.