Closed as not planned
Description
🐛 Describe the bug
pytorch v2.3.1 build for nvidia jetson orin 8GB
Previous discussion here FYI: https://forums.developer.nvidia.com/t/request-build-script-for-pytorch-or-up-to-date-pytorh-binary-release-supporting-jetson-boards-running-l4t35-6-ubuntu20-04/316972/12
$ git log -n 1
commit 63d5e9221bedd1546b7d364b5ce4171547db12a9 (HEAD, tag: v2.3.1, origin/release/2.3)
Author: pytorchbot <[email protected]>
Date: Wed May 29 08:15:01 2024 -0700
[EZ] Pin scipy to 1.12 for Py-3.12 (#127322)
[EZ] Pin scipy to 1.12 for Py-3.12 (#123795)
This caused false positive failures/reverts for https://github.com/pytorch/pytorch/pull/123689 and https://github.com/pytorch/pytorch/pull/123595
Fixes https://github.com/pytorch/pytorch/issues/123655
Pull Request resolved: https://github.com/pytorch/pytorch/pull/123795
Approved by: https://github.com/huydhn
(cherry picked from commit 2a597cfd2c63459dd303cf7922eb4c3750a76e75)
Co-authored-by: Nikita Shulga <[email protected]>
Software part of jetson-stats 4.2.12 - (c) 2024, Raffaello Bonghi
Model: NVIDIA Orin Nano Developer Kit - Jetpack 5.1.4 [L4T 35.6.0]
NV Power Mode[0]: 15W
Serial Number: [XXX Show with: jetson_release -s XXX]
Hardware:
- P-Number: p3767-0005
- Module: NVIDIA Jetson Orin Nano (Developer kit)
Platform:
- Distribution: Ubuntu 20.04 focal
- Release: 5.10.216-tegra
jtop:
- Version: 4.2.12
- Service: Active
Libraries:
- CUDA: 11.4.315
- cuDNN: 8.6.0.166
- TensorRT: 8.5.2.2
- VPI: 2.4.8
- OpenCV: 4.9.0 - with CUDA: YES
DeepStream C/C++ SDK version: 6.3
Python Environment:
Python 3.8.10
GStreamer: YES (1.16.3)
NVIDIA CUDA: YES (ver 11.4, CUFFT CUBLAS FAST_MATH)
OpenCV version: 4.9.0 CUDA True
YOLO version: 8.3.33
Torch version: 2.1.0a0+41361538.nv23.06
Torchvision version: 0.16.1+fdea156
DeepStream SDK version: 1.1.8
Error logs
- LOG 1: first build
FAILED: caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/Operators_1.cpp.o
/usr/bin/ccache /usr/bin/c++ -DAT_PER_OPERATOR_HEADERS -DCAFFE2_BUILD_MAIN_LIB -DCPUINFO_SUPPORTED_PLATFORM=1 -DFLASHATTENTION_DISABLE_ALIBI -DFMT_HEADER_ONLY=1 -DFXDIV_USE_INLINE_ASSEMBLY=0 -DHAVE_MALLOC_USABLE_SIZE=1 -DHAVE_MMAP=1 -DHAVE_SHM_OPEN=1 -DHAVE_SHM_UNLINK=1 -DMINIZ_DISABLE_ZIP_READER_CRC32_CHECKS -DNNP_CONVOLUTION_ONLY=0 -DNNP_INFERENCE_ONLY=0 -DONNXIFI_ENABLE_EXT=1 -DONNX_ML=1 -DONNX_NAMESPACE=onnx_torch -DUSE_EXTERNAL_MZCRC -D_FILE_OFFSET_BITS=64 -Dtorch_cpu_EXPORTS -I/home/daniel/Work/pytorch_v2.3.1/build/aten/src -I/home/daniel/Work/pytorch_v2.3.1/aten/src -I/home/daniel/Work/pytorch_v2.3.1/build -I/home/daniel/Work/pytorch_v2.3.1 -I/home/daniel/Work/pytorch_v2.3.1/cmake/../third_party/benchmark/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/onnx -I/home/daniel/Work/pytorch_v2.3.1/build/third_party/onnx -I/home/daniel/Work/pytorch_v2.3.1/third_party/foxi -I/home/daniel/Work/pytorch_v2.3.1/build/third_party/foxi -I/home/daniel/Work/pytorch_v2.3.1/torch/csrc/api -I/home/daniel/Work/pytorch_v2.3.1/torch/csrc/api/include -I/home/daniel/Work/pytorch_v2.3.1/caffe2/aten/src/TH -I/home/daniel/Work/pytorch_v2.3.1/build/caffe2/aten/src/TH -I/home/daniel/Work/pytorch_v2.3.1/build/caffe2/aten/src -I/home/daniel/Work/pytorch_v2.3.1/build/caffe2/../aten/src -I/home/daniel/Work/pytorch_v2.3.1/torch/csrc -I/home/daniel/Work/pytorch_v2.3.1/third_party/miniz-2.1.0 -I/home/daniel/Work/pytorch_v2.3.1/third_party/kineto/libkineto/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/kineto/libkineto/src -I/home/daniel/Work/pytorch_v2.3.1/aten/src/ATen/.. -I/home/daniel/Work/pytorch_v2.3.1/third_party/FXdiv/include -I/home/daniel/Work/pytorch_v2.3.1/c10/.. -I/home/daniel/Work/pytorch_v2.3.1/third_party/pthreadpool/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/cpuinfo/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/NNPACK/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/FP16/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/fmt/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/flatbuffers/include -isystem /home/daniel/Work/pytorch_v2.3.1/cmake/../third_party/googletest/googlemock/include -isystem /home/daniel/Work/pytorch_v2.3.1/cmake/../third_party/googletest/googletest/include -isystem /home/daniel/Work/pytorch_v2.3.1/third_party/protobuf/src -isystem /home/daniel/Work/pytorch_v2.3.1/third_party/XNNPACK/include -isystem /home/daniel/Work/pytorch_v2.3.1/cmake/../third_party/eigen -isystem /usr/local/cuda/include -isystem /home/daniel/Work/pytorch_v2.3.1/build/include -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOROCTRACER -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-unused-function -Wno-unused-result -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=pedantic -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow -O3 -DNDEBUG -DNDEBUG -std=gnu++17 -fPIC -D__NEON__ -Wall -Wextra -Wdeprecated -Wno-unused-parameter -Wno-unused-function -Wno-missing-field-initializers -Wno-unknown-pragmas -Wno-type-limits -Wno-array-bounds -Wno-strict-overflow -Wno-strict-aliasing -Wno-maybe-uninitialized -fvisibility=hidden -O2 -pthread -fopenmp -MD -MT caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/Operators_1.cpp.o -MF caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/Operators_1.cpp.o.d -o caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/Operators_1.cpp.o -c /home/daniel/Work/pytorch_v2.3.1/build/aten/src/ATen/Operators_1.cpp
c++: fatal error: Killed signal terminated program cc1plus
compilation terminated.
[5192/6660] Building CXX object caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/Operators_2.cpp.o
FAILED: caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/Operators_2.cpp.o
/usr/bin/ccache /usr/bin/c++ -DAT_PER_OPERATOR_HEADERS -DCAFFE2_BUILD_MAIN_LIB -DCPUINFO_SUPPORTED_PLATFORM=1 -DFLASHATTENTION_DISABLE_ALIBI -DFMT_HEADER_ONLY=1 -DFXDIV_USE_INLINE_ASSEMBLY=0 -DHAVE_MALLOC_USABLE_SIZE=1 -DHAVE_MMAP=1 -DHAVE_SHM_OPEN=1 -DHAVE_SHM_UNLINK=1 -DMINIZ_DISABLE_ZIP_READER_CRC32_CHECKS -DNNP_CONVOLUTION_ONLY=0 -DNNP_INFERENCE_ONLY=0 -DONNXIFI_ENABLE_EXT=1 -DONNX_ML=1 -DONNX_NAMESPACE=onnx_torch -DUSE_EXTERNAL_MZCRC -D_FILE_OFFSET_BITS=64 -Dtorch_cpu_EXPORTS -I/home/daniel/Work/pytorch_v2.3.1/build/aten/src -I/home/daniel/Work/pytorch_v2.3.1/aten/src -I/home/daniel/Work/pytorch_v2.3.1/build -I/home/daniel/Work/pytorch_v2.3.1 -I/home/daniel/Work/pytorch_v2.3.1/cmake/../third_party/benchmark/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/onnx -I/home/daniel/Work/pytorch_v2.3.1/build/third_party/onnx -I/home/daniel/Work/pytorch_v2.3.1/third_party/foxi -I/home/daniel/Work/pytorch_v2.3.1/build/third_party/foxi -I/home/daniel/Work/pytorch_v2.3.1/torch/csrc/api -I/home/daniel/Work/pytorch_v2.3.1/torch/csrc/api/include -I/home/daniel/Work/pytorch_v2.3.1/caffe2/aten/src/TH -I/home/daniel/Work/pytorch_v2.3.1/build/caffe2/aten/src/TH -I/home/daniel/Work/pytorch_v2.3.1/build/caffe2/aten/src -I/home/daniel/Work/pytorch_v2.3.1/build/caffe2/../aten/src -I/home/daniel/Work/pytorch_v2.3.1/torch/csrc -I/home/daniel/Work/pytorch_v2.3.1/third_party/miniz-2.1.0 -I/home/daniel/Work/pytorch_v2.3.1/third_party/kineto/libkineto/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/kineto/libkineto/src -I/home/daniel/Work/pytorch_v2.3.1/aten/src/ATen/.. -I/home/daniel/Work/pytorch_v2.3.1/third_party/FXdiv/include -I/home/daniel/Work/pytorch_v2.3.1/c10/.. -I/home/daniel/Work/pytorch_v2.3.1/third_party/pthreadpool/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/cpuinfo/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/NNPACK/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/FP16/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/fmt/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/flatbuffers/include -isystem /home/daniel/Work/pytorch_v2.3.1/cmake/../third_party/googletest/googlemock/include -isystem /home/daniel/Work/pytorch_v2.3.1/cmake/../third_party/googletest/googletest/include -isystem /home/daniel/Work/pytorch_v2.3.1/third_party/protobuf/src -isystem /home/daniel/Work/pytorch_v2.3.1/third_party/XNNPACK/include -isystem /home/daniel/Work/pytorch_v2.3.1/cmake/../third_party/eigen -isystem /usr/local/cuda/include -isystem /home/daniel/Work/pytorch_v2.3.1/build/include -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOROCTRACER -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-unused-function -Wno-unused-result -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=pedantic -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow -O3 -DNDEBUG -DNDEBUG -std=gnu++17 -fPIC -D__NEON__ -Wall -Wextra -Wdeprecated -Wno-unused-parameter -Wno-unused-function -Wno-missing-field-initializers -Wno-unknown-pragmas -Wno-type-limits -Wno-array-bounds -Wno-strict-overflow -Wno-strict-aliasing -Wno-maybe-uninitialized -fvisibility=hidden -O2 -pthread -fopenmp -MD -MT caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/Operators_2.cpp.o -MF caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/Operators_2.cpp.o.d -o caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/Operators_2.cpp.o -c /home/daniel/Work/pytorch_v2.3.1/build/aten/src/ATen/Operators_2.cpp
c++: fatal error: Killed signal terminated program cc1plus
compilation terminated.
[5193/6660] Building CXX object caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/RegisterCPU.cpp.o
FAILED: caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/RegisterCPU.cpp.o
/usr/bin/ccache /usr/bin/c++ -DAT_PER_OPERATOR_HEADERS -DCAFFE2_BUILD_MAIN_LIB -DCPUINFO_SUPPORTED_PLATFORM=1 -DFLASHATTENTION_DISABLE_ALIBI -DFMT_HEADER_ONLY=1 -DFXDIV_USE_INLINE_ASSEMBLY=0 -DHAVE_MALLOC_USABLE_SIZE=1 -DHAVE_MMAP=1 -DHAVE_SHM_OPEN=1 -DHAVE_SHM_UNLINK=1 -DMINIZ_DISABLE_ZIP_READER_CRC32_CHECKS -DNNP_CONVOLUTION_ONLY=0 -DNNP_INFERENCE_ONLY=0 -DONNXIFI_ENABLE_EXT=1 -DONNX_ML=1 -DONNX_NAMESPACE=onnx_torch -DUSE_EXTERNAL_MZCRC -D_FILE_OFFSET_BITS=64 -Dtorch_cpu_EXPORTS -I/home/daniel/Work/pytorch_v2.3.1/build/aten/src -I/home/daniel/Work/pytorch_v2.3.1/aten/src -I/home/daniel/Work/pytorch_v2.3.1/build -I/home/daniel/Work/pytorch_v2.3.1 -I/home/daniel/Work/pytorch_v2.3.1/cmake/../third_party/benchmark/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/onnx -I/home/daniel/Work/pytorch_v2.3.1/build/third_party/onnx -I/home/daniel/Work/pytorch_v2.3.1/third_party/foxi -I/home/daniel/Work/pytorch_v2.3.1/build/third_party/foxi -I/home/daniel/Work/pytorch_v2.3.1/torch/csrc/api -I/home/daniel/Work/pytorch_v2.3.1/torch/csrc/api/include -I/home/daniel/Work/pytorch_v2.3.1/caffe2/aten/src/TH -I/home/daniel/Work/pytorch_v2.3.1/build/caffe2/aten/src/TH -I/home/daniel/Work/pytorch_v2.3.1/build/caffe2/aten/src -I/home/daniel/Work/pytorch_v2.3.1/build/caffe2/../aten/src -I/home/daniel/Work/pytorch_v2.3.1/torch/csrc -I/home/daniel/Work/pytorch_v2.3.1/third_party/miniz-2.1.0 -I/home/daniel/Work/pytorch_v2.3.1/third_party/kineto/libkineto/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/kineto/libkineto/src -I/home/daniel/Work/pytorch_v2.3.1/aten/src/ATen/.. -I/home/daniel/Work/pytorch_v2.3.1/third_party/FXdiv/include -I/home/daniel/Work/pytorch_v2.3.1/c10/.. -I/home/daniel/Work/pytorch_v2.3.1/third_party/pthreadpool/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/cpuinfo/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/NNPACK/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/FP16/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/fmt/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/flatbuffers/include -isystem /home/daniel/Work/pytorch_v2.3.1/cmake/../third_party/googletest/googlemock/include -isystem /home/daniel/Work/pytorch_v2.3.1/cmake/../third_party/googletest/googletest/include -isystem /home/daniel/Work/pytorch_v2.3.1/third_party/protobuf/src -isystem /home/daniel/Work/pytorch_v2.3.1/third_party/XNNPACK/include -isystem /home/daniel/Work/pytorch_v2.3.1/cmake/../third_party/eigen -isystem /usr/local/cuda/include -isystem /home/daniel/Work/pytorch_v2.3.1/build/include -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOROCTRACER -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-unused-function -Wno-unused-result -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=pedantic -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow -O3 -DNDEBUG -DNDEBUG -std=gnu++17 -fPIC -D__NEON__ -Wall -Wextra -Wdeprecated -Wno-unused-parameter -Wno-unused-function -Wno-missing-field-initializers -Wno-unknown-pragmas -Wno-type-limits -Wno-array-bounds -Wno-strict-overflow -Wno-strict-aliasing -Wno-maybe-uninitialized -fvisibility=hidden -O2 -pthread -fopenmp -MD -MT caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/RegisterCPU.cpp.o -MF caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/RegisterCPU.cpp.o.d -o caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/RegisterCPU.cpp.o -c /home/daniel/Work/pytorch_v2.3.1/build/aten/src/ATen/RegisterCPU.cpp
c++: fatal error: Killed signal terminated program cc1plus
compilation terminated.
[5198/6660] Building CXX object caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/Operators_3.cpp.o
ninja: build stopped: subcommand failed.
- LOG 2: second build
Building wheel torch-2.3.1
-- Building version 2.3.1
cmake --build . --target install --config Release
[2/1464] Building CXX object caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/Operators_1.cpp.o
FAILED: caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/Operators_1.cpp.o
/usr/bin/ccache /usr/bin/c++ -DAT_PER_OPERATOR_HEADERS -DCAFFE2_BUILD_MAIN_LIB -DCPUINFO_SUPPORTED_PLATFORM=1 -DFLASHATTENTION_DISABLE_ALIBI -DFMT_HEADER_ONLY=1 -DFXDIV_USE_INLINE_ASSEMBLY=0 -DHAVE_MALLOC_USABLE_SIZE=1 -DHAVE_MMAP=1 -DHAVE_SHM_OPEN=1 -DHAVE_SHM_UNLINK=1 -DMINIZ_DISABLE_ZIP_READER_CRC32_CHECKS -DNNP_CONVOLUTION_ONLY=0 -DNNP_INFERENCE_ONLY=0 -DONNXIFI_ENABLE_EXT=1 -DONNX_ML=1 -DONNX_NAMESPACE=onnx_torch -DUSE_EXTERNAL_MZCRC -D_FILE_OFFSET_BITS=64 -Dtorch_cpu_EXPORTS -I/home/daniel/Work/pytorch_v2.3.1/build/aten/src -I/home/daniel/Work/pytorch_v2.3.1/aten/src -I/home/daniel/Work/pytorch_v2.3.1/build -I/home/daniel/Work/pytorch_v2.3.1 -I/home/daniel/Work/pytorch_v2.3.1/cmake/../third_party/benchmark/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/onnx -I/home/daniel/Work/pytorch_v2.3.1/build/third_party/onnx -I/home/daniel/Work/pytorch_v2.3.1/third_party/foxi -I/home/daniel/Work/pytorch_v2.3.1/build/third_party/foxi -I/home/daniel/Work/pytorch_v2.3.1/torch/csrc/api -I/home/daniel/Work/pytorch_v2.3.1/torch/csrc/api/include -I/home/daniel/Work/pytorch_v2.3.1/caffe2/aten/src/TH -I/home/daniel/Work/pytorch_v2.3.1/build/caffe2/aten/src/TH -I/home/daniel/Work/pytorch_v2.3.1/build/caffe2/aten/src -I/home/daniel/Work/pytorch_v2.3.1/build/caffe2/../aten/src -I/home/daniel/Work/pytorch_v2.3.1/torch/csrc -I/home/daniel/Work/pytorch_v2.3.1/third_party/miniz-2.1.0 -I/home/daniel/Work/pytorch_v2.3.1/third_party/kineto/libkineto/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/kineto/libkineto/src -I/home/daniel/Work/pytorch_v2.3.1/aten/src/ATen/.. -I/home/daniel/Work/pytorch_v2.3.1/third_party/FXdiv/include -I/home/daniel/Work/pytorch_v2.3.1/c10/.. -I/home/daniel/Work/pytorch_v2.3.1/third_party/pthreadpool/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/cpuinfo/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/NNPACK/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/FP16/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/fmt/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/flatbuffers/include -isystem /home/daniel/Work/pytorch_v2.3.1/cmake/../third_party/googletest/googlemock/include -isystem /home/daniel/Work/pytorch_v2.3.1/cmake/../third_party/googletest/googletest/include -isystem /home/daniel/Work/pytorch_v2.3.1/third_party/protobuf/src -isystem /home/daniel/Work/pytorch_v2.3.1/third_party/XNNPACK/include -isystem /home/daniel/Work/pytorch_v2.3.1/cmake/../third_party/eigen -isystem /usr/local/cuda/include -isystem /home/daniel/Work/pytorch_v2.3.1/build/include -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOROCTRACER -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-unused-function -Wno-unused-result -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=pedantic -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow -O3 -DNDEBUG -DNDEBUG -std=gnu++17 -fPIC -D__NEON__ -Wall -Wextra -Wdeprecated -Wno-unused-parameter -Wno-unused-function -Wno-missing-field-initializers -Wno-unknown-pragmas -Wno-type-limits -Wno-array-bounds -Wno-strict-overflow -Wno-strict-aliasing -Wno-maybe-uninitialized -fvisibility=hidden -O2 -pthread -fopenmp -MD -MT caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/Operators_1.cpp.o -MF caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/Operators_1.cpp.o.d -o caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/Operators_1.cpp.o -c /home/daniel/Work/pytorch_v2.3.1/build/aten/src/ATen/Operators_1.cpp
c++: fatal error: Killed signal terminated program cc1plus
compilation terminated.
[3/1464] Building CXX object caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/RegisterCPU.cpp.o
FAILED: caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/RegisterCPU.cpp.o
/usr/bin/ccache /usr/bin/c++ -DAT_PER_OPERATOR_HEADERS -DCAFFE2_BUILD_MAIN_LIB -DCPUINFO_SUPPORTED_PLATFORM=1 -DFLASHATTENTION_DISABLE_ALIBI -DFMT_HEADER_ONLY=1 -DFXDIV_USE_INLINE_ASSEMBLY=0 -DHAVE_MALLOC_USABLE_SIZE=1 -DHAVE_MMAP=1 -DHAVE_SHM_OPEN=1 -DHAVE_SHM_UNLINK=1 -DMINIZ_DISABLE_ZIP_READER_CRC32_CHECKS -DNNP_CONVOLUTION_ONLY=0 -DNNP_INFERENCE_ONLY=0 -DONNXIFI_ENABLE_EXT=1 -DONNX_ML=1 -DONNX_NAMESPACE=onnx_torch -DUSE_EXTERNAL_MZCRC -D_FILE_OFFSET_BITS=64 -Dtorch_cpu_EXPORTS -I/home/daniel/Work/pytorch_v2.3.1/build/aten/src -I/home/daniel/Work/pytorch_v2.3.1/aten/src -I/home/daniel/Work/pytorch_v2.3.1/build -I/home/daniel/Work/pytorch_v2.3.1 -I/home/daniel/Work/pytorch_v2.3.1/cmake/../third_party/benchmark/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/onnx -I/home/daniel/Work/pytorch_v2.3.1/build/third_party/onnx -I/home/daniel/Work/pytorch_v2.3.1/third_party/foxi -I/home/daniel/Work/pytorch_v2.3.1/build/third_party/foxi -I/home/daniel/Work/pytorch_v2.3.1/torch/csrc/api -I/home/daniel/Work/pytorch_v2.3.1/torch/csrc/api/include -I/home/daniel/Work/pytorch_v2.3.1/caffe2/aten/src/TH -I/home/daniel/Work/pytorch_v2.3.1/build/caffe2/aten/src/TH -I/home/daniel/Work/pytorch_v2.3.1/build/caffe2/aten/src -I/home/daniel/Work/pytorch_v2.3.1/build/caffe2/../aten/src -I/home/daniel/Work/pytorch_v2.3.1/torch/csrc -I/home/daniel/Work/pytorch_v2.3.1/third_party/miniz-2.1.0 -I/home/daniel/Work/pytorch_v2.3.1/third_party/kineto/libkineto/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/kineto/libkineto/src -I/home/daniel/Work/pytorch_v2.3.1/aten/src/ATen/.. -I/home/daniel/Work/pytorch_v2.3.1/third_party/FXdiv/include -I/home/daniel/Work/pytorch_v2.3.1/c10/.. -I/home/daniel/Work/pytorch_v2.3.1/third_party/pthreadpool/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/cpuinfo/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/NNPACK/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/FP16/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/fmt/include -I/home/daniel/Work/pytorch_v2.3.1/third_party/flatbuffers/include -isystem /home/daniel/Work/pytorch_v2.3.1/cmake/../third_party/googletest/googlemock/include -isystem /home/daniel/Work/pytorch_v2.3.1/cmake/../third_party/googletest/googletest/include -isystem /home/daniel/Work/pytorch_v2.3.1/third_party/protobuf/src -isystem /home/daniel/Work/pytorch_v2.3.1/third_party/XNNPACK/include -isystem /home/daniel/Work/pytorch_v2.3.1/cmake/../third_party/eigen -isystem /usr/local/cuda/include -isystem /home/daniel/Work/pytorch_v2.3.1/build/include -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOROCTRACER -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-unused-function -Wno-unused-result -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=pedantic -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow -O3 -DNDEBUG -DNDEBUG -std=gnu++17 -fPIC -D__NEON__ -Wall -Wextra -Wdeprecated -Wno-unused-parameter -Wno-unused-function -Wno-missing-field-initializers -Wno-unknown-pragmas -Wno-type-limits -Wno-array-bounds -Wno-strict-overflow -Wno-strict-aliasing -Wno-maybe-uninitialized -fvisibility=hidden -O2 -pthread -fopenmp -MD -MT caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/RegisterCPU.cpp.o -MF caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/RegisterCPU.cpp.o.d -o caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/RegisterCPU.cpp.o -c /home/daniel/Work/pytorch_v2.3.1/build/aten/src/ATen/RegisterCPU.cpp
c++: fatal error: Killed signal terminated program cc1plus
compilation terminated.
[9/1464] Building CXX object caffe2/CMakeFiles/torch_cpu.dir/__/aten/src/ATen/Operators_2.cpp.o
ninja: build stopped: subcommand failed.
Versions
daniel@daniel-nvidia:~/Work/pytorch$ python3 collect_env.py
Collecting environment information...
PyTorch version: N/A
Is debug build: N/A
CUDA used to build PyTorch: N/A
ROCM used to build PyTorch: N/A
OS: Ubuntu 20.04.6 LTS (aarch64)
GCC version: (Ubuntu 9.4.0-1ubuntu1~20.04.2) 9.4.0
Clang version: Could not collect
CMake version: version 3.31.0
Libc version: glibc-2.31
Python version: 3.8.10 (default, Nov 7 2024, 13:10:47) [GCC 9.4.0] (64-bit runtime)
Python platform: Linux-5.10.216-tegra-aarch64-with-glibc2.29
Is CUDA available: N/A
CUDA runtime version: 11.4.315
CUDA_MODULE_LOADING set to: N/A
GPU models and configuration: Could not collect
Nvidia driver version: Could not collect
cuDNN version: Probably one of the following:
/usr/lib/aarch64-linux-gnu/libcudnn.so.8.6.0
/usr/lib/aarch64-linux-gnu/libcudnn_adv_infer.so.8.6.0
/usr/lib/aarch64-linux-gnu/libcudnn_adv_train.so.8.6.0
/usr/lib/aarch64-linux-gnu/libcudnn_cnn_infer.so.8.6.0
/usr/lib/aarch64-linux-gnu/libcudnn_cnn_train.so.8.6.0
/usr/lib/aarch64-linux-gnu/libcudnn_ops_infer.so.8.6.0
/usr/lib/aarch64-linux-gnu/libcudnn_ops_train.so.8.6.0
HIP runtime version: N/A
MIOpen runtime version: N/A
Is XNNPACK available: N/A
CPU:
Architecture: aarch64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 6
On-line CPU(s) list: 0-5
Thread(s) per core: 1
Core(s) per socket: 3
Socket(s): 2
Vendor ID: ARM
Model: 1
Model name: ARMv8 Processor rev 1 (v8l)
Stepping: r0p1
CPU max MHz: 1510.4000
CPU min MHz: 115.2000
BogoMIPS: 62.50
L1d cache: 384 KiB
L1i cache: 384 KiB
L2 cache: 1.5 MiB
L3 cache: 2 MiB
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, but not BHB
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm lrcpc dcpop asimddp uscat ilrcpc flagm
Versions of relevant libraries:
[pip3] numpy==1.23.5
[pip3] onnx==1.17.0
[pip3] onnx-graphsurgeon==0.3.12
[pip3] onnxruntime==1.16.3
[pip3] onnxruntime-gpu==1.17.0
[pip3] onnxslim==0.1.36
[pip3] optree==0.13.1
[pip3] torch==2.1.0a0+41361538.nv23.6
[pip3] torch2trt==0.5.0
[pip3] torchvision==0.16.1
[conda] Could not collect
cc @malfet @seemethere @ptrblck @puririshi98 @chauhang @penguinwu