How to benchmark AI processes on Jetson orin NX 8gb

Robotics & Edge Computing Jetson & Embedded Systems Jetson Orin NX
1

We have Jetson orin nx 8GB. We want to perform a benchmark on this device. Model for AI should be YOLOv8s on the Onnx or tensorflow framework. Please suggest a solution or a tool to perform this.

3

Hi,

You can get some basic benchmark results with the below source:

For a custom ONNX model, you can also get the perf result with the TensorRT binary.

$ /usr/src/tensorrt/bin/trtexec --onnx=[filename]

Thanks.

4

Sure thanks for the suggetion.

6

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.