Can cuda core and tensor core operate at the same time? For example, if my thread block have 8 warps and I write 2 strategies for them. For warp0, it will use cuda core to calculate sth. For the rest 7 warps, they will all use tensor core for some calculation. Can these warps operate in parallel?

Typically yes, you can run them at the same time, each SM Partition has its own tensor core unit and normal cuda cores, so it matters, which warps use one or the other that the workload is distributed well.

Use cuda core & tensor core at the same time

Accelerated Computing CUDA CUDA Programming and Performance

Robert_Crovella September 9, 2024, 12:32pm 5

Here are some related threads: 1 2 3 4

Topic		Replies	Views
Is it possible to use cuda core and tensorcore concurrently ? Deep Learning (Training & Inference) mixed-precision	0	1630	October 13, 2019
Can a warp scheduler send instructions to tensor core and cuda core concurrently? CUDA Programming and Performance	2	40	May 5, 2025
Can CUDA Core and Tensor Core in one SM execute concurrently? CUDA Programming and Performance	1	841	August 25, 2023
Tensor cores and CUDA cores work in parallel Video Processing & Optical Flow cuda	2	204	July 10, 2024
How to use cuda core and tensor core simultaneously？ GPU-Accelerated Libraries cuda	4	627	August 16, 2022
Difference between CORE and GRID CUDA Programming and Performance	5	2816	June 9, 2012
Tensor Cores Jetson AGX Xavier	8	1332	October 18, 2021
Turing 16x16 MMA, SM usage, 1 or 2? CUDA Programming and Performance	2	1022	December 8, 2018
About the relationship between warp and tensor_core CUDA Programming and Performance	7	1423	July 7, 2023
Cuda operations along side Tensor operations CUDA Programming and Performance	2	481	October 12, 2021

Use cuda core & tensor core at the same time

Related topics