Trimble Business Center

 View Only
Back to discussions
Expand all | Collapse all

CUDA error with RTX 5000 series when training custom DL model in TBC

  • 1.  CUDA error with RTX 5000 series when training custom DL model in TBC

    Posted 3 hours ago

    Hi everyone,
    I'm running into a CUDA runtime error when using the custom DL model training to train the demo stockpile dataset.
    And I'm trying to find out whether this is a GPU compatibility issue or if there is a supported workaround. 

    My error (read from log file):

    RuntimeError: CUDA error: no kernel image is available for execution on the device
    CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
    For debugging consider passing CUDA_LAUNCH_BLOCKING=1
    Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions.

    CUDA compiler:
    nvcc: NVIDIA (R) Cuda compiler driver
    Release: CUDA 13.0, V13.0.88

    GPU: Dual NVIDIA RTX 5070 Ti

    OS: Windows 10 Pro


    ------------------------------
    Hoang Bach Cao
    ------------------------------