Trimble Business Center

 View Only
Expand all | Collapse all

CUDA error with RTX 5000 series when training custom DL model in TBC

  • 1.  CUDA error with RTX 5000 series when training custom DL model in TBC

    Posted 20 days ago

    Hi everyone,
    I'm running into a CUDA runtime error when using the custom DL model training to train the demo stockpile dataset.
    And I'm trying to find out whether this is a GPU compatibility issue or if there is a supported workaround. 

    My error (read from log file):

    RuntimeError: CUDA error: no kernel image is available for execution on the device
    CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
    For debugging consider passing CUDA_LAUNCH_BLOCKING=1
    Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions.

    CUDA compiler:
    nvcc: NVIDIA (R) Cuda compiler driver
    Release: CUDA 13.0, V13.0.88

    GPU: Dual NVIDIA RTX 5070 Ti

    OS: Windows 10 Pro


    ------------------------------
    Hoang Bach Cao
    ------------------------------


  • 2.  RE: CUDA error with RTX 5000 series when training custom DL model in TBC

    Posted 14 days ago

    Hi Hoang Bach,

    Thank you for your comment. The developer will investigate this issue.

    Regards,

    Evelina



    ------------------------------
    Evelina Indilaite-Gale
    ------------------------------



  • 3.  RE: CUDA error with RTX 5000 series when training custom DL model in TBC

    Posted 13 days ago

    I have exact same issue on Dell Precision Pro Max 16 laptop with NVIDIA RTX5000 GPU!!



    ------------------------------
    Dennis Belgrado
    ------------------------------