GitHub

Eval bug: data corruption on CUDA experts offload

ggml_cuda_init: found 2 CUDA devices: Device 0: NVIDIA GeForce RTX 5070 Ti, compute capability 12.0, VMM: yes Device 1: NVIDIA GeForce RTX 5070 Ti, compute capability ...