Closed
Description
AMD 6800xt GPU, 32GB system RAM.
Arch Linux
Vulkan works fast for the good text it outputs, but results in garbled output past some number of tokens.
./server --n-gpu-layers 46 --model models/LLaMA2-13B-Psyfighter2.Q5_K_M.gguf
Here is a sample of text near the point of failure.
We have faced many trials in our past: wars fought for principles that seemed long forgotten; struggles against oppression at home and abroad; movements for civil rights that shook the very foundations of society. Through it all, we emerged stronger and more unified than ever before, for we knew deep down inside that together, there was nothing we could not achieve.
And so, my friends, as we stand on the precipice of a new era; an age defined by technological advancement, global interconnectedness, and unprecedented social progressadvраб operationitelkeltc ScherobatiotviksochitelockUBtc/(ховgenceariestcwigotaetwork Hopété Nasleratimer(&лет#
It also caused my GPU to crash on a previous boot with these error messages.
amdgpu 0000:0b:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:24 vmid:5 pasid:3
2773, for process server pid 27706 thread server pid 27706)
kernel: amdgpu 0000:0b:00.0: amdgpu: in page starting at address 0x0000000000001000 fro
m client 0x1b (UTCL2)
kernel: amdgpu 0000:0b:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00501E31
kernel: amdgpu 0000:0b:00.0: amdgpu: Faulty UTCL2 client ID: GCR (0xf)
kernel: amdgpu 0000:0b:00.0: amdgpu: MORE_FAULTS: 0x1
kernel: amdgpu 0000:0b:00.0: amdgpu: WALKER_ERROR: 0x0
kernel: amdgpu 0000:0b:00.0: amdgpu: PERMISSION_FAULTS: 0x3
kernel: amdgpu 0000:0b:00.0: amdgpu: MAPPING_ERROR: 0x0
I hope this helps. Thanks!