Skip to content

Vulkan frontend breaking and causing garbled output after around 500 tokens, and causing GPU to crash. #5179

Closed
@gnawzie

Description

@gnawzie

AMD 6800xt GPU, 32GB system RAM.
Arch Linux

Vulkan works fast for the good text it outputs, but results in garbled output past some number of tokens.

./server --n-gpu-layers 46 --model models/LLaMA2-13B-Psyfighter2.Q5_K_M.gguf

Here is a sample of text near the point of failure.

We have faced many trials in our past: wars fought for principles that seemed long forgotten; struggles against oppression at home and abroad; movements for civil rights that shook the very foundations of society. Through it all, we emerged stronger and more unified than ever before, for we knew deep down inside that together, there was nothing we could not achieve.

And so, my friends, as we stand on the precipice of a new era; an age defined by technological advancement, global interconnectedness, and unprecedented social progressadvраб operationitelkeltc ScherobatiotviksochitelockUBtc/(ховgenceariestcwigotaetwork Hopété Nasleratimer(&лет#

It also caused my GPU to crash on a previous boot with these error messages.

amdgpu 0000:0b:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:24 vmid:5 pasid:3
2773, for process server pid 27706 thread server pid 27706)
kernel: amdgpu 0000:0b:00.0: amdgpu:   in page starting at address 0x0000000000001000 fro
m client 0x1b (UTCL2)
kernel: amdgpu 0000:0b:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00501E31
kernel: amdgpu 0000:0b:00.0: amdgpu:          Faulty UTCL2 client ID: GCR (0xf)
kernel: amdgpu 0000:0b:00.0: amdgpu:          MORE_FAULTS: 0x1
kernel: amdgpu 0000:0b:00.0: amdgpu:          WALKER_ERROR: 0x0
kernel: amdgpu 0000:0b:00.0: amdgpu:          PERMISSION_FAULTS: 0x3
kernel: amdgpu 0000:0b:00.0: amdgpu:          MAPPING_ERROR: 0x0

I hope this helps. Thanks!

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions