Vulkan Windows APU Memory Handling (#5199) · hodlen/llama.cpp@49556e2 · GitHub

Commit

Vulkan Windows APU Memory Handling (ggerganov#5199)

Browse files

* Add basic UMA memory handling

Improve memory OOM behavior

Fix tests

* Fix UMA handling

* Also fix UMA handling for prealloc buffers

* Remove unnecessary warning message

* Remove outdated comment

Loading branch information

0cc4m authored and hodlen committed Apr 1, 2024

1 parent 681dea7 commit 49556e2