Skip to content

Commit 0fff7fd

Browse files
authored
docs : vulkan build instructions to use git bash mingw64 (#10303)
1 parent 4e54be0 commit 0fff7fd

File tree

1 file changed

+25
-2
lines changed

1 file changed

+25
-2
lines changed

docs/build.md

Lines changed: 25 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -282,9 +282,9 @@ The following compilation options are also available to tweak performance (yes,
282282
283283
#### w64devkit
284284
285-
Download and extract [w64devkit](https://github.com/skeeto/w64devkit/releases).
285+
Download and extract [`w64devkit`](https://github.com/skeeto/w64devkit/releases).
286286
287-
Download and install the [Vulkan SDK](https://vulkan.lunarg.com/sdk/home#windows). When selecting components, only the Vulkan SDK Core is required.
287+
Download and install the [`Vulkan SDK`](https://vulkan.lunarg.com/sdk/home#windows) with the default settings.
288288
289289
Launch `w64devkit.exe` and run the following commands to copy Vulkan dependencies:
290290
```sh
@@ -302,6 +302,29 @@ EOF
302302
```
303303
Switch into the `llama.cpp` directory and run `make GGML_VULKAN=1`.
304304
305+
#### Git Bash MINGW64
306+
307+
Download and install [`Git-SCM`](https://git-scm.com/downloads/win) with the default settings
308+
309+
Download and install [`Visual Studio Community Edition`](https://visualstudio.microsoft.com/) and make sure you select `C++`
310+
311+
Download and install [`CMake`](https://cmake.org/download/) with the default settings
312+
313+
Download and install the [`Vulkan SDK`](https://vulkan.lunarg.com/sdk/home#windows) with the default settings.
314+
315+
Go into your `llama.cpp` directory and right click, select `Open Git Bash Here` and then run the following commands
316+
317+
```
318+
cmake -B build -DGGML_VULKAN=ON
319+
cmake --build build --config Release
320+
```
321+
322+
Now you can load the model in conversation mode using `Vulkan`
323+
324+
```
325+
build/bin/release/llama-cli -m "[PATH TO MODEL]" -ngl 100 -c 16384 -t 10 -n -2 -cnv
326+
```
327+
305328
#### MSYS2
306329
Install [MSYS2](https://www.msys2.org/) and then run the following commands in a UCRT terminal to install dependencies.
307330
```sh

0 commit comments

Comments
 (0)