Permalink
Comparing changes
Choose two branches to see what’s changed or to start a new pull request.
If you need to, you can also or
learn more about diff comparisons.
Open a pull request
Create a new pull request by comparing changes across two branches. If you need to, you can also .
Learn more about diff comparisons here.
...
- 11 commits
- 55 files changed
- 2 contributors
Commits on Jan 14, 2025
-
-
-
-
-
-
-
-
llama : enable building vision with cmake
This commit addresses a few compilation and linking errors that were occurring when building the vision module with cmake.
-
llama : add llama-simple-vision-mllama example (wip)
This commit adds a vision example that uses Llama 3.2 Vision Instruct to experiment with the new Vision API and how a multi-modal cross-attention model works. The implementation is based on Ollama's multi-modal implementation with some modifications to make it work with the new Vision API. The motivation for this example is only to get some experience with multi-modal cross-attention and understand how it works. This is a bare minimum approach to get something working and see if it is something that is worth exploring further, but parts of this migth be useful on their own like the model conversion for example, and having this will enable the testing of the converted/quantized, model.
Loading
This comparison is taking too long to generate.
Unfortunately it looks like we can’t render this comparison for you right now. It might be too big, or there might be something weird with your repository.
You can try running this command locally to see the comparison on your machine:
git diff master...vision-api-mllama-example