mirrors/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2025-05-11 18:36:41 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

remove cuda v11 (#10569)

Browse source 
This reduces the size of our Windows installer payloads by ~256M by dropping
support for nvidia drivers older than Feb 2023.  Hardware support is unchanged.

Linux default bundle sizes are reduced by ~600M to 1G.
This commit is contained in:
Daniel Hiltgen 2025-05-06 17:33:19 -07:00 • committed by GitHub
parent 307e3b3e1d
commit fa393554b9
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
11 changed files with 11 additions and 58 deletions
Download patch file Download diff file Expand all files Collapse all files

2
llm/server.go
View file

@ -286,7 +286,7 @@ func NewLlamaServer(gpus discover.GpuInfoList, modelPath string, f *ggml.GGML, a
params = append(params, "--mmproj", projectors[0])
}
// iterate through compatible GPU libraries such as 'cuda_v12', 'cuda_v11', 'rocm', etc.
// iterate through compatible GPU libraries such as 'cuda_v12', 'rocm', etc.
// adding each library's respective path to the LD_LIBRARY_PATH, until finally running
// without any LD_LIBRARY_PATH flags
for {