mirror of
https://github.com/ollama/ollama.git
synced 2025-05-16 14:35:15 +02:00
d20cd8df80
The dynamically calculated `NumCtx` value wasn't making it all the way to the chat handler This fix made us notice that the minimum setting of `NumCtx` to 4 inside of `server/sched.go` was accidentally removed in #10364. The minimum doesn't make it out to the client code, which is important for embeddings, as demonstrated in `TestAllMiniLMEmbedTruncate`. This should be cleaned up more, but probably is caused by start and end tokens in the embedding, so small context sizes need some work there. See the comment in `server/routes.go` for more information on the temporary hack that's been added to propagate the dynamically calculated `NumCtx` (the -1 guard there is to keep embeddings working if you set `NumCtx` to some small value like `1`). Fixes: #10441 |
||
|---|---|---|
| .. | ||
| testdata | ||
| api_test.go | ||
| basic_test.go | ||
| concurrency_test.go | ||
| context_test.go | ||
| embed_test.go | ||
| llm_image_test.go | ||
| llm_test.go | ||
| max_queue_test.go | ||
| model_arch_test.go | ||
| README.md | ||
| utils_test.go | ||
Integration Tests
This directory contains integration tests to exercise Ollama end-to-end to verify behavior
By default, these tests are disabled so go test ./... will exercise only unit tests. To run integration tests you must pass the integration tag. go test -tags=integration ./...
The integration tests have 2 modes of operating.
- By default, they will start the server on a random port, run the tests, and then shutdown the server.
- If
OLLAMA_TEST_EXISTINGis set to a non-empty string, the tests will run against an existing running server, which can be remote