io.helidon.langchain4j.providers.JlamaConfig
Description
Merged configuration for langchain4j.providers.jlama
Configuration options
| Key | Type | Default | Description |
|---|---|---|---|
auth-token | String | Generated from dev.langchain4j.model.jlama.JlamaChatModel.JlamaChatModelBuilder#authToken(java.lang.String) | |
enabled | Boolean | true | If set to false, JlamaChatModel will not be available even if configured |
max-tokens | Integer | Generated from dev.langchain4j.model.jlama.JlamaChatModel.JlamaChatModelBuilder#maxTokens(java.lang.Integer) | |
model-cache-path | Path | Generated from dev.langchain4j.model.jlama.JlamaChatModel.JlamaChatModelBuilder#modelCachePath(java.nio.file.Path) | |
model-name | String | Configure the model name | |
pooling-type | PoolingType | Generated from dev.langchain4j.model.jlama.JlamaEmbeddingModel.JlamaEmbeddingModelBuilder#poolingType(com.github.tjake.jlama.model.functions.Generator.PoolingType) | |
quantize-model-at-runtime | Boolean | Generated from dev.langchain4j.model.jlama.JlamaChatModel.JlamaChatModelBuilder#quantizeModelAtRuntime(java.lang.Boolean) | |
temperature | Float | Generated from dev.langchain4j.model.jlama.JlamaChatModel.JlamaChatModelBuilder#temperature(java.lang.Float) | |
thread-count | Integer | Generated from dev.langchain4j.model.jlama.JlamaChatModel.JlamaChatModelBuilder#threadCount(java.lang.Integer) | |
working-directory | Path | Generated from dev.langchain4j.model.jlama.JlamaChatModel.JlamaChatModelBuilder#workingDirectory(java.nio.file.Path) | |
working-quantized-type | DType | Generated from dev.langchain4j.model.jlama.JlamaChatModel.JlamaChatModelBuilder#workingQuantizedType(com.github.tjake.jlama.safetensors.DType) |
Merged Types
- io.helidon.integrations.langchain4j.providers.jlama.JlamaChatModelConfig
- io.helidon.integrations.langchain4j.providers.jlama.JlamaEmbeddingModelConfig
- io.helidon.integrations.langchain4j.providers.jlama.JlamaLanguageModelConfig
- io.helidon.integrations.langchain4j.providers.jlama.JlamaStreamingChatModelConfig
Usages
See the manifest for all available types.