io.helidon.integrations.langchain4j.providers.oci.genai.OciGenAiChatModelConfig
Description
Configuration for LangChain4j model OciGenAiChatModel
Configuration options
| Key | Type | Default | Description |
|---|---|---|---|
gen-ai-client | GenerativeAiInferenceClient | Custom http client builder | |
seed | Integer | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#seed(java.lang.Integer) | |
default-request-parameters-discover-services | Boolean | true | Whether to enable automatic service discovery for default-request-parameters |
auth-provider | BasicAuthenticationDetailsProvider | Authentication provider is by default used from default Service bean found in Service Registry | |
enabled | Boolean | true | If set to false, OciGenAiChatModel will not be available even if configured |
num-generations | Integer | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseGenericChatModel.Builder#numGenerations(java.lang.Integer) | |
temperature | Double | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#temperature(java.lang.Double) | |
max-tokens | Integer | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#maxTokens(java.lang.Integer) | |
model-name | String | OCI LLM Model name or OCID | |
auth-provider-discover-services | Boolean | true | Whether to enable automatic service discovery for auth-provider |
logit-bias | Map<String, Integer> | Modifies the likelihood of specified tokens that appear in the completion | |
region-discover-services | Boolean | true | Whether to enable automatic service discovery for region |
serving-type | OciFactoryMethods | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#servingType(com.oracle.bmc.generativeaiinference.model.ServingMode.ServingType) | |
frequency-penalty | Double | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#frequencyPenalty(java.lang.Double) | |
default-request-parameters | ChatRequestParameters | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#defaultRequestParameters(dev.langchain4j.model.chat.request.ChatRequestParameters) | |
listeners | List<ChatModelListener> | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#listeners(java.util.List) | |
top-k | Integer | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#topK(java.lang.Integer) | |
top-p | Double | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#topP(java.lang.Double) | |
listeners-discover-services | Boolean | true | Whether to enable automatic service discovery for listeners |
stop | List<String> | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#stop(java.util.List) | |
compartment-id | String | OCI Compartment OCID | |
gen-ai-client-discover-services | Boolean | true | Whether to enable automatic service discovery for gen-ai-client |
log-probs | Integer | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseGenericChatModel.Builder#logProbs(java.lang.Integer) | |
region | OciFactoryMethods | Region is by default set to the current OCI region detected by OCI SDK | |
presence-penalty | Double | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#presencePenalty(java.lang.Double) |
See the manifest for all available types.