io.helidon.integrations.langchain4j.providers.oci.genai.OciGenAiCohereChatModelConfig
Description
Configuration for LangChain4j model OciGenAiCohereChatModel
Configuration options
| Key | Type | Default | Description |
|---|---|---|---|
gen-ai-client | GenerativeAiInferenceClient | Custom http client builder | |
seed | Integer | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#seed(java.lang.Integer) | |
documents | List<Object> | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseCohereChatModel.Builder#documents(java.util.List) | |
default-request-parameters-discover-services | Boolean | true | Whether to enable automatic service discovery for default-request-parameters |
auth-provider | BasicAuthenticationDetailsProvider | Authentication provider is by default used from default Service bean found in Service Registry | |
enabled | Boolean | true | If set to false, OciGenAiCohereChatModel will not be available even if configured |
max-input-tokens | Integer | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseCohereChatModel.Builder#maxInputTokens(java.lang.Integer) | |
temperature | Double | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#temperature(java.lang.Double) | |
is-raw-prompting | Boolean | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseCohereChatModel.Builder#isRawPrompting(java.lang.Boolean) | |
max-tokens | Integer | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#maxTokens(java.lang.Integer) | |
model-name | String | OCI LLM Model name or OCID | |
auth-provider-discover-services | Boolean | true | Whether to enable automatic service discovery for auth-provider |
region-discover-services | Boolean | true | Whether to enable automatic service discovery for region |
serving-type | OciFactoryMethods | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#servingType(com.oracle.bmc.generativeaiinference.model.ServingMode.ServingType) | |
frequency-penalty | Double | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#frequencyPenalty(java.lang.Double) | |
default-request-parameters | ChatRequestParameters | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#defaultRequestParameters(dev.langchain4j.model.chat.request.ChatRequestParameters) | |
prompt-truncation | PromptTruncation | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseCohereChatModel.Builder#promptTruncation(com.oracle.bmc.generativeaiinference.model.CohereChatRequest.PromptTruncation) | |
citation-quality | CitationQuality | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseCohereChatModel.Builder#citationQuality(com.oracle.bmc.generativeaiinference.model.CohereChatRequest.CitationQuality) | |
listeners | List<ChatModelListener> | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#listeners(java.util.List) | |
top-k | Integer | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#topK(java.lang.Integer) | |
top-p | Double | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#topP(java.lang.Double) | |
is-search-queries-only | Boolean | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseCohereChatModel.Builder#isSearchQueriesOnly(java.lang.Boolean) | |
preamble-override | String | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseCohereChatModel.Builder#preambleOverride(java.lang.String) | |
listeners-discover-services | Boolean | true | Whether to enable automatic service discovery for listeners |
stop | List<String> | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#stop(java.util.List) | |
compartment-id | String | OCI Compartment OCID | |
gen-ai-client-discover-services | Boolean | true | Whether to enable automatic service discovery for gen-ai-client |
region | OciFactoryMethods | Region is by default set to the current OCI region detected by OCI SDK | |
presence-penalty | Double | Generated from dev.langchain4j.community.model.oracle.oci.genai.BaseChatModel.Builder#presencePenalty(java.lang.Double) |
See the manifest for all available types.