Optional
aleph_Optional
best_Optional
cacheOptional
callbackUse callbacks
instead
Optional
callbacksOptional
completion_Optional
completion_Optional
concurrencyUse maxConcurrency
instead
Optional
contextual_Optional
disable_Optional
echoOptional
frequency_Optional
log_Optional
logit_Optional
maxThe maximum number of concurrent calls that can be made.
Defaults to Infinity
, which means no limit.
Optional
maxThe maximum number of retries that can be made for a single call, with an exponential backoff between each attempt. Defaults to 6.
Optional
metadataOptional
minimum_Optional
nOptional
onCustom handler to handle failed attempts. Takes the originally thrown error object as input, and should itself throw an error if the input error is not retryable.
Optional
penalty_Optional
penalty_Optional
penalty_Optional
presence_Optional
repetition_Optional
repetition_Optional
sequence_Optional
sequence_Optional
stopOptional
tagsOptional
temperatureOptional
tokensOptional
top_Optional
top_Optional
use_Optional
use_Optional
use_Optional
verboseGenerated using TypeDoc
Interface for the input parameters specific to the Aleph Alpha LLM.