Optional ai21Optional baseOptional cacheOptional callbackUse callbacks instead
Optional callbacksOptional concurrencyUse maxConcurrency instead
Optional countOptional frequencyOptional logitOptional maxThe maximum number of concurrent calls that can be made.
Defaults to Infinity, which means no limit.
Optional maxThe maximum number of retries that can be made for a single call, with an exponential backoff between each attempt. Defaults to 6.
Optional maxOptional metadataOptional minOptional modelOptional numOptional onCustom handler to handle failed attempts. Takes the originally thrown error object as input, and should itself throw an error if the input error is not retryable.
Optional presenceOptional stopOptional tagsOptional temperatureOptional topPOptional verboseGenerated using TypeDoc
Interface for AI21 input parameters.