Class MomentoCache

A cache that uses Momento as the backing store. See https://gomomento.com.

Hierarchy

BaseCache
- MomentoCache

Index

Methods

lookup update fromProps

Methods

lookup

lookup(prompt, llmKey): Promise<null | Generation[]>
Lookup LLM generations in cache by prompt and associated LLM key.
Parameters
- prompt: string
  
  The prompt to lookup.
- llmKey: string
  
  The LLM key to lookup.
Returns Promise<null | Generation[]>
The generations associated with the prompt and LLM key, or null if not found.
Overrides BaseCache.lookup
- Defined in langchain/src/cache/momento.ts:101

update

update(prompt, llmKey, value): Promise<void>
Update the cache with the given generations.

Note this overwrites any existing generations for the given prompt and LLM key.
Parameters
- prompt: string
  
  The prompt to update.
- llmKey: string
  
  The LLM key to update.
- value: Generation[]
  
  The generations to store.
Returns Promise<void>
Overrides BaseCache.update
- Defined in langchain/src/cache/momento.ts:133

`Static` fromProps

fromProps(props): Promise<MomentoCache>
Create a new standard cache backed by Momento.
Parameters
- props: MomentoCacheProps
  
  The settings to instantiate the cache.
Returns Promise<MomentoCache>
The Momento-backed cache.

Throws
InvalidArgumentError if props.ttlSeconds is not strictly positive.
- Defined in langchain/src/cache/momento.ts:75

Generated using TypeDoc