Skip to content

Ask the HotKV docs

Answers come only from these docs and can be wrong; check the linked pages before you rely on them.

PCACHE.GETEX

Last updated
PCACHE.GETEX namespace prompt
Group
Prompt cache
Complexity
O(1)
Arity
3 (exactly, counting the command name)
Flags
read-only, fast
Keys
first 1, last 1, step 1
HotKV Cloud
Performance and Scale
On-Premise
requires the prompt-cache license feature

The prompt cache is an exact-match cache for LLM prompt and response pairs, organised in named namespaces. PCACHE.GETEX works like PCACHE.GET, but on a hit it also returns the metadata stored with META and the number of times the entry has been hit, including this one. In an existing namespace, it counts as a hit or a miss in PCACHE.STATS the same way.

Case RESP2 RESP3
Hit Array of three elements: the response (bulk string), the metadata (bulk string, empty if none), the hit count (integer) Same
Miss, expired entry, or unknown namespace Nil bulk string Null

Errors:

  • ERR wrong number of arguments for 'pcache.getex' command if the argument count is wrong.
  • NOLICENSE prompt-cache requires a HotKV license. Contact sales@hotkv.com if your license does not include the prompt-cache feature.
127.0.0.1:6379> PCACHE.SET llm_prompts "Translate: Hello" "Bonjour" META "{\"lang\":\"fr\"}"
OK
127.0.0.1:6379> PCACHE.GETEX llm_prompts "Translate: Hello"
1) "Bonjour"
2) "{\"lang\":\"fr\"}"
3) (integer) 1
127.0.0.1:6379> PCACHE.GETEX llm_prompts "Translate: Hello"
1) "Bonjour"
2) "{\"lang\":\"fr\"}"
3) (integer) 2

HotKV-only command. Redis and Valkey have no equivalent.

PCACHE.CREATE, PCACHE.SET, PCACHE.GET, PCACHE.DEL, PCACHE.STATS, PCACHE.FLUSH, PCACHE.DROP, PCACHE.LIST, PCACHE.CONFIG, AI features guide