Skip to content

Ask the HotKV docs

Answers come only from these docs and can be wrong; check the linked pages before you rely on them.

LLMSTATS.LIST

Last updated
LLMSTATS.LIST
Group
LLM usage and budgets
Complexity
O(N) where N is the number of buckets
Arity
1 (exactly, counting the command name)
Flags
read-only, fast
HotKV Cloud
Performance and Scale
On-Premise
requires the llm-stats license feature

LLM usage stats keep running totals of the requests, tokens, cost and latency of your model calls in named buckets, for example one per tenant or per model. LLMSTATS.LIST returns the names of all buckets on the server you are connected to, in no particular order. In a cluster, each node lists only the buckets it holds.

Case RESP2 RESP3
Always Array of bulk strings (empty if there are none) Same

Errors:

  • ERR wrong number of arguments for 'llmstats.list' command if the argument count is wrong.
  • NOLICENSE llm-stats requires a HotKV license. Contact sales@hotkv.com if your license does not include the llm-stats feature.
127.0.0.1:6379> LLMSTATS.LIST
1) "model_sonnet5"
2) "tenant_acme"

HotKV-only command. Redis and Valkey have no equivalent.

LLMSTATS.BUCKET, LLMSTATS.RECORD, LLMSTATS.GET, LLMSTATS.RESET, LLMSTATS.DROP, LLMSTATS.PRICE, AI features guide