Skip to content

Ask the HotKV docs

Answers come only from these docs and can be wrong; check the linked pages before you rely on them.

LLMSTATS.BUCKET

Last updated
LLMSTATS.BUCKET name
Group
LLM usage and budgets
Complexity
O(1)
Arity
2 (exactly, counting the command name)
Flags
write, fast
Keys
first 1, last 1, step 1
HotKV Cloud
Performance and Scale
On-Premise
requires the llm-stats license feature

LLM usage stats keep running totals of the requests, tokens, cost and latency of your model calls in named buckets, for example one per tenant or per model. LLMSTATS.BUCKET creates an empty bucket. It is safe to call on a bucket that already exists, which is left unchanged. You do not have to call it first: LLMSTATS.RECORD creates a missing bucket too.

Case RESP2 RESP3
Bucket created or already present Simple string OK Same

Errors:

  • ERR bucket limit reached if the bucket is new and the server already holds its maximum number of buckets (max_buckets under [llmstats]).
  • ERR wrong number of arguments for 'llmstats.bucket' command if the argument count is wrong.
  • NOLICENSE llm-stats requires a HotKV license. Contact sales@hotkv.com if your license does not include the llm-stats feature.
127.0.0.1:6379> LLMSTATS.BUCKET tenant_acme
OK
127.0.0.1:6379> LLMSTATS.BUCKET tenant_acme
OK

HotKV-only command. Redis and Valkey have no equivalent.

LLMSTATS.RECORD, LLMSTATS.GET, LLMSTATS.RESET, LLMSTATS.DROP, LLMSTATS.LIST, LLMSTATS.PRICE, AI features guide