Skip to main content

Grafana Dashboards

The Docker Compose stack includes Prometheus and Grafana configuration.

Start the stack:

docker compose up -d

Open Grafana:

http://localhost:3000

Overview dashboard​

Shows:

  • traffic
  • cache hit rate
  • upstream calls
  • gross chat savings
  • embedding cost
  • net savings
  • semantic lifecycle signals

Diagnostics dashboard​

Shows:

  • readiness
  • shutdown state
  • in-flight requests
  • upstream timeouts
  • semantic candidates
  • threshold pass/fail
  • expired entries skipped
  • semantic store errors

Cost breakdown​

gross chat savings - embedding cost = net savings