Skip to main content

Semantic Cache Lifecycle

Semantic cache entries include:

  • inserted_at
  • expires_at

Expiration is based on:

semantic_cache_retention_seconds 604800;

Runtime behavior

Expired entries:

  • are not reused
  • are filtered before similarity ranking
  • may remain stored in Qdrant until pruned

Cleanup

Local binary:

./target/release/ai-firewall \
--config configs/ai-firewall.conf \
--prune-expired-semantic-cache

Installed binary:

ai-firewall \
--config /etc/ai-firewall/ai-firewall.conf \
--prune-expired-semantic-cache

Docker Compose:

docker compose run --rm firewall \
--config /configs/ai-firewall.conf \
--prune-expired-semantic-cache

Pruning removes entries where:

expires_at <= now