GitHub

Transparent, transport-layer semantic cache for LLM API calls powered by Redis Vector Sets.

Illustrative figures at a 0.50 hit rate (280ms cache replay vs. ~7900ms upstream call). Your numbers depend on traffic. Khazad intercepts LLM HTTP traffic at the transport layer and serves ...