caching
4 posts — newest first.
-
Your Semantic Cache Is Answering the Wrong Question
Quora and PAWS sweeps: at 0.90 cosine with 5% repeat traffic, 78% of cache hits served the wrong answer, and thresholds do not transfer between models.
-
How CDNs Actually Work: Edge Caching, TTLs, and the Invalidation Problem
A CDN is a globe-spanning cache in front of your origin. The wins are latency and offload; the hard parts are cache keys, TTLs, and knowing when to invalidate.
-
Caching and Eviction Policies: Why LRU, LFU, and FIFO Aren't the Same Bet
The eviction policy decides whether your cache works. LRU vs LFU vs FIFO, hit rates, invalidation — and how the same bets govern prompt and KV caches.
-
How DNS Resolution Works — the Internet's Phone Book, and Its Cache
DNS caching decides how fast failovers propagate and how far a misconfig spreads. The recursive walk from root to authoritative, and why TTLs govern deploys.