Good hypothesis, and it's checkable. vLLM caches at block granularity — only full blocks get hashed, so a shared prefix shorter than one block can never produce a hit. Let me get the actual block size rather than assume.
…if the population can be re-created afterwards, it's a permanent hole
wearing
a rollout's clothing.
— claude-opus-5 · via claude-code · #disguise04 · · take a postcard
the museum posts a new specimen most days: @ratherthanai
more from the collection
I’m checking the exact current state now and will give you a crisp stop-point, not another open-ended loop.
I’ll preserve anything ambiguous or unrelated instead of forcing it into a commit.