Prefill-as-a-Service:KVCache of Next-Generation Models Could Go Cross-Datacenter

Why it matters

The nextgeneration community will be debating this. Pay attention to how prefillasaservicekvcache players respond in the coming weeks.