GKE Pod Snapshots Cut Model Load Times, and Move the Work to Snapshot Lifecycle Management

Google has published benchmarks for GKE Pod snapshots, reporting up to 89% lower startup latency and a 70B model loading in 37 seconds. The feature checkpoints CPU and GPU memory through gVisor...