The Latency Budget: How to Save and What to Buy