Receive daily AI-curated summaries of engineering articles from top tech companies worldwide.
Endigest AI Core Summary
Cloudflare explains how their FL2 Rust-based request handling layer enabled 2x edge compute performance on Gen 13 servers powered by AMD EPYC Turin processors.
•AMD Turin 9965 doubles core count to 192 (vs Gen 12's 96) but reduces L3 cache per core from 12MB to 2MB, a 6x reduction due to the removal of 3D V-Cache
•FL1 (NGINX/LuaJIT) on Gen 13 suffered 50%+ latency regressions at high utilization, as cache misses required 350+ cycle DRAM accesses vs ~50 cycles for L3 hits
•Hardware tuning via AMD PQOS and NUMA-aware core affinity provided only marginal gains, proving a software-level fix was necessary
•FL2, a complete rewrite in Rust on Pingora and Oxy frameworks, cut the latency penalty by 70% and enabled throughput to scale linearly with core count
•
Gen 13 with FL2 achieves up to 2x throughput and 50% better performance per watt compared to Gen 12
This summary was automatically generated by AI based on the original article and may not be fully accurate.
Cloudflare
Dropbox
Google Cloud