Storage/compute separation: 2 real scaling case studies
2 of the 73 engineering write-ups in our database are tagged with the technique "storage/compute separation". They come from 2 companies (Datadog and GitHub) and were published between 2022 and 2026. 1 of the 2 state concrete scale numbers, for example "99.99999% of repositories copied to Azure" (GitHub). Each card below links to our short summary and the original post.
The bridge to agent-scale Git infrastructure
GitHub has copied 99.99999% of its Git repositories to Azure, where most now keep two of their five replicas and Azure serves about half of Git traffic. The busiest remaining repositories were blocked by a ~25ms cross-region round trip, because Spokes held a repository-wide lock for each write while waiting on the slowest healthy replica. Scoping the quorum to individual Git references lets writes to different branches proceed in parallel (3-4x higher throughput in internal testing), and a virtual write replica that streams writes into Azure Blob Storage lets stateless read replicas scale out on demand.
Introducing Husky, Datadog's third-generation event store
Datadog's Husky is a distributed, schemaless column store that keeps event data on object storage.