Columnar storage: 3 real scaling case studies
3 of the 73 engineering write-ups in our database are tagged with the technique "columnar storage". They come from 2 companies (Cloudflare and Datadog) and were published between 2018 and 2022. Stack that shows up most often in these stories: ClickHouse (2) and Go (2). 1 of the 3 state concrete scale numbers, for example "6M requests/sec" (Cloudflare). Each card below links to our short summary and the original post.
Cloudflare · 2022
Log analytics using ClickHouse
Cloudflare moved its error-log pipeline to ClickHouse and shares schema and query lessons.
Datadog · 2022
Introducing Husky, Datadog's third-generation event store
Datadog's Husky is a distributed, schemaless column store that keeps event data on object storage.
Cloudflare · 2018
HTTP Analytics for 6M requests per second using ClickHouse
Cloudflare rebuilt its HTTP analytics pipeline on ClickHouse, replacing a Postgres/Citus setup.
Get new columnar storage scaling stories weekly
One email a week. No spam.