HACKER Q&A
📣 gautamsomani

Largest DBs (any) you worked on?


Largest DBs (any) you worked on?


  👤 zX41ZdbW Accepted Answer ✓
ClickHouse cluster for web analytics data, 120 trillion records, mostly in two tables (hits and visits). 133 PiB uncompressed / 8.31 PiB compressed.

But it is not large compared to what other ClickHouse users have, for example:

> Ahrefs: main cluster is 100k+ CPU cores, 800TB RAM. 110PB nvme storage, uncompressed data size on main cluster is 1EB.

https://clickhouse.com/docs/en/about-us/adopters


👤 XCSme
Just a few hundred GBs of MySQL, which doesn't sound too big, but having tens of millions of rows can be tricky with some more complex query, to keep query time reasonable (within 1-2 seconds max).

👤 Malp
~1.5 PB. Observability data.

👤 gigatexal
size or disparate number of distinct dbs?

👤 not_your_vase
It was 25