Best way to set up self-managed Postgres clusters?

Question

Imagine you need to set up 100 Postgres clusters on Linux machines &ndash; self-managed, not RDS or CloudSQL or Azure or anything.What's the best path in YOUR opinion?1) apt/yum/... install2) docker / docker-compose3) kubernetes

throwaway38375 · Accepted Answer

There's no amount of money you could pay me to do this with Kubernetes. Like, you could offer me double my salary, and I'd laugh.
The only answer that makes any sense here is Ansible.
Arguments:
Way simpler
Can fall back to using plain SSH if things goes really wrong
No vendor lock in
One less bit of technology in the mix to go wrong
Very boring, which means very reliable

paulryanrogers · Answer

Do they need to interconnect, or are they all standalone?
How big are these instances expected to get for the next few years?
OLTP, OLAP, warehouse, or a combo?
What's your budget?
What is your team most familiar with?
Will they be publicly exposed for shared hosting? Or behind a VPN/VPC serving only your employer?
Has anyone had a good time using Docker for something like this? (I haven't but the paravirt persistence may have gotten better?)

west0n · Answer

You may try kubeblocks(kubeblocks.io), a database control plane that can run almost any database on K8s.

rad_gruchalski · Answer

Clusters? So with replication, leader election, load balancing, whole shebang? Kubernetes, with the help of one of the battle tested operators.

samokhvalov · Answer

~~Context: https://twitter.com/samokhvalov/status/1771573110858269014~1000 votes in just one day &ndash; obviously, this is an attractive topic to discuss, so wanted to have a thoughtful conversation here on HN.

notadeveloper · Answer

Sorry but do you mean nodes or clusters? Anyway at this scale you are definitely looking into managed services from cloud providers or using Kubernetes. 1 and 2 is not an option because of the maintenance burden. Rolling out upgrades and resource allocation is going to be very hard without Kubernetes.

k8svet · Answer

(after clicking through context...) There's no amount of money you could pay me to do this with Ansible. Like, you could offer me double my salary, and I'd laugh.The only answer that makes any sense here is Kubernetes.

Best way to set up self-managed Postgres clusters?

Imagine you need to set up 100 Postgres clusters on Linux machines – self-managed, not RDS or CloudSQL or Azure or anything.
What's the best path in YOUR opinion?
1) apt/yum/... install
2) docker / docker-compose
3) kubernetes

You may try kubeblocks(kubeblocks.io), a database control plane that can run almost any database on K8s.

Clusters? So with replication, leader election, load balancing, whole shebang? Kubernetes, with the help of one of the battle tested operators.

~~
Context: https://twitter.com/samokhvalov/status/1771573110858269014
~1000 votes in just one day – obviously, this is an attractive topic to discuss, so wanted to have a thoughtful conversation here on HN.

(after clicking through context...) There's no amount of money you could pay me to do this with Ansible. Like, you could offer me double my salary, and I'd laugh.
The only answer that makes any sense here is Kubernetes.