What’s your take on inter-cluster communication?

E.g. I could hypothetically have 3 clusters:

1. Administrative
2. Web-Facing
3. Backend

Potential use cases:

• Backend might produce updated parquet files which needs to be transferred and made accessible on metabase in the Web-Facing cluster.
• Web-Facing might need to send batched inputs (from webhooks for example) to Backend for processing.

Good point about Tailscale. It hadn’t occurred to me.

How does DNS work for a Tailscale-networked cluster of servers?

My understanding is at least one of the nodes would need to be designated as the ingress. I could potentially also have all the master nodes hold the ingress, but then I believe that means I’d need to use round robin DNS in cloudflare to ensure the domains are always pointing at the cluster.

Storage might be a problem, but being more cloud aware potentially means I can run DuckDB against minio to scan S3 objects when doing data-intensive tasks.

I read into Docker Swarm, the community surrounding it is much smaller and there appear to be far fewer tutorials compared with k8s.

In addition to hosting the usual self-hosted applications that are often mentioned, I also do a good amount of processing of crypto and other financial data. Being able to more dynamically add/remove servers and have the containers automatically assigned / routed should at least in theory save me a lot of time administering the infrastructure.