24 pointsby grep_ita day ago1 comment
  • rdtsc3 hours ago
    > We built out a control plane service (CPS) responsible for automating Delta’s fleet management. Each instance of the CPS gets configured to monitor a list of Delta buckets. Its primary function includes repairing

    How does the configuration spread consistently across the nodes? How does each node know if each link to the next node is still the most up-to-date, based on the configuration system. This part usually is waved away but it’s one of the trickier bits. Usually there is some paxos/raft/zookeeper system involved here.