5 ms·

what is the difference between celld and Cloudflare Workers open source version workerd? https://github.com/cloudflare/workerd https://github.com/cloudflare/wo

• rough-sea 1mo ago
  workerd is missing the scheduler - the thing that allows it to operate across nodes. Durable Object storage are just local sqlite databases. celld is the full distributed system (albeit single tenant). It distributes DOs (cells) across any number of VMs. The databases for each DO are in object storage with RPO=0 guarantee.
  • kentonv 1mo ago
    You beat us to it! Been meaning to land this but got distracted. https://github.com/cloudflare/workerd/pull/6780 https://github.com/cloudflare/workerd/pull/6780 But honestly I love that there are multiple implementations now.
    • jitl 1mo ago
      bummer this expects NFS; this is all a brand new implementation vs what Cloudflare runs internally in production for DOs? I can’t imagine all your workerds share a single global NFS… What would a more realistic workerd with DO support look like? ah well, we have celld!
      • kentonv 1mo ago
        Honestly, you wouldn't want to run our internal implementation -- it's far too complicated. Unless you have 100+ datacenters around the world -- then maybe. The goal of this new design is to scale to a cluster while being operationally very easy to set up. Ideal for self-hosting. NFSv4 is an easy first step, convenient because it's broadly understood, has many implementations, and requires no client libraries. I could imagine a follow-up to support LiteFS instead of NFS could make a lot of sense, though it'll get more complicated. But yes, celld is definitely ahead of us here. No doubt about that.
        • raygen 1mo ago
          This just makes me curious, what does the internal implementation actually look like? I've always wondered what it is Cloudflare does to make DO's work but this specific thing doesn't seem explained anywhere
      • keybits 1mo ago
        ZeroFS might help here to put the actual storage on an S3 compatible object store? https://github.com/Barre/zerofs https://github.com/Barre/zerofs
        • srhtftw 1mo ago
          The ZeroFS readme says Dual-licensed under the GNU AGPL v3 (fully featured, for open source use) and a commercial license. but the commercial license link https://www.zerofs.net/licensing https://www.zerofs.net/licensing is a 404 page
        • jitl 1mo ago
          my interest in s3 is for how easy it is - just need HTTP. mounting a filesystem and worrying about filesystem level locks is more complicated.