5 ms·

Not really a computer but some distributed systems already work that way. I've read somewhere that Netflix (might have been Amazon?) is designed in such a way t

by C-- 12y ago

Not really a computer but some distributed systems already work that way. I've read somewhere that Netflix (might have been Amazon?) is designed in such a way that it's capable of satisfying certain requirements even when services are down.

aeturnum 12y ago
It's netflix: http://techblog.netflix.com/2012/07/chaos-monkey-released-into-wild.html http://techblog.netflix.com/2012/07/chaos-monkey-released-in...
scrollaway 12y ago
Are we talking about a "fallback db servers take over when the main ones drop", or "static assets server morphs into temporary db server if the main one drops"? Because there is a massive difference.
- Dylan16807 12y ago
  There are crazy cases of plasticity like that, this is more of "massive nosql caching infrastructure is down, everything else works overdrive to still mostly function correctly".
  - scrollaway 12y ago
    So when your legs stop working and you start crawling around the floor with your hands pulling the rest of your body, is that plasticity too? It's easy to continue working at increased costs when you don't have a cache. That's.. that's what a cache is for; it's not critical to the infrastructure, it's here to reduce the costs. Not to rain on any parade of course, I'm just pointing out I'd like to see more cases of actual plasticity of an email server that puts all jobs on hold while it temporarily takes over for a database server that just stopped responding.
    - Dylan16807 12y ago
      I'm not saying servers can be plastic worth anything, I'm saying that the role of the cerebellum is to assist functions that exist elsewhere, so missing it is not the same as missing a primary functional unit. The motor cortex is still doing its original job, it just has to work harder.
    - evincarofautumn 12y ago
      Caching can be critical if the volume is high enough. There are physical limitations of computing appliances that make sites like Google or Facebook actually impossible to run without extensive caching and indexing layers, not just prohibitively expensive.
      - scrollaway 12y ago
        I thought that was obvious. OP was making a point about things running without cache at the cost of increased load... I'm sure Google Search couldn't reliably achieve that right now, but we were not talking about Google Search.
        evincarofautumn 12y ago
        Right. I figured I wasn’t telling you anything new, but thought it worth making explicit for the benefit of others.
  - sitkack 12y ago
    If one designed their down-scaling properly, the caching layer would be shut off as the system contracted, not being part of solving the domain problem.
- superuser2 12y ago
  With virtualization/containerization that's not an unreasonable scenario. One of VMWare's selling points is that a sufficiently expensive vSphere cloud can expand and contract over its available hardware depending on load/time-of-day. With iLO integration, it can even power off the hardware it's not using and power it on when needed. If one server goes down, its VMs can be distributed over the remaining hypervisor, leading to potential resource contention but maintaining availability. So, sort of.
deleted 12y ago
[deleted]

by C-- 12y ago

aeturnum 12y ago

It's netflix: http://techblog.netflix.com/2012/07/chaos-monkey-released-into-wild.html http://techblog.netflix.com/2012/07/chaos-monkey-released-in...

scrollaway 12y ago

Are we talking about a "fallback db servers take over when the main ones drop", or "static assets server morphs into temporary db server if the main one drops"? Because there is a massive difference.

Dylan16807 12y ago
There are crazy cases of plasticity like that, this is more of "massive nosql caching infrastructure is down, everything else works overdrive to still mostly function correctly".
- scrollaway 12y ago
  So when your legs stop working and you start crawling around the floor with your hands pulling the rest of your body, is that plasticity too? It's easy to continue working at increased costs when you don't have a cache. That's.. that's what a cache is for; it's not critical to the infrastructure, it's here to reduce the costs. Not to rain on any parade of course, I'm just pointing out I'd like to see more cases of actual plasticity of an email server that puts all jobs on hold while it temporarily takes over for a database server that just stopped responding.
  - Dylan16807 12y ago
    I'm not saying servers can be plastic worth anything, I'm saying that the role of the cerebellum is to assist functions that exist elsewhere, so missing it is not the same as missing a primary functional unit. The motor cortex is still doing its original job, it just has to work harder.
  - evincarofautumn 12y ago
    Caching can be critical if the volume is high enough. There are physical limitations of computing appliances that make sites like Google or Facebook actually impossible to run without extensive caching and indexing layers, not just prohibitively expensive.
    - scrollaway 12y ago
      I thought that was obvious. OP was making a point about things running without cache at the cost of increased load... I'm sure Google Search couldn't reliably achieve that right now, but we were not talking about Google Search.
      - evincarofautumn 12y ago
        Right. I figured I wasn’t telling you anything new, but thought it worth making explicit for the benefit of others.
- sitkack 12y ago
  If one designed their down-scaling properly, the caching layer would be shut off as the system contracted, not being part of solving the domain problem.
superuser2 12y ago
With virtualization/containerization that's not an unreasonable scenario. One of VMWare's selling points is that a sufficiently expensive vSphere cloud can expand and contract over its available hardware depending on load/time-of-day. With iLO integration, it can even power off the hardware it's not using and power it on when needed. If one server goes down, its VMs can be distributed over the remaining hypervisor, leading to potential resource contention but maintaining availability. So, sort of.

deleted 12y ago

[deleted]