7 ms·

Then you can skip the middleman and just automate the taking-action part.

ghc 14y ago
That would be ideal, but often decision making follows a pattern similar to computational complexity theory. Even if the computer tells you what action you need to take, actually executing can be monumentally more complex for a computer. Automating lights is easy: just flip a switch. But how would you automate the bicycle barometer action? The computer can't put you on a bike! The field of "big data" is filled with applications where execution of decisions is monumentally more complex than decision making. But even if we can't automate decisions, telling people what to do is still way better than giving them a bunch of real time plots and leaving it up to them to use that data to make good decisions.
- deafbybeheading 14y ago
  Sure, I was being facetious. Even with actions that are simple to execute, I'm somewhat skeptical that a black box with a single recommendation is the best answer. I think that presenting the analysis as "do this, and here is why" would be a nice alternative for more complex systems--frequently dashboards and such throw data at you and completely punt on helping you interpret it.
  - ghc 14y ago
    Your suggestion is one often made to me so I didn't realize it was facetious. The truth is that many of the big data systems we build are starting to make complex decisions based on subtleties in data a non-expert human can't understand. We of course try to give reasoning along with the decisions, but it's often easier and cheaper to get decisions from a computer and then hire a domain expert as a consultant to write down the reasoning for the client in a monthly report. As long as the actions your software tells your clients to take will save them money they don't really care about seeing the reasoning beforehand. And if they choose not to take action, you can tell them how much money they lost by not implementing the advice of the computer. It's a surprisingly effective way to do business.
- dkarl 14y ago
  You're really stretching the meaning of, "They want our software to tell them what to do. Period." In the real world, as you mention, it makes sense to tell people what to do, because humans usually make better and cheaper robots than robots do, but in computing you only need humans for two things: physically interacting with hardware, and human judgment. In my admittedly limited experience in this domain, what people wanted was alerts that indicated that human investigation and judgment were needed. The systems I worked on only ever told humans to do one thing: "Look! Look at this!" If the system knew more, it did it. (A nice feature of one system I worked with was that it automated the routine aspects of investigation, so when an alert was generated, relevant information for the type of alert such as traceroute output and previous alerts related to a host was gathered and attached.) Bottom line: you never intentionally waste a human's time on things that don't require human judgment, and when human judgment comes into play, people want context. Good software helps people establish context for the decisions they make. The bike barometer, for example, doesn't actually tell you whether to bike or not. It just lets you know how a couple of factors balance against each other. The person reading the barometer will factor in other context such as how they feel that morning, whether they want some exercise that morning or would rather read a book on the tube, whether the bike is in good working condition, and so on. Granted, the systems I worked with were mostly used by full-time operations personnel. If you're talking about a system for non-specialists who may need prompting and guidance along the lines of, "It looks like you're trying to handle more load than usual. Would you like to spin up a few more servers?" then I guess I can see people wanting the software to give them explicit orders.
  - ghc 14y ago
    In the narrow context of software that exists entirely to deal with other software, you're probably right. But I build software that mainly optimizes non-virtual processes. These processes often require human oversight due to laws or safety regulations. Even in the cases where I'm building software where regulations don't get in the way, the real world is usually too messy for the computer to automatically take action because it would need to control a robot much more advanced than current technology allows for.
    - 14y ago

ghc 14y ago

That would be ideal, but often decision making follows a pattern similar to computational complexity theory. Even if the computer tells you what action you need to take, actually executing can be monumentally more complex for a computer. Automating lights is easy: just flip a switch. But how would you automate the bicycle barometer action? The computer can't put you on a bike! The field of "big data" is filled with applications where execution of decisions is monumentally more complex than decision making. But even if we can't automate decisions, telling people what to do is still way better than giving them a bunch of real time plots and leaving it up to them to use that data to make good decisions.

deafbybeheading 14y ago
Sure, I was being facetious. Even with actions that are simple to execute, I'm somewhat skeptical that a black box with a single recommendation is the best answer. I think that presenting the analysis as "do this, and here is why" would be a nice alternative for more complex systems--frequently dashboards and such throw data at you and completely punt on helping you interpret it.
- ghc 14y ago
  Your suggestion is one often made to me so I didn't realize it was facetious. The truth is that many of the big data systems we build are starting to make complex decisions based on subtleties in data a non-expert human can't understand. We of course try to give reasoning along with the decisions, but it's often easier and cheaper to get decisions from a computer and then hire a domain expert as a consultant to write down the reasoning for the client in a monthly report. As long as the actions your software tells your clients to take will save them money they don't really care about seeing the reasoning beforehand. And if they choose not to take action, you can tell them how much money they lost by not implementing the advice of the computer. It's a surprisingly effective way to do business.
dkarl 14y ago
You're really stretching the meaning of, "They want our software to tell them what to do. Period." In the real world, as you mention, it makes sense to tell people what to do, because humans usually make better and cheaper robots than robots do, but in computing you only need humans for two things: physically interacting with hardware, and human judgment. In my admittedly limited experience in this domain, what people wanted was alerts that indicated that human investigation and judgment were needed. The systems I worked on only ever told humans to do one thing: "Look! Look at this!" If the system knew more, it did it. (A nice feature of one system I worked with was that it automated the routine aspects of investigation, so when an alert was generated, relevant information for the type of alert such as traceroute output and previous alerts related to a host was gathered and attached.) Bottom line: you never intentionally waste a human's time on things that don't require human judgment, and when human judgment comes into play, people want context. Good software helps people establish context for the decisions they make. The bike barometer, for example, doesn't actually tell you whether to bike or not. It just lets you know how a couple of factors balance against each other. The person reading the barometer will factor in other context such as how they feel that morning, whether they want some exercise that morning or would rather read a book on the tube, whether the bike is in good working condition, and so on. Granted, the systems I worked with were mostly used by full-time operations personnel. If you're talking about a system for non-specialists who may need prompting and guidance along the lines of, "It looks like you're trying to handle more load than usual. Would you like to spin up a few more servers?" then I guess I can see people wanting the software to give them explicit orders.
- ghc 14y ago
  In the narrow context of software that exists entirely to deal with other software, you're probably right. But I build software that mainly optimizes non-virtual processes. These processes often require human oversight due to laws or safety regulations. Even in the cases where I'm building software where regulations don't get in the way, the real world is usually too messy for the computer to automatically take action because it would need to control a robot much more advanced than current technology allows for.
  - 14y ago