4 ms·
Awesome idea to help make capturing data more easy, but how will you deal with the problem of the curse of dimensionality? As you start to capture more variable
by dropdownmenu 14y ago
Awesome idea to help make capturing data more easy, but how will you deal with the problem of the curse of dimensionality? As you start to capture more variables you data begins to appear far apart leading to less meaningful results.
Also, while 'capturing everything' sounds like an awesome idea it can lead to worse performance if you don't take into account that your data now has more variables that can each introduce noise.
- disgruntledphd2 14y agoThe thing about the curse of dimensionality is that it only really kicks into play when you try to put every variable into a model (or when you have low n relative to p, generally). If you restrict yourself to analysing events that you actually care about, its much less of an issue.
- matm 14y ago"Capture everything" need not imply "measure everything." It should imply "measure anything you need to, immediately and retroactively".