5 ms·

"False positive" has a precise meaning in statistical analysis. The second thing you're talking about is useful to know, but calling it the false positive rate

by felisml 11y ago

"False positive" has a precise meaning in statistical analysis. The second thing you're talking about is useful to know, but calling it the false positive rate is just wrong. "Out of 1000 positive tests, 50 were false positives, 950 were true positives" - valid statement. "The false positive rate was 50 out of 1000" - abuses a common technical term in a way that sounds valid on the face of it, but which is potentially VERY misleading. We can't even calculate a valid false positive rate from the above data, since that requires taking the ratio vs. all tests and not just positive tests.

SeanDav 11y ago
Here is a definition of False Positive from wikipedia: "In medical testing, and more generally in binary classification, a false positive is an error in data reporting in which a test result improperly indicates presence of a condition, such as a disease (the result is positive), when in reality it is not" I don't see anything here that definitively clarifies which of the 2 scenarios above it can exclusively be applied to.
- sdenton4 11y ago
  Right; this is the definition of the numerator (the number of false positives). The false positive RATE also has a denominator, which is defined as the total number of tests performed (the second case in the parent poster's question). Dividing by the number of positive tests instead gives what's called the 'false discovery rate' which is pretty rarely used.
- felisml 11y ago
  There are many ways in which you can incorrectly interpret statements on Wikipedia, which is why specialized textbooks and so forth still have use.
- timbre 11y ago
  That's what a "false positive" is but Wikipedia also has a separate article on "false positive rate", which gives the formula FP / (FP + TN) Where FP is number of false positives, and TN is number of true negatives. So it's a third option: - Out of 1000 actually negative samples, 50 were tested as positive. So in the case of 1000 samples, 949 correctly testing as negative, 50 incorrectly testing as positive, and 1 correctly testing as positive, the false positive rate is 50 / 999.

by felisml 11y ago

SeanDav 11y ago

Here is a definition of False Positive from wikipedia: "In medical testing, and more generally in binary classification, a false positive is an error in data reporting in which a test result improperly indicates presence of a condition, such as a disease (the result is positive), when in reality it is not" I don't see anything here that definitively clarifies which of the 2 scenarios above it can exclusively be applied to.

sdenton4 11y ago
Right; this is the definition of the numerator (the number of false positives). The false positive RATE also has a denominator, which is defined as the total number of tests performed (the second case in the parent poster's question). Dividing by the number of positive tests instead gives what's called the 'false discovery rate' which is pretty rarely used.
felisml 11y ago
There are many ways in which you can incorrectly interpret statements on Wikipedia, which is why specialized textbooks and so forth still have use.
timbre 11y ago
That's what a "false positive" is but Wikipedia also has a separate article on "false positive rate", which gives the formula FP / (FP + TN) Where FP is number of false positives, and TN is number of true negatives. So it's a third option: - Out of 1000 actually negative samples, 50 were tested as positive. So in the case of 1000 samples, 949 correctly testing as negative, 50 incorrectly testing as positive, and 1 correctly testing as positive, the false positive rate is 50 / 999.