7 ms·
Has anyone seen a similar comparison for medium-sized document classification tasks? I'd imagine LibLINEAR would perform far better for document classification
by fuzzmeister 14y ago
Has anyone seen a similar comparison for medium-sized document classification tasks? I'd imagine LibLINEAR would perform far better for document classification than it does in these results.
- ogrisel 14y agoHave a look at the RCV1 benchmarks on this page: http://leon.bottou.org/projects/sgd http://leon.bottou.org/projects/sgd SGD is still slightly faster but liblinear is behaving good enough in that case.
- ogrisel 14y agoOne unmentioned caveat of SGD is how to configure the learning rate schedule. scikit-learn is using Bottou's tricks that seem to work reasonably well in practice but it might even be better to implement the online estimate of optimal learning rate schedule from this NIPS 2012 pre-print: http://arxiv.org/abs/1206.1106 http://arxiv.org/abs/1206.1106 (No More Pesky Learning Rates).