Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
snikolov
searching Neon…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
8 ms
·
1.
▲
by
snikolov
13y ago
a program can still generate the score that a musician plays sincerely
2.
▲
by
snikolov
14y ago
People who do hard work tend to bite off more than they can chew, especially at MIT, and there is obviously a limit to how much you can handle. What MIT does right when it comes to stress relief is its housing system. You get to pick where
3.
▲
by
snikolov
14y ago
It is online learning, but as far as I understand, there is another side to it. Right now, if you get a new data stream, you have to play around to build the right models for it (mostly manually, with trial and error) before you do online l
4.
▲
Jeff Hawkins Develops a Brainy Big Data Company
(bits.blogs.nytimes.com)
16 points
by
snikolov
14y ago
|
2 comments
5.
▲
by
snikolov
14y ago
It sort of comes down to the question of what's really being learned here? That's a great question. We are learning to recognize trends and non-trends based on previous examples. Since the Twitter trends algorithm gives us such examples,
6.
▲
by
snikolov
14y ago
Thanks! I'm afraid my background, like yours, is more in methods that are not specialized for time series, and so I couldn't credibly give any comprehensive references. My understanding is that a lot of methods designed specifically for tim
7.
▲
by
snikolov
14y ago
You bring up a great point. To classify something as a trend or not a trend, we have to use this artificial black box to supply ourselves with examples of what's a trend and what isn't. The nice thing, IMO (and this is something I admittedl
8.
▲
by
snikolov
14y ago
You can get the trending topics through the Twitter API https://dev.twitter.com/docs/api/1/get/trends/%3Awoeid But I think what you are asking is how such a method would come up with its own trends, given just a stream of tweets. This is
9.
▲
Early detection of Twitter trends explained
(snikolov.wordpress.com)
75 points
by
snikolov
14y ago
|
11 comments
10.
▲
by
snikolov
14y ago
Not in general. I was part of the VI-A program ( http://vi-a.mit.edu/ ) at MIT, which allows you to do your thesis at a company.
11.
▲
by
snikolov
14y ago
I agree with you --- this seems like a perfectly good way to tackle the problem of trend prediction directly. What we had in mind was something that would be more generally applicable to any kind of time series data, and we figured it would
12.
▲
by
snikolov
14y ago
Thanks for the interest! We collected tweets by sampling a small percentage of all tweets in a time window, to emulate what one might get from the streaming API (I did this as part of the VI-A http://vi-a.mit.edu/ masters program at MIT,
13.
▲
by
snikolov
14y ago
My problem is often in the other extreme. I tell myself "I don't want to bother so and so, I still haven't tried x." But there's a point at which you should ask for help if you're no longer making progress. Especially if your question is ex
14.
▲
by
snikolov
14y ago
Dynamic Time Warping is a pretty neat application of dynamic programming that takes two time series and tries to squish one time series to look like the other, with some constraints that you can't do too much squishing. This is used a lot i
15.
▲
by
snikolov
14y ago
Indeed, projection onto the principal subspace is a kind of regularization, which makes for better generalization. This kind of makes sense intuitively. These slides go into more detail (the whole course is great), where it says "Projection
16.
▲
by
snikolov
14y ago
For what it's worth, I loved your post too. It reminded me of chats with my advisor. I'd walk in thinking "who the hell am I to push the boundaries of human knowledge?" and walk out excited to get back to work.
17.
▲
by
snikolov
14y ago
A nonparametric model for anomaly detection, classification, and prediction in timeseries. It observes the trajectory of some measurement over time and compares it to tons of historical trajectories to see if it looks like anything that has
18.
▲
by
snikolov
14y ago
I would caution against this approach. First, he is aiming to pass all the course requirements for a CS degree from MIT in only 1 year (including the non-CS requirements). His definition of passing is getting a passing grade on the final if
19.
▲
by
snikolov
14y ago
What struck me most is that this course helped form lasting communities who are now studying other material together. That is just wonderful. A community you can discuss the material with will help people learn the material much better. Als
20.
▲
by
snikolov
14y ago
I wonder why they couldn't (or didn't choose to) partner with individual professors on a per-course basis instead of entire institutions whose professors might not all be interested in participating. Is it because individual professors migh
21.
▲
by
snikolov
14y ago
According to a new analysis, if you want to run a tech company, you shouldn't drop out of college. More like "if you want to run a tech company, but you're not already running one that's becoming so successful it needs your full attention
22.
▲
by
snikolov
14y ago
I agree that that the boys and videogames thing is a bit of a misconception. But rather than attacking that misconception, we should be asking how poeple might come to have such misconceptions and how we can correct them. My takeaway is tha
23.
▲
by
snikolov
14y ago
Look at this way: for a 20000 category classification problem, guessing randomly will give you 0.005% accuracy. Compared to chance, this is pretty good.
24.
▲
by
snikolov
14y ago
Clustering algorithms operate on features, which typically have to be designed by hand. The appeal of deep learning is that it discovers good features automatically.
25.
▲
by
snikolov
14y ago
Would you care to elaborate? Surely most of the lines of code are not directly implementing theoretical things, but I would say the meat of the work is without a doubt theoretical.
26.
▲
by
snikolov
14y ago
6.001 doesn't exist anymore. The new set of intro courses are completely different. It sounded like you thought 6.001 is now taught in some other language.
27.
▲
by
snikolov
14y ago
I doubt it's that bad. It might be that he hadn't done any bit hacking in C in a while. If you haven't coded in matlab for a long time and I asked you (during an interview!) to do random bit hacking, you might feel stumped too. You'd probab
28.
▲
by
snikolov
14y ago
Gary Rubinstein wrote an excellent series of posts debunking the value added metrics http://garyrubinstein.teachforus.org/2012/02/26/analyzing-re...
29.
▲
by
snikolov
14y ago
Right, but brain capability is not a one dimensional quantity, and measurements of it are time-varying and noisy. This suggests that one shouldn't jump to conclusions before careful measurement, and that it is not trivial to compare measure
30.
▲
by
snikolov
14y ago
Really? Blunt criticism is fine with me (welcome, even!), but insults are completely unacceptable. Insults are disrespectful and create a hostile environment. It sucks when you have to deal with a hostile environment and we should try to av
More ›