Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
bcleary
searching Neon…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
11 ms
·
1.
▲
by
bcleary
13y ago
I know javascript and jQuery suffer from their popularity and utility I think in this analysis. There is also the issue of jQuery and javascript tags being used by people as synonyms. jQuery particularly is a 500 pound gorilla over all the
2.
▲
by
bcleary
13y ago
No just the post bodies (question and answers) at the moment, but we are working parsing the comments and the post history, those datasets are about 4 times the size of the posts! So there are probably a lot more URLs in there, although we
3.
▲
by
bcleary
13y ago
Thanks. Yea i agree our initial use case was to provide an interface to the dataset and to allow us to explore what kinds of things developers were sharing on SO. For the next version we are working on new ranking metrics that will improve
4.
▲
by
bcleary
13y ago
Wow - ok looking into that now. What version of ios?
5.
▲
by
bcleary
13y ago
Thanks, yea second most requested feature after the domain filter. Will hopefully add soon.
6.
▲
by
bcleary
13y ago
Thanks, yes we are actually working on a paper to that effect at the moment.
7.
▲
by
bcleary
13y ago
Thanks. Yes the domain filter is a great idea, will go to the top of the feature request list. The site is c#, asp.net mvc, with a javascript front end, backed with sql server 2012. And running on AWS.
8.
▲
by
bcleary
13y ago
Thanks for the support. Yes to everything above :) We are currently mining the post history data to be able to do those kinds of time range queries. Cant wait to get that out there it should be very cool indeed, also want to allow users to
9.
▲
by
bcleary
13y ago
So these are taken from the March 2013 data dump, which includes questions going right back to the start of SO. So some of these links have been collecting citations for a few years. We only mined the actual post content on the date the dum
10.
▲
by
bcleary
13y ago
I actually had that in an earlier version and took it out just to simplify the design but i am actually looking at this again to produce a better sorting experience. Also the number of views a post receives may be a good metric also.
11.
▲
by
bcleary
13y ago
Wow, that's really cool, have to admit i didn't see that before. Let me know if your interested in sharing data, we are doing a lot of research in this area and the more data the better!
12.
▲
by
bcleary
13y ago
Thanks for the support, really encouraged by the feedback here on Hacker News. You guys are great. To your question, yes I am currently testing some ideas for a magic ranking system. One option is as you say a kind of random select amounts
13.
▲
by
bcleary
13y ago
Thanks, will update.
14.
▲
by
bcleary
13y ago
Thanks for the heads up, will modify the parser, again if anybody knows of a good open source crawler let me know. I rolled my own very quickly but would love it if i could find a 3rd party solution. Another option i have explored is pullin
15.
▲
by
bcleary
13y ago
Interesting in c# the second most popular link is for the BackgroundWorker class, not entirely the same use case but i guess similar motivations. http://msdn.microsoft.com/en-us/library/system.componentmode...
16.
▲
by
bcleary
13y ago
Thanks. Re the redirects, yea I have a lot of work to do on my crawler, my current solution is hand rolled and only has limited capabilities. But if anybody knows of a good open source project let me know, i have been looking at using the c
17.
▲
by
bcleary
13y ago
Yea, I know. I think it probably goes back to that SO joke about "Q - I have this programming problem" "A - jQuery"
18.
▲
by
bcleary
13y ago
Ah, you guessed my next paper :) I have done a little informal analysis on the top 10 results from linked_lists vs the top 10 for that tag used as a Google query. They are quite different, almost totally different actually. But this is not
19.
▲
by
bcleary
13y ago
Great idea, will try and look at that next.
20.
▲
by
bcleary
13y ago
Fixed.
21.
▲
by
bcleary
13y ago
Thanks, missed that one, will fix.
22.
▲
by
bcleary
13y ago
Thanks for the comments and votes. By the way if anybody is interested this was presented as part of the mining challenge at MSR2013 http://2013.msrconf.org/challenge.php and here is the paper http://thechiselgroup.org/2013/03/27/a-study
23.
▲
by
bcleary
13y ago
Thanks, yea we will have to do some work on cleaning up our title and description parser. Will add to the bug list.
24.
▲
by
bcleary
13y ago
Thanks for the heads up, fixed.
25.
▲
The most popular links posted by developers to Stack Overflow
(linkedlists.net)
203 points
by
bcleary
13y ago
|
65 comments