5 ms·
Ask HN: anyone interested to build a hacker news with tags?
Could anyone help me build a hacker news with tags?
I am asking only those who are interested to have it as well because I only have a budget for the hosting for this.
The point is to be able to search through the whole archive using tags/keywords.
example of tags:
'security'
'crm'
'a/b testing'
'optimization'
'http', 'ssl', 'domain name'
'scala', 'c++', 'php', etc
'lua'
'sql'
'marketing'
'website'
'landing page'
=> get all posts that relate to each tag (and combinations of tags) sorted by points of individual posts/comments.
To do list:
1. import all hacker news database
2. insert in database all tags for all posts/comments, using an algorithm similar to the Kaggle Keyword Extraction algo (https://www.kaggle.com/c/facebook-recruiting-iii-keyword-extraction),
which will need to be refined.
3. create great user interface to the new database
-------
or if no-one has the time, could anyone advise me on how to download the whole hacker news database?
- captn3m0 12y ago1. You can download the dataset using http://hn.algolia.com/api http://hn.algolia.com/api. Mind the rate-limits, though. 2. This has already been done quite a few times by various apps, most prominently here: http://algorithmia.com/demo/hn http://algorithmia.com/demo/hn (http://blog.algorithmia.com/post/86295023534/algorithmic-tagging-of-hackernews-or-any-other-site http://blog.algorithmia.com/post/86295023534/algorithmic-tag...)
- tucson 12y agohttp://hn.algolia.com/api http://hn.algolia.com/api Thanks. How many requests would that require ? http://algorithmia.com/demo/hn http://algorithmia.com/demo/hn does not work for me.
- captn3m0 12y agoThe first link states at the bottom: "We are limiting the number of API requests from a single IP to 10,000 per hour. " The hn/tag demo works one time out of five refreshes for me, so keep trying. Here's a screenshot in case that doesn't work: http://imgur.com/yPF0hkn http://imgur.com/yPF0hkn
- tucson 12y agoThank you. I appreciate the screenshot. Interesting; I get the feeling the tag algorithm is crucial to make it work. Not sure it's such a clear no-brainer as I first imagined it...
- stevekemp 12y agoSee the new API too: https://news.ycombinator.com/item?id=8422599 https://news.ycombinator.com/item?id=8422599
- wanghq 12y agoCan't you just search the keywords? I wonder how useful it would be given that the information (tech articles, such as rails2.1, best features in jQuery1.0,...) will be out-of-date as time goes. I think what's useful is various tools if they are still alive. That's why I want to build a toolbox which collects all the useful tools. https://news.ycombinator.com/item?id=8413016 https://news.ycombinator.com/item?id=8413016