6 ms·

Creator here, I would love to hear any feedback you all have. I also have around 3 months worth of historical data if anyone is interested or has a cool idea.

jabo 14y ago
I tried doing something like this a while ago. But HN kept blocking my IP after a few days of screen scraping. How did you get past that rate limit?
- marcneuwirth 14y ago
  I am using the bigrss feed as described in the latest post: http://ycombinator.com/newsnews.html http://ycombinator.com/newsnews.html
  - cooldeal 14y ago
    I wish it gave out the points the article had... does your data track that or just the position?
    - marcneuwirth 14y ago
      Just the position unfortunately, I would need to scrape the site itself in order to get comments and points info. It would be awesome if that data was added to the RSS feed
- peteretep 14y ago
  Were you hitting it more than once every 30 seconds?
  - jabo 14y ago
    No, I hit it once in 15 minutes!
pooriaazimi 14y ago
Very nice. I like it a lot. Would be nice if it showed more than 6 hours though, I'd like to see what's happened to the 'WhosHere' threads :) But why on earth redirecting to news.ycombinator.org? The official one is .com I think, and in the past couple years I've been visiting HN I've never seen anyone using .org (people link to previous HN threads all the time, and they all end in .com), so I think you should redirect people to .com domain. And It's not really important, but just FYI: It crashed when I tried zooming on iPad 2 (iOS 5.1.1). It's the second time ever my iPad's Safari crashes (first time being Linux's network on Github, that crashes every single browser on every platform, so don't even try opening it: https://github.com/torvalds/linux/network)* https://github.com/torvalds/linux/network)*.
- marcneuwirth 14y ago
  Fixed the .org domain, thanks for pointing that out. You actually _can_ look at up to the past 12 hours if you change the URL manually, but I have found the graph to be less useful from 6-12 hours How much data were you looking at when the iPad crashed? I use this daily on the new iPad and havent experienced any problems unless there was a ton of data on the screen
pooriaazimi 14y ago
Also, it would be nice to show timestamps (see http://hnrankings.info/4054568/ http://hnrankings.info/4054568/ for example. I have no idea when it dropped. When I move my cursor, it just shows 'Saturday, Jun 2, 2012').
EzGraphs 14y ago
Very cool - nice work. I like the idea of charts to see change over time(your charts are great - sparklines might be useful for seeing an individual post's status over time). Some ideas based on my similar project over at http://hn4d.com http://hn4d.com. Another are of interest that I track is the change in the number of comments over time. This also provides an indication of current activity and interest over time. Since you have historic data, perhaps a search would be useful. It might be interesting to see "longest lasting posts" or posts with the "greatest increase." In any case - very nice site, well implemented and easy to understand.
- marcneuwirth 14y ago
  Your project looks awesome, are you just scraping the homepage directly? Great suggestions, thanks
kylebrown 14y ago
In case anyone hasn't already seen it, "A journey through the bowels of proggit" http://corte.si/posts/socialmedia/redditgraph/index.html http://corte.si/posts/socialmedia/redditgraph/index.html
shaggyfrog 14y ago
All the curves are in a giant jumble at the top and are nearly indistinguishable from each other. Perhaps a log scale on the y-axis would improve readability?
miahi 14y ago
It's probably because I'm colorblind, but I find it hard to follow the lines in the default chart even when selected/highlighted. Can you increase the width of the selected line a little bit more?

jabo 14y ago

I tried doing something like this a while ago. But HN kept blocking my IP after a few days of screen scraping. How did you get past that rate limit?

marcneuwirth 14y ago
I am using the bigrss feed as described in the latest post: http://ycombinator.com/newsnews.html http://ycombinator.com/newsnews.html
- cooldeal 14y ago
  I wish it gave out the points the article had... does your data track that or just the position?
  - marcneuwirth 14y ago
    Just the position unfortunately, I would need to scrape the site itself in order to get comments and points info. It would be awesome if that data was added to the RSS feed
peteretep 14y ago
Were you hitting it more than once every 30 seconds?
- jabo 14y ago
  No, I hit it once in 15 minutes!

pooriaazimi 14y ago

Very nice. I like it a lot. Would be nice if it showed more than 6 hours though, I'd like to see what's happened to the 'WhosHere' threads :) But why on earth redirecting to news.ycombinator.org? The official one is .com I think, and in the past couple years I've been visiting HN I've never seen anyone using .org (people link to previous HN threads all the time, and they all end in .com), so I think you should redirect people to .com domain. And It's not really important, but just FYI: It crashed when I tried zooming on iPad 2 (iOS 5.1.1). It's the second time ever my iPad's Safari crashes (first time being Linux's network on Github, that crashes every single browser on every platform, so don't even try opening it: https://github.com/torvalds/linux/network)* https://github.com/torvalds/linux/network)*.

marcneuwirth 14y ago
Fixed the .org domain, thanks for pointing that out. You actually _can_ look at up to the past 12 hours if you change the URL manually, but I have found the graph to be less useful from 6-12 hours How much data were you looking at when the iPad crashed? I use this daily on the new iPad and havent experienced any problems unless there was a ton of data on the screen

pooriaazimi 14y ago

Also, it would be nice to show timestamps (see http://hnrankings.info/4054568/ http://hnrankings.info/4054568/ for example. I have no idea when it dropped. When I move my cursor, it just shows 'Saturday, Jun 2, 2012').

EzGraphs 14y ago

Very cool - nice work. I like the idea of charts to see change over time(your charts are great - sparklines might be useful for seeing an individual post's status over time). Some ideas based on my similar project over at http://hn4d.com http://hn4d.com. Another are of interest that I track is the change in the number of comments over time. This also provides an indication of current activity and interest over time. Since you have historic data, perhaps a search would be useful. It might be interesting to see "longest lasting posts" or posts with the "greatest increase." In any case - very nice site, well implemented and easy to understand.

marcneuwirth 14y ago
Your project looks awesome, are you just scraping the homepage directly? Great suggestions, thanks

kylebrown 14y ago

In case anyone hasn't already seen it, "A journey through the bowels of proggit" http://corte.si/posts/socialmedia/redditgraph/index.html http://corte.si/posts/socialmedia/redditgraph/index.html

shaggyfrog 14y ago

All the curves are in a giant jumble at the top and are nearly indistinguishable from each other. Perhaps a log scale on the y-axis would improve readability?

miahi 14y ago

It's probably because I'm colorblind, but I find it hard to follow the lines in the default chart even when selected/highlighted. Can you increase the width of the selected line a little bit more?