curio

6 ms·

1.
by curio 16y ago
thanks for taking the time to respond to this. i definitely understand where you're coming from and am glad to hear the robots.txt is being updated.
2.
by curio 16y ago
but their robots.txt says that you're welcome to scrape it: User-agent: * Disallow: /ac.php Disallow: /ae.php Disallow: /album.php Disallow: /ap.php Disallow: /feeds/ Disallow: /o.php Disallow: /p.php Disallow: /photo_co
3.
by curio 16y ago
incredibly easy. and not only can the bot lie, it can disregard the robots.txt file altogether. just like the terms of service document for humans, you can choose to disregard it & deal w/ the consequences (blocked IP's, lawsuit, etc).
4.
by curio 16y ago
yes, using the user-agent: http://en.wikipedia.org/wiki/Robots_exclusion_standard
5.
by curio 16y ago
this is a really important issue. this new model that facebook is trying to push isn't scalable. it favors the big guys and it's bad for the open web. you shouldn't have a TOS that contradicts your robots.txt. period.
6.
by curio 16y ago
probably not, but that's irrelevant. the point is facebook's robots.txt says you can crawl it but their TOS says you can't. facebook have already shown they are willing to sue anyone who tries to crawl without permission. this new model t
7.
by curio 16y ago
you can also do this with a regular expression. here's the blog post i wrote on it a year ago. i use one function to grab get variables from either window.location or from a script tag. 5 lines of code. http://www.onlineaspect.com/2009/
8.
by curio 16y ago
and just like chatroulette or most anonymous forums, the tone quickly deteriorates to the level of graffiti in a public bathroom stall.
9.
by curio 16y ago
he should drop out of school and use it as an excuse to get on every tv station and written about in every paper in the country. who wants a degree from such a dumb school anyway. walk away. some of the best companies of our time have bee
10.
by curio 16y ago
practically speaking, most respectable email services will have an MX record. i tested it on about 30,000 emails & a simple MX lookup caught about 40 gmial's and only 1 false positive.
11.
by curio 16y ago
that reminds me of the girl who takes advantage of the zappos free returns policy and gets 5 new pairs of shoes every singles week only to mail them back a few days later. but zappos doesn't cut here off -- she is important evidence that th
12.
by curio 16y ago
and while we're on the topic of how broken SSN's are... why is it that the most important piece of identification you receive in your life, that you also need to keep forever, is printed on a crappy piece of paper???
13.
EventVue post-mortem(blog.eventvue.com)
47 points by curio 17y ago|6 comments
14.
by curio 17y ago
It sucks that comments aren't enabled on that post. You can see the responses from the community (including Brett Slatkin one of the authors) on the Google Group for PuSH: http://groups.google.com/group/pubsubhubbub/browse_thread/th...
15.
by curio 17y ago
YES!
16.
by curio 17y ago
That's an important point. You can see how PuSH handles it here: http://pubsubhubbub.googlecode.com/svn/trunk/pubsubhubbub-co...
17.
by curio 17y ago
Crap - don't know how that happened. I've reposted the article with the correct link if you care to thumb that one up instead.
18.
RSSCloud Vs. PubSubHubbub: Why The Fat Pings Win(techcrunch.com)
3 points by curio 17y ago|1 comments
19.
RSSCloud Vs. PubSubHubbub: Why The Fat Pings Win(techcrunch.com)
23 points by curio 17y ago|7 comments
20.
by curio 17y ago
It should be back up now. Too much traffic I guess. :)
21.
Coding for the unexpected(onlineaspect.com)
3 points by curio 17y ago|2 comments
22.
Choosing your audience(onlineaspect.com)
1 points by curio 17y ago|0 comments
23.
by curio 17y ago
Impressive demo. Very cool to see real-time updates coming to Google Reader.
24.
by curio 17y ago
I don't know what you should do, and I don't necessarily think there is one right answer for everything in this position. I do know that almost every successful entrepreneurship I've talked to has a story about a failed relationships becau
25.
by curio 17y ago
+1 vote for pubsubhubbub
26.
by curio 17y ago
must have 500k in annual sales and 51% ownership to apply!
27.
Entrepreneur Magazine's Entrepreneur of the Year Contest(entrepreneur.com)
1 points by curio 17y ago|1 comments
28.
Why you should never be a startup girlfriend(stephfinch.com)
92 points by curio 18y ago|70 comments
29.
by curio 19y ago
I recommend Powweb to everyone. Reasons why I love them: - cheap: $7.77/month - reliable: i've never seen them go down - advanced developer features: cron, .htaccess, php.ini editing - really clean user interface (forget using godaddy) - am
30.
How to build great forms(onlineaspect.com)
1 points by curio 19y ago|0 comments

More ›