There is no mechanism for search "completeness" without access to the fire hose. http://blog.cloudera.com/blog/2012/09/analyzing-twitter-data-with-hadoop/ http

There is no mechanism for search "completeness" without access to the fire hose. http://blog.cloudera.com/blog/2012/09/analyzing-twitter-data-with-hadoop/ http://blog.cloudera.com/blog/2012/09/analyzing-twitter-data... ^ that is a good resource if you ever get access to the firehose. Shoot me an email anthony@makerops.com, and when I get home I can shoot you an email with some example code that Ive written in the past.