5 ms·

How many petabytes does something like this take up?

• llao 8y ago
  The internet says there are about 500 million tweets per day. If we assume 500 bytes for storing each, this would be 250 Gigabytes per day.
  • written 8y ago
    Average tweet JSON object size is 5300B.
    • llao 8y ago
      Should compress nicely though.
• written 8y ago
  I download profiles I'm interested in of course. Not everything. 70 profiles with 75000 tweets take 5GB for JSON + images + linked pages content + 60GB for videos. I didn't optimize for space at all, twitter's json is quite wasteful.