7 ms·
Ask HN: Best way to distribute multi-GB dataset?
I'm in the process of shutting down Word2[1], an MMO scrabble-like word game we built for Node Knockout back in 2010. The game's world is amazing - ~265MM tiles, ~123MM played words, over 1MM unique players. Once all personally identifiable information has been removed, I'd like to provide it to interested parties to play with. The clean dataset will be ~15GB compressed - what's the preferred way to share multi-GB files these days? Bittorrent, S3 (probably Requester Pays unless there's another option with manageable costs), or something else? Suggestions welcome.
[1] http://massivelyfun.com/saying-goodbye/
- markcarlson 13y agohttp://archiveteam.org http://archiveteam.org
- ggoodale 13y agoRad! Haven't run across Archive Team before. Looking into them now.
- 0x006A 13y agoBittorrent
- ggoodale 13y agoSeems reasonable, though given the size of the file I'm probably going to have to host it somewhere for seeding purposes rather than just parking it on my home fileserver (yay Comcast monopoly in my area).
- davidbanham 13y agoHow about a torrent hosted on s3? http://docs.aws.amazon.com/AmazonS3/latest/dev/S3Torrent.html http://docs.aws.amazon.com/AmazonS3/latest/dev/S3Torrent.htm...
- ggoodale 13y agoLooks like that only works for 5GB files or less, which is a shame.
- logn 13y agoSourceforge
- ggoodale 13y agoInteresting - hadn't considered that possibility. Thanks! I'll look into it.
- willmacdonald 13y agoBittorrent Sync