websiteguy

5 ms·

1.
by websiteguy 14y ago
Unix sort is a merge sort, using fixed RAM uniq -c is line by line sed is line by line A superior solution in every way If you were going to do this in Python (or another similar language), you need to write a sort function that operates on
2.
by websiteguy 14y ago
Maybe I am missing something here, but The python version is: O(N) sequential disk access O(NlogN) cpu O(N) RAM The shell script is the same for disk and cpu, however, it is O(1) of RAM, and therefor can operate on input of size limited to
3.
by websiteguy 15y ago
Hi jokull, Would like to understand more, is there a way to contact you ? Andy
4.
by websiteguy 15y ago
(disclosure, I am the author of this post) Hi hn_decay, Our use case goes like this: a member database of over a 100M records, and a number of content databases each with tens or hundreds of millions of records (reviews, video, lists, wiki,
5.
by websiteguy 15y ago
(disclosure - I am the author of this article) "At the end of the day hire good ppl. They'll do the right thing most of the time." - absolutely agree. No system is perfect, ours is not. You need to decide what is important to your organizat
6.
by websiteguy 15y ago
(disclosure - I am the author of this article) I think this comes down to judgment. Design appropriately. Short sighted designs are as bad as ivory tower designs. Every situation is different. If a person does not own something, no one does
7.
by websiteguy 15y ago
(disclosure - I am the author of this article) I think it is a matter of judgment. Bugs that bring the site down,I agree. Minor bugs that most people will not notice on a consumer site where we can quickly patch them, I would rather get mor
8.
by websiteguy 15y ago
(disclosure - I am the author of this article) I am not sure about "faster", but it is more scalable and more flexible - especially considering that the datasets to be "joined" are small, page-sized datasets. We have a lot of different cont
9.
by websiteguy 15y ago
@latch - Yes, we saw it - would be a fun project, but we are software hackers :-) There are also concerns about heat, vibration, hot swapping, etc. I would happily spend $78K for that same storage instead of $7.8K if it was reliable and wa
10.
by websiteguy 15y ago
For a web startup - large monitors, powerful dev machines, extra servers for testing and running stuff, free drinks and free food
11.
by websiteguy 15y ago
Thanks for the replies - Need disk storage, would like to use 7200rpm for real-time access to logs, 15k for database/email apps Would be a lot of fun to roll our own, but we are resource constrained, and while money is not an issue for us,
12.
Ask HN: Inexpensive large scale (100's of TB) storage options?
5 points by websiteguy 15y ago|6 comments