gtuhl

20 ms·

1.
by gtuhl 12y ago
The density of the DIMMs is where the price difference jumps. Right now 32GB sticks push the price way up. Common current chassis have 24 slots letting you hit 384GB total with no big surprises on 16GB sticks. Getting to 1TB would certainly
2.
by gtuhl 13y ago
MailChimp - Atlanta, GA Database Engineer MailChimp is a DIY email-newsletter service based in Atlanta that serves more than 4 million users worldwide. We're self-funded and profitable, and we're growing fast. Job Description Mail
3.
by gtuhl 13y ago
Atlanta, GA - MailChimp I am hiring for two roles on the Infrastructure side: Systems/Coding: http://mailchimp.theresumator.com/apply/6Il9br/Infrastructur... NOC/Networking: http://mailchimp.t
4.
by gtuhl 14y ago
Atlanta, GA. Full time. Infrastructure Engineer. Job Description MailChimp is looking for engineers to join our team. This is a full time position in Atlanta that will help build, support, and monitor the infrastructure our company depends
5.
by gtuhl 14y ago
Atlanta, GA - Full time, local, relocation possible MailChimp is looking for infrastructure engineers to join our team. This is a full time position in Atlanta that will help build, support, and monitor the infrastructure our company depend
6.
by gtuhl 15y ago
MailChimp, Atlanta, GA, Full Time I am looking for Infrastructure Engineers to join the team. We support hundreds of servers, millions of customers, and send billions of emails every month with a small team that prefers automation over man
7.
by gtuhl 15y ago
I think the focus on in-memory only is what makes Redis great and I hope they never change. It lives on that requirement and is incredibly stable and fast. I don't want another half-baked data store that technically "works" on disk but onl
8.
by gtuhl 15y ago
I just poked around with some of our servers to verify. In Softlayer's Dallas facility (selected when ordering a server) 10 Gbps is an option. The maximum amount of bandwidth available is 20TB. Sometimes you can get more options by contacti
9.
by gtuhl 15y ago
That does seem odd. I'd file a ticket and see what they have to say about it. In certain datacenters (think might be dallas05?) you can even get a 10Gbps uplink brought to a box so they have pretty big pipes available.
10.
by gtuhl 15y ago
Softlayer offers this as well. You can spec out a box however you want up to pretty exotic configurations, get billed monthly, and can SSH into them in 3-4 hours. It is expensive, but not as expensive as something like heroku or aws for eq
11.
by gtuhl 15y ago
If I need to go cross-shard then I am doing it in code. If you knew both shards were on the same box you could do cross-shard joins if you used schemas like this but you would need some potentially tricky logic that determines if it is wor
12.
by gtuhl 15y ago
Good point, sounds like I intend to keep it that way for this particular database in my comment. It's setup for multi box (each schema is mapped to a hostname in code) but I simply haven't had a reason to move to more boxes yet. The schema
13.
by gtuhl 15y ago
I'm a big fan of Redis precisely because it has a short list of promises and executes them well. So many of these other new data stores promise "infinite scale" and leave out the "as long as it fits in RAM" part.
14.
by gtuhl 15y ago
I have a 1.5 TB Postgres database, sharded by schema, that runs wonderfully on a single box (12 core, 36GB RAM, raid 10 of 15k SAS drives). Why couldn't you shard with Postgres?
15.
by gtuhl 15y ago
The tough thing about comparing these two is that it is hard to find a benchmark (I don't know of one) that works similarly with them both. Sysbench is somewhat of a standard for testing MySQL configs but Postgres does not handle it well.
16.
by gtuhl 15y ago
Compared to MyISAM? Sure for certain aggregate functions, but it's too easy to point out reasons for avoiding MyISAM: fragmentation, no transactions, table locks on writes, complete table rewrites to change columns or indexes, only scales
17.
by gtuhl 15y ago
Postgres has bitmap index support baked in as well and it works really well. I'd be awfully interested in knowing where MySQL beats it by 50x at anything.
18.
by gtuhl 15y ago
I am not a big fan of Hadoop. It is a headache to configure and optimized for installs with node counts only a few companies could make use of. I really wish there were more options as I believe Hadoop is overkill for most of the people u
19.
by gtuhl 15y ago
Agreed, hard drives fail constantly. I've had as many as 3 dead at a time while waiting for hot spares to rebuild in arrays as small as 24 drives. Dual drive failures have happened at least twice that I can remember off the top of my head
20.
by gtuhl 15y ago
There are some nice middle options out there. I'll use Softlayer as an example as I have provisioned a lot of machinery over there. I can order machines online and SSH in 3-4 hours later. Even exotic stuff they turn around just as fast -
21.
by gtuhl 16y ago
We do have transactional support via Amazon SES now: http://blog.mailchimp.com/mailchimp-launches-transactional-e... It rolled out this very week.
22.
by gtuhl 17y ago
If shopping for an SSD at least consider the OCZ Vertex. I've been running one in my Santa Rosa MBP for 7 months with no issues and excellent performance. See ( http://blog.gtuhl.com/2009/03/26/ocz-vertex-ssd-in-a-17-sant... ) for install
23.
by gtuhl 17y ago
While I think some of these new projects are great for certain tasks, this sentiment resonates with me often when talking with nosql evangelists.
24.
by gtuhl 17y ago
Thought I was add that the PostgreSQL documentation is really, really good for learning. It is a bit dense but overall very well written, includes nontrivial examples, and you can really get a solid dive into a topic reading it. The curren
25.
by gtuhl 17y ago
Agreed it was too strong of a statement, but denormalization really is something you do all the time in big databases. It is not some targeted last resort technique. If you have 30 million rows in a table you absolutely cannot do joins so
26.
by gtuhl 17y ago
JOINs rightly get a lot of crap - they are massive performance bottlenecks if you are working with large tables. Having a single awkward example does not detract from that. I'll add to this by noting the post does say "For smaller tables it
27.
by gtuhl 17y ago
I agree. It seems if a person's perspective is that coding isn't cool they either don't like coding or don't like the employer they code for.
28.
by gtuhl 17y ago
I used to be a huge MySQL fan until a coworker forced us to use PostgreSQL for a big project. At the start I wasn't happy about it but have since completely changed sides. It is an amazing piece of software with some exceptional code and
29.
by gtuhl 17y ago
A lot of generic SQL stuff in there for sure. But, last I worked with MySQL (it has admittedly been a few years) the indexing options were severely limited when compared with PostgreSQL. Last I used it you could not index an expression or
30.
by gtuhl 17y ago
Been unplugged all day so haven't been around to respond. This is a completely fair criticism - the wording in my post is indeed too plain. Without understanding the normal forms making smart decisions about denormalization is going to be

More ›