robotadam

5 ms·

1.
by robotadam 13y ago
Opening the site in Firefox avoided the redirect to login issue for me.
2.
by robotadam 15y ago
I agree with you; a lot of the reason it took us a while to get out of EC2 was my lack of comfort. If I had pushed that earlier many things would have been easier. There are so many great things about EC2, but it pushes the need to think ab
3.
by robotadam 15y ago
I definitely could have been more clear on that. Cassandra has so many great properties, and when we made the decision to use Postgres for the large dataset under question was shortly after 0.7 was released, and it took a while to get more
4.
by robotadam 15y ago
The Heroku guys are doing some seriously awesome things with Postgres. I can't wait to see where they go with it; the whole community will benefit, I'm sure.
5.
by robotadam 15y ago
We make heavy use of queue and internal messaging systems. This discussion was solely about the data storage layers, which always causes us more headaches than the messaging/queuing systems.
6.
by robotadam 15y ago
Sorry about that -- I couldn't speak as much about our Hbase experience, but I can speak to the toll its taken on our ops team so far, which is very high, with lots of crashes.
7.
by robotadam 15y ago
You are very right; I should have tried to have us move to physical hardware before we did. Definitely one of the things that I would have done differently, in hindsight. The larger EC2 instances (especially for always-on systems like prima
8.
by robotadam 15y ago
Thanks for the kind words, everyone. When I was writing the talk I was worried it'd be too tied to our/my experience, but at least people found it a little entertaining. The video should be posted soon; the Q&A was interesting and broug
9.
by robotadam 15y ago
According to the docs, this is a blocking operation -- so it's inplace, but I wouldn't consider it to be online, as I would PostgreSQL's vacuum or Cassandra's major compactions: http://www.mongodb.org/display/DOCS/compact+Command
10.
by robotadam 15y ago
We made the switch before 1.8 was released, and made the decision during the 1.6 cycle, give or take. Auto-sharding never worked reliably in our tests. I think schmichael does a good job explaining the new features that would have helped --
11.
by robotadam 15y ago
In addition, some ELBs are seeing failures with routing, so that wouldn't help, either.
12.
by robotadam 16y ago
getLastError (or safe=true) does not force the write to the disk. Checking getLastError determines whether the server accepted the write, or whether there were failures (uniqueness checks, for instance, or whether any rows were updated).
13.
by robotadam 16y ago
Do you mean connections to the queue server, or outgoing connections? In either case, it would affect it only slightly (I imagine) if the connections were persistent, as they are in this case. If you're regularly opening and closing connect
14.
by robotadam 16y ago
I'm a little confused by this; how do SQL databases not support more atomic operations that MongoDB, seeing as you have full control of the transactions themselves? Incrementing, adding to a list (generally done with inserting a row in anot
15.
by robotadam 16y ago
The U.S. does have a similar program, the Self-Employment Assistance Program: http://www.workforcesecurity.doleta.gov/unemploy/self.asp It's a Federal program, but the states have to implement it. Only Delaware, Maine, Maryland, New Jerse
16.
by robotadam 16y ago
A good question. Shrinking TCP buffer sizes can have a negative performance impact when sending large amounts of data; our use case was keeping track of a large number of mostly silent connections, and so we benefit from the smaller memory
17.
by robotadam 16y ago
We got over 500k/instance: http://blog.urbanairship.com/blog/2010/08/24/c500k-in-action...
18.
by robotadam 16y ago
It's a spike as in a spike solution -- an end-to-end prototype to see if a chosen method of solving the problem is feasible, but without writing tests or handling all error cases or the like. http://c2.com/xp/SpikeSolution.html
19.
by robotadam 16y ago
MongoDB has a single, global read/write lock for the entire database. So when a write is actually processing, nothing else can happen. In a moderately write-heavy environment, a single slow write can result in pretty bad performance in my e
20.
Posterous and URLs(mtrichardson.com)
33 points by robotadam 16y ago|26 comments
21.
by robotadam 17y ago
Here's the initial note from the forum. I copied it before and can't reload, so I don't know the user that posted it. "During a shared library update distributed to our hosts, a number of the hosts incorrectly have marked Linodes as being s
22.
by robotadam 17y ago
I agree with you, especially with regard to open source related conferences (I've made great friends at PyCon); but perhaps there's a difference at the more old-fashioned corporate conferences?
23.
by robotadam 17y ago
A breach in your OpenID account is the same security risk as a breach in your email account, if the sites do account recovery via email.
24.
by robotadam 17y ago
You could use a dedicated OpenID provider, like MyOpenID. If you have a simple website or blog where you can edit meta tags in the HTML, then you can delegate. For example, I use my blog as my OpenID, but I don't want to run a server myself