nosefrog

5 ms·

1.
by nosefrog 27d ago
I don't understand your comment. A google data center is much larger than an ntp server, but it's obviously not infinitely larger. As you know, if it was infinite capacity, then there would be no need for load balancing or load sh
2.
by nosefrog 1mo ago
So tired of these AI generated articles.
3.
by nosefrog 2mo ago
Major lesson from when I worked on Google Search indexing is that queues have a lot of hidden complexity and can make your outages much longer than they need to be. We had a big project to get rid of a bunch of queues by just scaling up our
4.
by nosefrog 2mo ago
Would be nice if the timeline matched up with the text of the blog post (missing "HackerOne provides disclosure guidance").
5.
by nosefrog 2mo ago
Interesting. We run pgbouncer via kubernetes so it was straightforward to make multiple pgbouncer processes on one machine. Also straightforward to get them running on multiple machines, which helps because we run on Azure and they like to
6.
by nosefrog 2mo ago
Don't reboot the db during your next outage.
7.
by nosefrog 4mo ago
It's highly unlikely that GCP banning their account without telling them is true, but GCP is probably not going to go public with the real reason.
8.
by nosefrog 4mo ago
Yup...
9.
by nosefrog 6mo ago
We run 1000s of machines in Azure. It's garbage. Very few features work. Nodes are always having strange issues, especially on the networking side. And the worst part is that Azure support has 0 interest in actually debugging things. W
10.
by nosefrog 9mo ago
> At some point, you will have many teams. And one of them _will not_ be able to validate and accept some upgrade. Maybe a regression causes something only they use to break. Now the entire org is held hostage by the version needs of one
11.
by nosefrog 10mo ago
Big shoutout to Amin and Sacha for keeping this going!
12.
by nosefrog 11mo ago
Front Door is not good.
13.
by nosefrog 1y ago
What's the most difficult part of distributed stream processing?
14.
by nosefrog 1y ago
It was low. I got a bump to 90k that year, then 130k when I jumped companies, which I thought was a mind boggling amount. Do entry level devs even get out of bed for $130k these days?
15.
by nosefrog 1y ago
My first programming job in SF paid $60k/year 10 years ago. I'd like to thank big tech for driving salaries up.
16.
by nosefrog 1y ago
On the flip side, my baby likes the small loud airplanes. He points at them and says "oooh!"
17.
by nosefrog 1y ago
Hi Chad!
18.
by nosefrog 1y ago
I was vegan for 7 years, one of my vegan friends had the opinion that human hospitals should be banned and only animal hospitals should be allowed.
19.
by nosefrog 1y ago
Infra teams like it, app devs don't like it.
20.
by nosefrog 1y ago
We did that at Dropbox in Python for a while. Though they switched to async after I left.
21.
by nosefrog 1y ago
At Google, they found that engineers L5 and above got more work done with RTO, and engineers at L4 and below got significantly less work done. WFH is great but it doesn't work for fresh engineers (who are often the most gung-ho about i
22.
by nosefrog 1y ago
We use Python to generate these configs at my work. Ends up working out pretty well. I previously worked on the biggest deployment of gcl (the inspiration for KCL, Jsonnet) at Google and it was a giant nightmare and the cause of many outage
23.
by nosefrog 1y ago
Nobody thought Instagram and WhatsApp were good acquisitions at the time.
24.
by nosefrog 2y ago
By health check, do you mean the kubernetes liveness check? Does that make kube try to kill or restart your container?
25.
by nosefrog 2y ago
> When using Cloudflare Workers as an API server, I have experienced requests that would “fail silently” and leave a “hanging connection”, with no error thrown, no log emitted, and a frontend that is just loading. Honestly, no idea what’
26.
by nosefrog 2y ago
Reminds me of gcl (yikes).
27.
by nosefrog 2y ago
The idea that engineers at Google don't get rich is not based on reality.
28.
by nosefrog 2y ago
Yea, I don't have a problem with the quota, more that the "out of quota" throttling lasts 2+ hours even after the traffic spike dies down.
29.
by nosefrog 2y ago
I'm curious why people pick Azure, if anyone here has direct experience with making the decision. I work at a startup that runs on Azure, and we're only here because of Microsoft's monopolistic behavior. We switched because M
30.
by nosefrog 2y ago
Yup, the hardest part about migrating to Azure was jumping between all the managed services that work everywhere else but are insanely buggy on Azure. We ended up with the most basic architecture you can imagine (other than AKS, which works

More ›