SaveTheRbtz

5 ms·

1.
by SaveTheRbtz 3y ago
"An In-Depth look at Lerp, Smoothstep, and Shaping Functions"[1] by SimonDev is the best 8min introduction to Lerp for a software engineer that I saw. [1] https://www.youtube.com/watch?v=YJB1QnEmlTs
2.
by SaveTheRbtz 4y ago
We're mostly on the Grafana stack, so we tend to favor their open-source solutions for metric backends. For client libraries, we're currently using Prometheus for metrics and OpenTelemetry (OTEL) for tracing, but we're lookin
3.
by SaveTheRbtz 4y ago
Thanks for creating this proposal! Would love to see it committed upstream. For me it worked just fine -- I'll need to play a bit more with it and maybe put it into a real-world production setup to see how well it preforms on real-wo
4.
by SaveTheRbtz 4y ago
I did PoC experiments with compression, chunking, and IPFS here: https://github.com/SaveTheRbtz/bazel-cache If you need a mature compression implementation for bazel I would recommend using recent bazel versions w&#x2F
5.
by SaveTheRbtz 4y ago
I was recently playing[0] with the ZSTD seekable format[1]: a *valid* ZSTD stream format (utilizing ZSTD skippable frames, that are ignored by de-compressor) w/ an additional index at the end of the file that allows for random access t
6.
by SaveTheRbtz 5y ago
The analysis itself is quite impressive: a very systematic top-down approach. We need more people doing stuff like this! But! Be careful applying tunables from the article "as-is"[1]: some of them would destroy TCP performance:
7.
by SaveTheRbtz 5y ago
re. syncookies: Linux by default starts issuing syncookies when listening socket's backlog overflows, so it may be accidentally triggered even by a small connection spike. (This, of course, is not an excuse for a service misconfigurat
8.
by SaveTheRbtz 5y ago
> tcpdump ... linux TCP stack ... ebpf > Networks are not my specialty I wish all network non-specialist were like you!
9.
by SaveTheRbtz 5y ago
Thanks! Added it back to the blogpost (seems like we accidentally lost the `pktmon` reference during the editing process =)
10.
by SaveTheRbtz 5y ago
A couple of questions: * What are the reasons for disabling TCP timestamps by default? (If you can answer) will they be eventually enabled by default? (The reason I'm asking is that Linux uses TS field as storage for syncookies, and w
11.
by SaveTheRbtz 5y ago
Sadly, middleboxes are a real problem, esp. with our Enterprise customers. We had this problem even with HTTP/2 rollout so there is even a special HTTP/1.1-only mode in the Desktop Client for environments where h2 is disabled. In
12.
by SaveTheRbtz 5y ago
Oh, Windows 7? That does explain it. Windows TCP stack really improved in 8.1. The main change there is the auto send buffer tuning which allows automatic growing of SNDBUF. Let me see if we can put a dirty hack^W^Wworkaround for Window
13.
by SaveTheRbtz 5y ago
We didn't mention RSS/RPS in the post mostly because they are stable. (Albeit, relatively ineffective in terms of L2 cache misses.) FlowDirector, OTOH, breaks that stability and causes a lot of migrations, and hence a lot of re-o
14.
by SaveTheRbtz 5y ago
We will be eventually migrating to UDP (HTTP/3) once it is rolled out on Envoys[0] on Dropbox Edge Network[1]. [0] https://dropbox.tech/infrastructure/how-we-migrated-dropbox-... [1] https://dropbox.tec
15.
by SaveTheRbtz 5y ago
Microsoft Devs explain this in their "Algorithmic improvements boost TCP performance on the Internet"[1] article. TL;DR is that they had RACK (RFC draft) implemented as an MVP but w/o the reordering heuristic. [1] https:&#x2
16.
by SaveTheRbtz 5y ago
Interesting, can you try disabling upload limiter in settings? Also what is your RTT to `nsf-1.dropbox.com`? PS. One known problem that we have right now is that we use a multiplexed HTTP/2 connection, therefore: 1) We rely on the host
17.
by SaveTheRbtz 6y ago
Alexey from Traffic Team is here. Traffic is definitely a non-negligible part of the budget. We try to reduce it as much as possible for both lower operational expenses and better user experience. Main drivers for that improvement (besid
18.
by SaveTheRbtz 6y ago
We've made a note about how inefficient our solution was and what was the plan to fix it. Sadly, to get proper stats in nginx we needed two things: * C interface for stats, so we can would have access to from C code. * Instrument all
19.
by SaveTheRbtz 6y ago
One of the senior engineers once said to me that "Bazel is like a sewer: you get back what you put in." Bazel requires a lot of upfront effort but the power of (a programmatically accessible/modifiable) dependency graph a
20.
by SaveTheRbtz 6y ago
It is easy enough for simple cases (and we used it for quite a while, until we moved to using Lua for that.) For more complex scenarios you will have new `server` blocks, certificates, tls tickets, log files / syslog endpoints, so the
21.
by SaveTheRbtz 6y ago
We've actually started experimenting with converting our static file serving to "proxying to S3 + caching." This is simpler from deployment and development perspectives (for companies that do not have a distributed filesyste
22.
by SaveTheRbtz 6y ago
open source argument is valid -- most software enterprise vendors do provide source code access (under NDA.) The rest of the arguments stand though: as it is right now, it way more developer/operator friendly to use Envoy in our produ
23.
by SaveTheRbtz 6y ago
To tell you the truth, we didn't consider it. From what I can get from the architecture docs[1], it can be a decent platform for apps, but might not be the best choice for a general purpose ingress/egress proxy (at least for now.
24.
by SaveTheRbtz 6y ago
Totally get it! The team (@veshji and @euroelessar) struggled a bit in convincing me that the new Envoy way is a simpler one. I do not regret giving in. Operationally, there are many differences (esp. around Observability) but if I were t
25.
by SaveTheRbtz 6y ago
It works beautifully. We use driver offload (i40e on the Edge.)
26.
by SaveTheRbtz 6y ago
Actually, all the props for that go to Katran's author himeself. When we hired Nikita V. Shirokov (tehnerd), the first thing he did was replacing IPVS with XDP/eBPF-based Katran, which improved our Edge servers throughput by 10x,
27.
by SaveTheRbtz 6y ago
The subject of monetizing opensource software is a tricky one. Some companies pursue the Open-Core principle, others monetize through the consulting services or cloud infrastructures. As for investing into opensource, Dropbox is trying to
28.
by SaveTheRbtz 6y ago
We had a large rundown of our Traffic Infrastructure some time ago[1]. TL;DR is: * First level of loadbalancing is DNS[2]. here we try to map user to a closest PoP based on metrics from our clients. * User to a PoP path after that mostly de
29.
by SaveTheRbtz 6y ago
Our technology stack is very gRPC friendly, so developer experience is actually better with it, than without (though this is very subjective.) As for the middleboxes, using gRPC-WEB[1] allowed us to switch Desktop Client App to gRPC even be
30.
by SaveTheRbtz 6y ago
Can you describe your use-case? If you are talking about the ability to select a certificate on the fly via `ssl_certificate_by_lua_block`[1] we are not aware of such functionality. If you are missing something, I would highly encourage yo

More ›