dalailambda

12 ms·

1.
A build tool for the rest of us(rslabbert.com)
2 points by dalailambda 5y ago|0 comments
2.
by dalailambda 6y ago
A quote from the article I would object to is "for large datasets and complex transformations this architecture is far from ideal. This is far from the world of open-source code on Git & CI/CD that data engineering offers - ag
3.
by dalailambda 7y ago
SQL has definitely become the defacto tool for a lot of data processing. This model of working is generally referred to as ELT as opposed to ETL. For small/medium scale environments Fivetran/Stitch with Snowflake/BigQuery usi
4.
by dalailambda 7y ago
I can highly recommend this talk by Respawn, Multiplay, and Google on how Titanfall 2 does multiplayer server management. It's geared more at the infrastructure side as opposed to actual dev but worth a watch: https://www.yo
5.
by dalailambda 8y ago
While the move seems to be towards NewSQL databases (Spanner/CockroachDB), the answer to relations in NoSQL is to model the data differently. This can generally resolve a lot of the problems inherent in the need for relations. This mig
6.
by dalailambda 8y ago
Lambda will create a function instance to handle concurrent requests, i.e. if 100 requests happen at the same time there will be 100 function instances. It will then however keep them "alive" for a few minutes allowing it to reuse
7.
by dalailambda 8y ago
In my experience the reason for a JSON object per line is because a tool can then split the entire file by newlines and have a list of objects to start parsing/processing in parallel, which avoids having to parse the entire file up fro
8.
by dalailambda 9y ago
One of the major reasons that would influence a language like Jai is that once you do that, even if your generated C/++ is fairly optimal, you still have to go through another slower compiler. Jai's compiler is fairly optimised fo
9.
by dalailambda 9y ago
The app can still use environment variables and be completely independent (12 factor), but the Dockerfile/Kubernetes config still needs to provide those things, so there is a clear distinction between ops and dev, they're just mor
10.
by dalailambda 9y ago
There are generally two levels of autoscaling involved with kubernetes. Firstly, kubernetes is able to create multiple instances of your app as load increases and scale them out over all the nodes. Secondly, the nodes your kubernetes cluste
11.
by dalailambda 9y ago
There doesn't seem to be any part of that package that requires ES6 to use. You can use it as an ES6 module, but the commonjs version should work fine as well.
12.
by dalailambda 9y ago
Building distributed systems makes you aware of how unreliable things are at the large scale, e.g. the network. The parent comment implies that Google's network is so fast and reliable that it becomes tempting to ignore best practices
13.
by dalailambda 9y ago
A web page, for example, should not have direct access to the database.
14.
by dalailambda 9y ago
In regards to Purescript/Typescript, they're both statically typed and that results in friction when trying to integrate with the existing JavaScript ecosystem/libraries. Erlang/OTP might be different, but there will pro
15.
by dalailambda 9y ago
While I agree that the OTP perhaps is not as easily statically typed, since it was built with Erlang in mind, I do think that static typing adds a layer of robustness to distributed systems, especially if you design it that way upfront. In
16.
by dalailambda 9y ago
The node level autoscaling doesn't need to be integrated with kubernetes, all it needs to do is create a new instance and register it as a node through normal channels. Even if you don't need autoscaling, I'd suggest still us
17.
GRiSP Base Board – Pre orders now available(grisp.org)
3 points by dalailambda 9y ago|0 comments
18.
by dalailambda 10y ago
I don't see why not, Haskell has green threads, channels, and everything that Go has. The only argument I can see made is that the laziness and current GC implementation aren't suited, and even then, those problems can be solved w
19.
by dalailambda 10y ago
If using 4 wide space/tabs, the function body will line up with the function name when using "fun". Maybe not the reason, but it is a reason.
20.
by dalailambda 10y ago
Since languages like Rust/C++/Swift compile reference counting into machine code already, there's no real reason why they shouldn't be able to compile it to WebAssembly.
21.
by dalailambda 10y ago
Erlang's processes are green threads, they're just called "processes". Neither Erlang, nor Akka run 1 thread or process per actor, they just schedule multiple actors over N native threads inside the single process (ignor
22.
by dalailambda 10y ago
The semantics of Erlang and Elixir are very similar, as they're both dynamically typed functional languages, so the performance difference should be negligible.
23.
by dalailambda 10y ago
In many cases a garbage collected language will be faster when it comes to allocations than using naive allocation strategies (e.g. reallocating a hashmap many times as it grows instead of reserving memory upfront). This is because the garb
24.
by dalailambda 10y ago
While this may seem silly to some people, I definitely appreciate the sentiment. "The compiler is smarter than you" is thrown around often here, and on Reddit, and a lot of people consider it "common wisdom", but it&#x27
25.
by dalailambda 10y ago
While the virtual DOM is a component in React's popularity, the main thing that I believe people use it for is the functional, one way data flow it allows you to use combined with the component model.
26.
by dalailambda 10y ago
A lot of systems code involves directly messing with the memory of a specific struct, and if a compiler moved the struct fields around with the programmer knowing, there would be a lot of memory problems.
27.
Making the obvious code fast(jackmott.github.io)
23 points by dalailambda 10y ago|2 comments
28.
by dalailambda 10y ago
I'm glad to see D in the top 30, I would love to see it get a hype boost along the lines of Rust/Go, it is a very nice language.
29.
by dalailambda 10y ago
I imagine with a little introspection, a notebook can figure out dependencies between cells and cascade as needed.
30.
by dalailambda 10y ago
Doing this with dynamic libs in C/C++ is done frequently in some areas.

More ›