runT1ME

5 ms·

1.
by runT1ME 5y ago
Let's say your immutable DAG has four different 'transformations' (think either a map or a fold on the data). Beam or Spark will take a chunk of your data, partition it somehow (so you get parallelism), and do a transform on
2.
by runT1ME 5y ago
It's awkward to work with fully nested structures. Think about having a map of customer objects which have a list of addresses and you need to update everyone's first address to be capitalized for some raeson. You'd really
3.
by runT1ME 5y ago
I really think this is where pure FP shines. If you look at the architecture of something like Apache Beam, while you describe your computations in a language like Java or Python, you're really using a DSL for creating an immutable DAG
4.
by runT1ME 5y ago
I don't have time (nor the endurance) for a 90 minute run, so could you combine the two? I often do a 14 hour fast and then go for a 20 minute run combined with some calisthenics on my lunchbreak before eating. How can you tell your
5.
by runT1ME 5y ago
Would love to get your take on if python is popular in large organizations because of the existing libraries or if it is the language asethetic itself? To an outsider who knows a bit of python because of Airflow and Spark, it seems Python h
6.
by runT1ME 5y ago
This isn’t legal. A corporation that leases someone a car and a house is paying them a taxable income, regardless of it not being a cash income.
7.
by runT1ME 5y ago
When I would commute from Orange County so Santa Clara the flight was often ~40 minutes. Combine with takeoff and landing it didn't make a lot of sense to pull out an addition device but it was easy enough to watch a short TV show on
8.
by runT1ME 5y ago
Depends on the language (I don't use it for Java), but for Scala and python I definitely prefer it. I'd definitely recommend using TMux with Vim, I've mapped my tmux navigation to mirror Vim's window navigation, and I c
9.
by runT1ME 5y ago
We can write a general procedure to see it any given program halts within n-steps however.
10.
by runT1ME 5y ago
>Sure, that's possible, but the opposite is also possible: it might be wrong for most programs we actually write. We could confirm this though! It's not like we can't find out if a given program halts or is inconsisent.
11.
by runT1ME 5y ago
It might only be wrong for programs that have never existed and will ever exist.
12.
by runT1ME 5y ago
>Only one thread actually mutates anything, and its the same one over and over Sounds great in theory and usually results in fantastic average case, but you get a hot partition and suddenly you can't work share and things go south.
13.
by runT1ME 5y ago
I think it's important to point out that you can do calculus and arithmetic and only construct proofs that are provable. The possibility of deriving unprovable but true statements in an axiomatic system doesn't mean they'r
14.
by runT1ME 5y ago
> The day rates look high, but they have to pay self-employment taxes and health insurance Most SWEs doing 'contract work' aren't actually 1099 contractors, what it means is they work for an intermediary and then 'c
15.
by runT1ME 5y ago
Both at my current startup job and at my previous Verizon job, a lot of my time is scaling out existing services and also boostrapping core infrastructure projects that prioritize reliability over adding features or addressing rapidly chang
16.
by runT1ME 6y ago
You don't need async/await to do monadic comprehension in Scala, it's built into the language from the very beginning with `for`. This was inspired by do notation, which came about ~1998.
17.
by runT1ME 6y ago
I think he means that the Fed can directly and indirectly increase the money supply, which disproportionately benefits people and corporations leveraged into assets. Hence, increasing the money supply makes the rich even richer.
18.
by runT1ME 6y ago
I'm postulating that any modern CRUD app framework has Monads, Monoids, and other categorically inspired structure, even if they don't call it that or have a way to abstract over it.
19.
by runT1ME 6y ago
>I was on a team building good old crud apps using monads, monoids, categories Here's the thing, if you look at a basic Spring crud app, you are also using Monads, Monoids, Categories, Traverse, etc. but you aren't expressing i
20.
by runT1ME 6y ago
SBT in the last few years is nothing like SBT of five years ago. I agree it was a convoluted mess at one point, and now I much prefer it to Gradle.
21.
by runT1ME 6y ago
I have the same issue with my PX, every two months or so I have to use the paper clip to hard reboot them. Kind of annoying to need to do for a $400 pair of headphones, but they sound great, look good, and are very comfortable.
22.
by runT1ME 6y ago
Interesting comment, definitely want to hear more. I have concerns about Beam/Dataflow, but they seem different to yours. The dataflow product seems to run older versions of Apache Beam just fine, so minor deprecations don’t seem like
23.
by runT1ME 6y ago
I've been approached about various data engineering jobs over the last couple years and the job descriptions have varied wildly. It has been everything from: 1. SQL/analytics wizard, capable of building out dashboards and quickly
24.
by runT1ME 6y ago
I'm not even sure the core Beam engineers understand it all! Look at how Kafka offset acks are handled now: https://github.com/apache/beam/blob/master/sdks/java/io/kafk...
25.
by runT1ME 6y ago
It would be helpful if this thorough of an example could live on the apache beam website, I think it would avoid a lot of confusion. I certainly found the way it handles windowing with triggers to be quite diffrent than say, Spark.
26.
by runT1ME 6y ago
I'm surprised that they haven't taken a page out of Netflix's book: sign small artists that sound close enough to what's popular to their own internal record label and push them in playlists?
27.
by runT1ME 6y ago
I really recommend Functional Programming in Scala. It takes a first principles approach to Functional Programming and starts with the idea of "how do we write programs if we don't mutate state"? Lots of exercises, from sma
28.
by runT1ME 6y ago
The problem is this incentivizes all the wrong things. This encourages the ultra rich to invest in land or large properties, driving up that particular asset class. Instead of venture capital, we’ll just get a bunch or people hoarding lan
29.
by runT1ME 6y ago
>The beauty of inflation is that it hurts you in direct proportion to how well off you are, This is the opposite of true. In practice, inflation is wealth transfer to the upper class. Inflation benefits debt holders, the people who are
30.
by runT1ME 6y ago
Thank you so much for your response, that example makes a lot of sense. Algorithmically speaking in computer science, we can formalize efficiency with complexity theory. Can we do the same with neural networks? Is there a formalization of

More ›