_pastel

5 ms·

1.
by _pastel 5mo ago
The tradeoff is highly contextual; it's not a tradeoff an agent can always make by inspecting the project themselves. Even within the same project, for a given PR, there are some parts of the codebase I want to modify freely and some t
2.
A Philosophy of Code Review(benpastel.com)
4 points by _pastel 1y ago|1 comments
3.
by _pastel 1y ago
Bike is the one that gets me - when the full Ode to Joy hits I tear up every time.
4.
by _pastel 2y ago
You could fine-tune the embedding model to reduce cosine distance on a more specific function.
5.
by _pastel 2y ago
I work with an extremely effective machine learning engineer, and the biggest thing I've learned is how far you can get with vibes, even in a more traditional ML situation. He invests most of his time visualizing the inputs and outputs
6.
by _pastel 2y ago
Why is max_seq_len set to 2048 [1] when the model card says the context size is 8k [2]? [1] https://github.com/meta-llama/llama3/blob/14aab0428d3ec3a959... [2] https://github.com/meta-llama&#x
7.
by _pastel 3y ago
Tooling around embeddings has improved. Creating and fine-tuning custom embeddings for your tabular data should be easier and more powerful these days.
8.
by _pastel 3y ago
100% agree. One thing that helps is hooking metabase up to its own database and building queries on your queries, e.g.: select * from report_card where dataset_query ilike '%' || {{query}} || '%' (You c
9.
by _pastel 3y ago
Not only is it not constant time, it's not even polynomial - it's psuedo-polynomial. Also it'll fail on negative numbers, right? You'll need something like `10000 * log(time + min(time) + 1)` to be linear in the bits u
10.
by _pastel 3y ago
Some ways to make recipients feel more comfortable: - You can suggest some other contribution. "Would you mind bringing snacks? / Would you mind handling music on the drive? / Would you mind giving X a ride?" - You can a
11.
by _pastel 4y ago
True in this situation, but note that intermediate activations and gradients do take memory and in other contexts that's the limiting factor. For example purely convolutional image networks generally take fixed-size image inputs, and
12.
by _pastel 4y ago
Ah, the celery semantics.
13.
by _pastel 4y ago
Interesting how Gitlab repeatedly emphasizes it's based on "cost of market", not "cost of living".
14.
by _pastel 4y ago
So in the sparse grams explanation, what are the bigram weights? Is it inverse frequency, so common bigrams get split last? And the goal is to be able to search on a larger gram that covers the more common trigrams as often as possible?
15.
by _pastel 4y ago
From https://acoup.blog/2019/07/26/collections-war-elephants-part... . I highly recommend the whole series. > At Bagradas (255 B.C. – a rare Carthaginian victory on land in the First Punic War) [...] the e
16.
by _pastel 4y ago
Did you target cloud infrastructure from the beginning, or fall into it by chance? Do you think that's an easier entry point than general programming?
17.
by _pastel 4y ago
I had a graduate algorithms class that was graded like this, but the teacher didn't explain and I was clueless. I spent the whole semester super stressed and convinced I was failing, then was shocked and befuddled by an A. "Emoti
18.
by _pastel 4y ago
I see this when giving and receiving form advice in a few physical disciplines. "Just relax your shoulders here and move naturally." Physical mastery often looks relaxed, natural, and simple, because all extraneous effort has bee
19.
by _pastel 4y ago
Thanks for all your work! If you don't mind some off-topic feedback on the Dominion website - have you considered making the Tables screen default to "New" only? At busy times, that screen consistently lags for several secon
20.
by _pastel 4y ago
Word of warning - if you write your own task queue at a startup, you will spend the rest of your tenure justifying this decision to every new data engineer who joins. Also, am I crazy or do the celery docs not even clarify their delivery se
21.
by _pastel 4y ago
If you're interested in browsing creative prompts, I highly recommend the reddit community at r/dalle2. Some are impressive: - www.reddit.com/r/dalle2/comments/uzosy1/the_rest_of_mona_lisa - www.redd
22.
by _pastel 4y ago
Because anytime I search for literature on basic tweaks to the structure of decision trees, I find nothing. Another example: modern GBM implementations all use binary trees. How would they perform with ternary trees? Or k-way trees for la
23.
by _pastel 4y ago
It's baffling to me how little research attention there has been to improving tree-based methods, considering their effectiveness. For example, LightGBM and XGBoost allow some regularization terms, but the variance/bias is still m
24.
by _pastel 4y ago
Note that greedy probability maximization or information gain are not quite optimal. Not without some kind of search or tiling heuristics. For example, suppose you've eliminated all the other ships and are only looking for the 2-ship.
25.
by _pastel 5y ago
These numbers focus on reads. How does writing speed to cache, main memory, or disk compare? Anyone have some ballparks to help me build intuition?
26.
by _pastel 5y ago
Maybe there's survivorship bias in that sample. Are ancient authors we still read more likely to be obsessed with legacy-building than the ones we've forgotten?
27.
by _pastel 5y ago
> [16] Design as a team; implement as individuals. This is pithy. I'm curious - does anyone here follow this philosophy? How do you actually design as a team? A meeting for every single design decision? I'm used to the team f
28.
by _pastel 5y ago
// [The eighth byte of LINENO_MID] changes in meaning over the course of // the program. It does indeed represent the billions digit most of // the time; but when the line number is getting close to a
29.
by _pastel 5y ago
Kaggle competitions rarely produce interesting algorithmic results. But I highly encourage you to read the winners' solutions. They are full of clever data insight, augmentations, regularizations, feature engineering, and preprocessi
30.
by _pastel 5y ago
Yes! It just takes practice. I started out finding a comfortable position and relaxing with a timer set for 15 minutes. After years of practice, I now hit REM almost immediately and wake up feeling rested without a timer in 15-20 minutes.

More ›