ychen306

7 ms·

1.
by ychen306 2mo ago
How do you deal with target-specific inline asm like tcgen05.mma?
2.
by ychen306 10mo ago
This. It's for renaming.
3.
by ychen306 11mo ago
Eventually the utility will be correctly priced. It's just a matter of time.
4.
by ychen306 11mo ago
It's orders of magnitude cheaper to serve requests with conventional methods than directly with LLM. My back-of-envelope calculation says, optimistically , it takes more than 100 GFLOPs to generate 10 tokens using a 7 billion paramete
5.
by ychen306 11mo ago
I try to avoid this ambiguity by calling such variables "values".
6.
by ychen306 1y ago
It's a TSP route over the highest 48 peaks of NH.
7.
by ychen306 2y ago
How this works is the LLM predicts the probability of the next token and then an arithmetic coder turns that probability distribution into bits. So it will never hallucinate. In the worst case, when the LLM makes an outrageous prediction, y
8.
by ychen306 2y ago
My main point is that these jobs are fundamentally different and people spend their time differently as a consequence. At this point, I am more curious about how what I argue even comes across as me feeling superior or being disrespectful
9.
by ychen306 2y ago
Not writing code doesn't equate to not working. Thinking, documenting, designing, discussing, etc are all important parts of their job. I don't understand why you seem offended by my take on this. This line of reasoning doesn&#x27
10.
by ychen306 2y ago
In this instance what would qualify as “pursing fundamentals” for a producer as defined by the author?
11.
by ychen306 2y ago
NFL players wouldn’t have time to do drills if their games last 8 hours and they need to play everyday.
12.
by ychen306 2y ago
Training is work but their main “events” are just much shorter than say that of a programmers. Even the longest athletic event like TdF lasts only several weeks. A programmer or lawyer worker 9 to 5 (at a minimum) doesn’t have time after wo
13.
by ychen306 2y ago
Athletes and musicians pursue fundamentals because they have time; their “work” occurs in intense but short bursts of performances, leaving them the rest of their days to practice. Knowledge workers don’t “practice” because their job (long-
14.
by ychen306 6y ago
They are both randomized. https://en.wikipedia.org/wiki/Las_Vegas_algorithm#Relation_t...
15.
by ychen306 7y ago
I think he's referring to threads as a programming model, not the physical implementation.
16.
by ychen306 7y ago
> Sprinkling printf statements is an efficient debugging technique. Debatable.
17.
by ychen306 7y ago
> Functional programming doesn't have state, so you don't need locks, so you can get better concurrency. This is not true. Many algorithms are intrinsically imperative (e.g., quicksort). You can represent it using some monads i
18.
by ychen306 7y ago
> , though he did not join until June 2016
19.
by ychen306 7y ago
It's related to intelligence in the sense that being able to predict well requires intelligence and helps compression. If you have an intelligent model that predicts new words with high confidence, then you can use fewer bits to enco
20.
by ychen306 7y ago
The counterpart of "Contracts" in C++ is "Traits" not "generics".
21.
by ychen306 7y ago
maybe use fences?
22.
by ychen306 7y ago
This is probably not useful for production, but volatile is a great way to see what kind of code compiler generates in a realistic setting. For example, if you want to see how compiler optimizes a code snippet and the code depends on a cons
23.
by ychen306 7y ago
Program verification. E.g. when you want to prove that certain condition/path (e.g. asserts) is unreachable.
24.
by ychen306 7y ago
This seems odd. I've known no one who learns programming by reading books. Reading books help, but most people get proficient by working on projects.
25.
by ychen306 7y ago
This is unlikely to happen because of the performance penalty it would incur (e.g. defining outcome of all out-of-bound memory accesses).
26.
by ychen306 7y ago
These analysis need each other for precision but not soundness. For instance, building a good call graph requires decent alias analysis, but to build a poor one you can always assume everything aliases with everything. So the idea is you ru
27.
by ychen306 7y ago
Arithmetic coding is a standard compression technique. It uses less bits for more frequent characters (think Huffman code, even though they are not the same). This one makes arithmetic coding "adaptive". Consider this. The rough f
28.
by ychen306 8y ago
Perhaps some people are missing the point here?. The post is not about the technical challenge/novel but rather how existing ML techniques can play a part in making reusable energy more efficient.
29.
by ychen306 8y ago
You need O(log(n)) of bits to write down the input. So the output size is indeed exponential. Size of input: O(log n) Size of output: O(log(c^n)) = O(n)
30.
by ychen306 8y ago
> It is entirely possible to build something without understanding it. [...] Our relationship with true A.I. will always be a matter of faith, not proof WTF. I have no problem with building something without understanding how or why it

More ›