hajile

14 ms·

1.
by hajile 15d ago
Water usage may be a drop in the bucket nationally, but they tend to put datacenters in areas without much water (often because evaporative cooling is less expensive in arid regions) and the effects to those local water supplies can be extr
2.
by hajile 15d ago
The markets may not be claiming a recession, but the real world certainly is.
3.
by hajile 17d ago
Vectors are pretty big for speeding up stuff like string comparisons. Bit manipulation offers up to almost 10% advantage. Zicond allows branchless code which represents significant speedups. There’s also serious gains to be had from crypto
4.
by hajile 1mo ago
Rewriting critical stuff like hand-written SIMD takes a long time (though not as long as it took ARM because ARM had to overcome everything being written in just one ISA). Even a decade in, there are still lots of low-hanging fruit in RISC-
5.
by hajile 1mo ago
If such an instruction is so obviously important, we'll see it start popping up as a custom instruction in some cores then it will get adopted as an official extension by other companies trying to stay competitive.
6.
by hajile 1mo ago
> The problem is that RISC-V is never going to win at the high end. RISC-V will never have as much money driving it forward as x86 and ARM. As such, the blocks and integration will always lag. Qualcomm recently bought Ventana and are loo
7.
by hajile 1mo ago
Here's a good one. Qualcomm beat ARM in court and reportedly pays 2-3% royalties where ARM was demanding 5-10% royalties. Qualcomm's ARM license expires around 2028 with an option to extend to 2033 (for some amount of money). If Q
8.
by hajile 1mo ago
> I will make one ISA propsal: x86_64 should have had 32 instead of 16 registers APX proposes exactly this along with 3-register syntax and some other things. There are two big issues IMO. 1. It will take at least 15 years before most so
9.
by hajile 1mo ago
Not too long ago, the claim was that having multiple Phds worth of knowledge was the real value of AI, but now that's gone and it's suddenly a good thing. That's a sales tactic -- not a logical position.
10.
by hajile 1mo ago
I think this has to do with parallel decoding. How do you tell that the immediate is an immediate instead of an instruction? You have to carve out a very large part of the encoding space and you still can't fit a full immediate (eg, if
11.
by hajile 1mo ago
Not traditional VLIW per-se as packets wouldn't imply parallelism (though that's theoretically possible) and instruction count would vary. 2-register to 3-register also just involves different wiring and costs nothing. I think you
12.
by hajile 1mo ago
How about EPIC-esque packet-based instructions? 64-bit instructions with 4 bits indicating instruction formats (60-bit, two 40+20-bit variants, 30+30-bit, 20+20+20-bit, three 30+15+15-bit variants, and 15+15+15+15-bit). Have each larger ins
13.
by hajile 1mo ago
How can you use consistency and SSE/AVX in the same sentence? SSE has inconsistencies like SSE4.x vs SSE4a. AVX is an even more mixed bag. There are some 19 AVX-512 extensions and ZERO chips support all of them. The situation is so bad
14.
by hajile 1mo ago
Neither AlphaGo nor AlphaZero were transformers. Why would you expect the same results? Going further, current LLMs have at least an order of magnitude more computing resources, but completely suck at go. Why would this suddenly change unle
15.
by hajile 1mo ago
Scheme SRFIs make Scheme a much bigger language while also making it painful to use because you have to research which SRFI are implemented in your scheme variant then map those SRFI numbers to what they actually do then you usually need re
16.
by hajile 1mo ago
JS converts most number into 31-bit ints internally (which is why it’s so fast). GUI work often prefers int or f32. You have a point about games, but the CPU is seldom the limiting factor. Very few people are handling raw audio. For the res
17.
by hajile 1mo ago
> Itanium would still have sucked I'm not completely convinced of this. If you ignore VLIW, you just have a very unexciting RISC ISA, but because of the VLIW, you get extra scheduling info that most RISC designs don't provide w
18.
by hajile 1mo ago
How will costs come down? Each generation of model is more expensive to train and run than the last. More efficient hardware? That means throwing out billions of dollars worth of existing hardware and buying billions more in hardware. The c
19.
by hajile 1mo ago
As it stands, the leaked financials prove him correct. Given their losses (not counting restructuring) they are going to need enough funding to buy any of the bottom 300-400 of the F500 companies outright just to keep the lights on for the
20.
by hajile 2mo ago
The real answer is to stop trying to have AI reviewing AI code because it's just the blind leading the blind.
21.
by hajile 2mo ago
Nvidia already seems to be pivoting to "Local inferencing" with stuff like RTX Spark laptops. The problem is that local inference machines won't allow anywhere close to their current margins or gross sales figures. At the sam
22.
by hajile 2mo ago
On a $100B AI datacenter, some 60-70% of the center needs to be replaced every 2-6 years. These companies claim the hardware lasts 6 years while simultaneously claiming they are relying on new hardware to lower inference costs (implying muc
23.
by hajile 2mo ago
All "interim" AI contributions to OpenJDK can and will be sued to make big money off of Oracle if those court cases don't go a certain way. This is ironic given how Oracle has bet almost everything on AI succeeding.
24.
by hajile 2mo ago
The distillation commentary is really crazy coming from a company that stole all it's training material.
25.
by hajile 2mo ago
You formally verify that your incorrect solution executes without a hitch, but you might just be formally verifying that any user can hit your API and download all your plaintext passwords. Lots of security bugs are caused by incorrect spec
26.
by hajile 2mo ago
He sees what is coming. Crowd funding HAS to be dropping off as people choose between feeding their family or their favorite content creators (the creator will be fine as they have lots of other patrons is a guilt-free rationalization too).
27.
by hajile 2mo ago
I might buy this if those languages were actually faster. Instead, implementations of scheme with no commercial backers run circles around scripting languages with huge budgets. Common Lisp can match and exceed languages like Java without t
28.
by hajile 2mo ago
Last I checked, both of these were built on top of Common Lisp/SBCL.
29.
by hajile 2mo ago
function can do what a macro does, but it must run every single time while the macro can run just one time during the final code generation. Let's say you have some Java-style a + b. It needs to work on native strings (concatenation) a
30.
by hajile 2mo ago
Your lisp criticism is orthogonal to the idea of lisp itself. Lisps like Coalton (lambda calculus) or Shen (sequent calculus) are strongly typed. AI is an interesting point too where being closer to a raw AST is likely an advantage because

More ›