baruch

7 ms·

1.
by baruch 2mo ago
I find it useful to see such a project. It's an interesting view of the system and a neat idea, I don't care if it's just a couple of ai prompts and will be abandoned next week or maintained for life, the idea itself is good
2.
by baruch 4mo ago
It is possible to get more tokens out of the same hardware by leveraging fast storage for KVCache, it is especially useful for agentic workloads.
3.
Storage based KVCache for denser token factory(blogs.oracle.com)
1 points by baruch 4mo ago|1 comments
4.
by baruch 5mo ago
If they started doing caching properly and using proper sunrooms for that they'd have a better chance with that
5.
by baruch 5mo ago
It is mathematically impossible for a proper hash function (one with an output range smaller than its input range) to not have collisions. The proof uses the Pigeon Hole Principle https://en.wikipedia.org/wiki/Pigeonhol
6.
by baruch 6mo ago
You can ask an LLM to create a github action for that. The action can fail if the rebase fails and you can either fix it yourself or ask an LLM to do it for you.
7.
by baruch 7mo ago
Isn't that handled pretty well these days with sub agents? They can research the code without polluting the context.
8.
by baruch 7mo ago
There is a global setting you can do to disable using the Claude.ai MCPs from being used on your Claude code.
9.
by baruch 7mo ago
The complaints are against the open-weight LLMs, I didn't try them much. I do use mostly Claude as that's what the company is paying for. They don't pay for laptops with GPUs or locally hosted LLMs to test those. It's no
10.
by baruch 7mo ago
I work with D and LLMs do very well with it. I don't know if it could be better but it does D well enough. The problem is only working on a complex system that cannot all be held in context at once.
11.
by baruch 8mo ago
Is it possible to put such a driver for nvme under igb_uio or another uio interface? I have an app that uses raw nvme devices and being able to tests strange edge cases would be a real boon!
12.
by baruch 9mo ago
Ages ago, working on an embedded system we did something similar by running gdb server on the embedded machine and gdb on the server and running a script to collect periodic stack traces to get a sampling profiler.
13.
by baruch 9mo ago
The company still got $20B of cash(?) in its books, it can pay dividends to its shareholders (investors) and they get their payment. The company can go down the drain afterwards. If it can still make money with its remaining assets that&#x2
14.
by baruch 1y ago
We do storage systems and use DPDK in the application, when the network IS the bottleneck it is worth it. Saturating two or three 400gbps NICs is possible with DPDK and the right architecture that makes the network be the bottleneck.
15.
by baruch 1y ago
Once there will be a business around this and people will make money the businesses will maintain a lobby to keep doing it and even increase the operation.
16.
by baruch 1y ago
I only use my common sense here, but it doesn't stop the production it just prevents the transport from the source to the destination through the area that was previously iron deficient and couldn't use the fully the other nutrien
17.
by baruch 1y ago
It's easier to write the system's front end while paying little attention to the backend and "just" letting a local filesystem do a lot of the work for you, but it doesn't work well. The interesting question is if t
18.
by baruch 2y ago
I find that my understanding of different layers is usually not needed but is rarely important toy ability to solve thorny issues or figure out ways to do things or debug issues that others are not even trying. I'm working in areas of
19.
by baruch 2y ago
The advantage for text based interfaces is that they work over ssh/tmate over trans atlantic connections whereas the GUI tools would suffer greatly. It just works everywhere and if you learn it, it will be just as good as a gui debugge
20.
by baruch 2y ago
Asynchronous IO with user space threads works wonders to get both the performance of async IO and the convenience of sequential programming.
21.
by baruch 2y ago
My day job is working on a product that uses DPDK for a super high performance file system.
22.
by baruch 2y ago
Your company already doesn't really care about you (for the vast majority of them at least), so there is a conflict of interest but you personally shouldn't take the side of the company.
23.
by baruch 2y ago
I do. To learn a code base it before tremendously, also to find what happened and why things were done it is off great help. I don't need it every day but I routinely do git archeology.
24.
by baruch 2y ago
Do note that more drives mean higher chance to see a failure...
25.
by baruch 2y ago
I'm working mostly with enterprise drives and not consumer. These drives can write continuously at 1 to 4 GB/s depending on the specific type (mixed use vs read intensive vs very low writes).
26.
by baruch 2y ago
They do fail and you should have redundancy and backup but there isn't a real point to do the optimization that the article describes.
27.
by baruch 2y ago
NVMe drives fail at a fairly low rate so this is an optimization for a very small edge case and since they are also very fast it's not like you'll be doing a rebuild for 6+ hours like with HDDs. It also doesn't change anythin
28.
by baruch 2y ago
And here we are working on systems with dual 400Gbps and sending data out of storage clusters at 5 TiB/s.
29.
by baruch 2y ago
I believe pricing (in quantity, these usually do not sell by single pieces) is around 6 cents a Gig so about $7680. I could very well be wrong though, it's been a while since I heard pricing of DC SSDs.
30.
by baruch 2y ago
Effect of element alignment in a memory pool by L1 cache collision.

More ›