abcdabcd987

5 ms·

1.
Harnessing 3200 Gbps Network: A Journey with RDMA, EFA, and Libfabric(le.qun.ch)
11 points by abcdabcd987 2y ago|0 comments
2.
Anonynmized Archive Open Letter to ArXiv Leaders (2017)(lph.ece.utexas.edu)
1 points by abcdabcd987 3y ago|0 comments
3.
by abcdabcd987 3y ago
Related discussion on serving finetuned LLMs: https://news.ycombinator.com/item?id=38196661
4.
by abcdabcd987 3y ago
Thanks for your encouragement! We are working on quantization as well. We recently submitted a paper, Atom [1], that uses 4-bit quantization, delivering 7.73x throughput compared to FP16 and 2.53x compared to INT8. Atom is able to maintain
5.
by abcdabcd987 3y ago
Certainly! We'd like our good designs to be picked up by frameworks and serve all users. Currently, Punica is built on top of PyTorch and HuggingFace Transformers ecosystems. Therefore, vLLM and LMDeploy, which are also in the PyTorch
6.
by abcdabcd987 3y ago
Thank you! We are also very excited about combining the fast fine-tuning and efficient serving. In fact, what you just said is very related to one of our very first motivations. In my previous blog post [1], I call this scheme "Just-in
7.
by abcdabcd987 3y ago
Thanks for the question. Currently Punica is on the ecosystem of PyTorch and HuggingFace Transformers. So PyTorch users can start to use Punica now. Look forward to collaboration with TVM and MLC to reach more users :)
8.
Punica: Serving multiple LoRA finetuned LLM as one(github.com)
135 points by abcdabcd987 3y ago|26 comments
9.
by abcdabcd987 3y ago
On a related note, Google also uses optical circuit switches in their datacenter network. See the paper form SIGCOMM'22 [1]. [1] Jupiter Evolving: Transforming Google’s Datacenter Network via Optical Circuit Switches and Software-Defin
10.
by abcdabcd987 4y ago
I'm using 27-inch 4K monitors with Gnome. I found it more practical to use no scaling but 1.25x text size (settings in gnome-tweaks). The problem for me with 2x scaling or fractional scaling is that it scales UI (icons, margins) as wel
11.
Backblaze Down for Log4j Maintenance(help.backblaze.com)
5 points by abcdabcd987 5y ago|0 comments
12.
by abcdabcd987 5y ago
I use Automate[1] to do this. Just draw an infinite loop that does sms_received[2] and email_send[3]. [1] https://play.google.com/store/apps/details?id=com.llamalab.a... [2] https://llamalab.com/au
13.
The fastest interconnect for hundreds of CPUs, GPUs and FPGAs (2017)(alexeyab.com)
2 points by abcdabcd987 5y ago|0 comments
14.
Japanese director Takeuchi Ryo interviews Huawei’s international employees(youtube.com)
1 points by abcdabcd987 6y ago|0 comments
15.
by abcdabcd987 6y ago
> If you find a really good tutorial by programmers who are both excellent teachers and experienced in that particular field, it beats JIT learning on a personal project in one important respect. You get exposure to the One True Way of d
16.
by abcdabcd987 6y ago
Just mentioning two related programs in my mind: Franz ( https://meetfranz.com/ ) and nativefier ( https://github.com/jiahaog/nativefier ).
17.
Chowbus user data breach (email, name, phone, address) with 800k rows
17 points by abcdabcd987 6y ago|6 comments
18.
by abcdabcd987 6y ago
Just want to mention bitbar[1]. Write anything to stdout, it'll make it show up in the menu bar. [1] https://github.com/matryer/bitbar
19.
by abcdabcd987 7y ago
Check out the HotOS'19 paper from our lab :) https://danyangzhuo.com/papers/HotOS19-Stone.pdf
20.
How we discovered why C++ exceptions disappear in stacktrace(le.qun.ch)
3 points by abcdabcd987 8y ago|0 comments
21.
Show HN: Enjoy computation resources sharing at your laboratory with `lxc-gpu`(github.com)
3 points by abcdabcd987 8y ago|0 comments
22.
The Random Forest Based Detection of Shadowsock's Traffic(ieeexplore.ieee.org)
1 points by abcdabcd987 9y ago|0 comments
23.
by abcdabcd987 9y ago
I think I did almost the same thing three years ago. See: https://www.v2ex.com/t/121272 (in Chinese only, sorry. I should translate it to English when I'm free)
24.
Upwork’s CEO on How an Introverted Engineer Learned to Lead(hbr.org)
1 points by abcdabcd987 10y ago|0 comments
25.
by abcdabcd987 11y ago
Well, it's not a big problem. This case won't exist in most BSTs. Even if it appears in some BST, splay tree for example, it will be amortized.
26.
by abcdabcd987 11y ago
I'm confused. I can follow the logic for O(sqrt n) searching. yeah, that's cool. But how to maintain the structure when inserting or deleting? Insertion for example, if I want to insert a value which is smaller than the smallest e