ban-lan-gen

6 ms·

1. 1.▲
   Ask HN: How to store KV cache efficiently on disk?

   1 points by ban-lan-gen 2y ago|0 comments
2. 2.▲
   by ban-lan-gen 2y ago

   Lookup the meaning of theoretical
3. 3.▲
   by ban-lan-gen 2y ago

   Does this only apply to PDFs with many images? If it is mostly text and table, could it just extract plain text?
4. 4.▲
   Dataflow Execution in GPU(arxiv.org)

   3 points by ban-lan-gen 2y ago|0 comments
5. 5.▲
   HBF for GPUs(tomshardware.com)

   1 points by ban-lan-gen 2y ago|0 comments
6. 6.▲
   by ban-lan-gen 3y ago

   When I browsed GitHub repos. I came across some repos that implied "Because my thing is written in Rust, it automatically comes with a good performance, good scalability, etc". Jumping into a new language because people said it h
7. 7.▲
   by ban-lan-gen 3y ago

   I don't understand all those rust hypes here. What indeed does rust bring to the table?
8. 8.▲
   by ban-lan-gen 3y ago

   Something like that 4^30 >>> 8^13?
9. 9.▲
   by ban-lan-gen 3y ago

   They just want to sell some expensive hardwares?
10. 10.▲
    by ban-lan-gen 3y ago

    Haha?
11. 11.▲
    by ban-lan-gen 3y ago

    Minor thing: the link redirects to the org but not the actual repo.
12. 12.▲
    by ban-lan-gen 3y ago

    I finally have some evidence to stop my wife's complaints.
13. 13.▲
    by ban-lan-gen 3y ago

    Just curious what kinds of models are used in your project? https://arxiv.org/abs/2306.08891 One paper seems to suggest trained specialized model can outperform LLM in some tasks.