manili

7 ms·

1. 1.▲
   by manili 2y ago

   Fair enough, it's "nonsense". Curious to know about YOUR experience. Sounds "nonsense" yet?
2. 2.▲
   by manili 2y ago

   The issue is that I can give it a try on a set of toy problems, but finding a real-world-class problem is totally a different story IMHO. That is exactly the reason I asked about people's "experiences". Anyway thanks for the
3. 3.▲
   How much does CoT Reasoning typically cost for frameworks like LlamaIndex?

   2 points by manili 2y ago|4 comments
4. 4.▲
   Ask HN: The Cost of Building an AI Workflow with Open-Source Tools for a Startup

   1 points by manili 2y ago|1 comments
5. 5.▲
   by manili 2y ago

   Thanks @koutetsu, I know about FHE and TFHE, but as you said, they need a lot of computational resources. Ignoring the training process and just looking at inference, what are the "technical" drawbacks of this idea? If the first a
6. 6.▲
   Ask HN: Privacy-Aware Inferencing for LLMs

   1 points by manili 2y ago|2 comments
7. 7.▲
   by manili 3y ago

   Thanks a lot @brucethemoose2 Are there any evidences and studies (e.g. papers, case study, etc...) regarding possibility/impossibility of training or running the architecture on top of the infrastructure?
8. 8.▲
   Ask HN: Versal HBM Series vs. Nvidia A100 for LLM Training?

   2 points by manili 3y ago|2 comments
9. 9.▲
   Versal HBM Series vs. Nvidia A100 for LLM Training?

   1 points by manili 3y ago|0 comments
10. 10.▲
    Ask HN: Designing New RPi for Doing HPC, ML, etc.?

    2 points by manili 8y ago|3 comments