DwarvenEngineer

4 ms·

1. 1.▲
   by DwarvenEngineer 23d ago

   does that mean they're measuring bandwidth differently than how others (like nvidia) does it? memory bandwidth is the gating factor of running models locally, so if it's actually 8x 150GB/s, it may help something like prefill
2. 2.▲
   by DwarvenEngineer 2mo ago

   Ironically for home-lab users (ie those who primarily have access to consumer hardware), apple silicon is probably the best value (and also the most obtainable for running some of the smaller sized models. You can get unified memory of up t
3. 3.▲
   by DwarvenEngineer 2mo ago

   Honestly, I just hate the term "physical AI". They're robots. It's unfortunate that we had to adopt a term with the words AI in it, just to get investor's attention.
4. 4.▲
   by DwarvenEngineer 7y ago

   yeah, i'd say so. what if lyft's lidar manufacturers said that they should be included in this release because it's their lidars? I agree, it doesnt really need mentioning