lanceflt

8 ms·

1. 1.▲
   by lanceflt 7mo ago

   Council taxes are property taxes and are monthly.
2. 2.▲
   by lanceflt 1y ago

   Thanks! I've emailed.
3. 3.▲
   by lanceflt 1y ago

   The key issue for the sector is the tens of legacy systems that don't integrate with each other, often with manual spreadsheet processes that could be easily automated. Yet the big players like Oracle sell a generic CRM experience that
4. 4.▲
   by lanceflt 2y ago

   Deepseek R1 (full, Q1) is 14t/s on an M2 Ultra, so this should be around 20t/s
5. 5.▲
   by lanceflt 2y ago

   RAM for 4-bit is 1GB per 2 billion parameters. So you will want 256GB RAM and at least one GPU. If you only have one server and one user, it's the full parameter count. (If you have multiple GPUs/servers and many users in parallel
6. 6.▲
   by lanceflt 2y ago

   I'm running a 4090 at 280W, and I'm seeing ~96% of the performance of 450W. There's no need to run it at full power.
7. 7.▲
   by lanceflt 2y ago

   This is just an ad for the Swiss chocolate industry. The only people quoted are being funded directly by chocolate manufacturers.
8. 8.▲
   by lanceflt 2y ago

   https://github.com/openai/sparse_autoencoder They actually open sourced it, for GPT-2 which is an open model.
9. 9.▲
   by lanceflt 2y ago

   They didn't train the vision encoder either, it's unchanged SigLIP by Google.
10. 10.▲
    by lanceflt 2y ago

    - Llava is not the SOTA open VLM, InternVL-1.5 is https://huggingface.co/spaces/opencompass/open_vlm_leaderboa... You need to compare the evals to strong open VLMs including this and CogVLM - This is not "fir