nshotton

7 ms·

1. 1.▲
   by nshotton 24d ago

   you could try using a local vision model, like Mage-VL from microsoft. Its only a 5b model so its quite small for the capability it has.
2. 2.▲
   by nshotton 1mo ago

   it looks like it says the 27b will be included in the release too, we will find out in 30 minutes lol
3. 3.▲
   by nshotton 1mo ago

   you can see the countdown here: https://modelscope.cn/models/Qwen/Qwen3.8-2.4T-A95B?spm=a2ty...
4. 4.▲
   by nshotton 2mo ago

   Thanks for posting this, it made a huge difference tweaking the recipe.
5. 5.▲
   by nshotton 2mo ago

   https://archive.ph/6Kz6H
6. 6.▲
   by nshotton 2mo ago

   I might be missing something here, but could this concept not also be used in the same way for harm? For example if a model is trained to replicated a sucessfull scammer?
7. 7.▲
   by nshotton 2mo ago

   flash is 284b isnt it? https://artificialanalysis.ai/models/deepseek-v4-flash
8. 8.▲
   by nshotton 2mo ago

   Yeah i shouldve been more clear, a model of this size could run on 2 dgx sparks so out of the range of a lot of the typical consumer sure, but I think there is definitely a market for that size
9. 9.▲
   by nshotton 2mo ago

   This model is shockingly small for how capable it is. its a little bit bigger than deepseekV4 flash but around as capable if not more on some benchmarks than V4 pro, i wouldnt be surprised if this becomes a popular local model.
10. 10.▲
    by nshotton 2mo ago

    sweet, is there any plans to implement VLLM in the future?
11. 11.▲
    by nshotton 2mo ago

    This looks really great! Quick question, is there any support for using local models?
12. 12.▲
    by nshotton 3mo ago

    I'm struggling to see how this could lower the cost to ideate here, almost all of the designs I can see on your page would require re drafting/designing it would be more beneficial for people to look at homes that have already bee