aegis_camera

6 ms·

1. 1.▲
   by aegis_camera 6mo ago

   Thanks, we are not large R&D lab, limited resources. We were working on a product with is a Local VLM first BYOD when you want Video Security application, our users requested to have a MLX backend benchmark comparison, we tried hard to
2. 2.▲
   by aegis_camera 6mo ago

   Tried, but wrong time to post, it got zero attention . :)
3. 3.▲
   by aegis_camera 6mo ago

   One of my user requested MLX comparison with GGUF, he wanted to run the benchmark, I was thinking about how to get MLX support without bundling the python code together with SharpAI Aegis, a Local or BYOK local security agent https:/&
4. 4.▲
   by aegis_camera 6mo ago

   Here is a reference https://www.sharpai.org/benchmark/ For specific tasks, local model could achieve workable level.
5. 5.▲
   by aegis_camera 6mo ago

   Thanks, pure Swift was the design idea and since I found nothing could be used for my project https://www.sharpai.org then I created Swift version. Python is too heavy to be delivered with application, user mentioned they want t
6. 6.▲
   by aegis_camera 6mo ago

   https://www.sharpai.org/benchmark/ The MLX part is what we've done with SwiftLM, the local result is still being verified more details are on-going.
7. 7.▲
   by aegis_camera 6mo ago

   I've ran this on an IPHONE 13 pro (6GB) memory, QWEN 3 1.7B runs good. So local will get more intelligent for the task you want it done soon or already.
8. 8.▲
   by aegis_camera 6mo ago

   Yes, I've ran it on IOS, IPHONE 13 pro beside M5 pro, I'll test it on my M2 Mini and M3 Air.
9. 9.▲
   by aegis_camera 6mo ago

   the Python mlx-metal trick is actually what's crashing it. The mlx.metallib from pip is a different version of MLX than what your Swift binary was built against. It gets past the startup error but then corrupts the GPU memory allocator
10. 10.▲
    by aegis_camera 6mo ago

    git clone https://github.com/SharpAI/SwiftLM # no --recursive needed cd SwiftLM swift build -c release ### Please let me know if this fix the issue: # Copy metallib next to the binary (one-time step) cp LocalPackages&
11. 11.▲
    by aegis_camera 6mo ago

    Yes, this is a reference project, the main different is we don't use os swap ( it introduces latency, will add https://github.com/danveloper/flash-moe to the original reference as well ).
12. 12.▲
    by aegis_camera 6mo ago

    I'll add more details. We just wired up the pipeline on both MAC and IOS.
13. 13.▲
    by aegis_camera 6mo ago

    We implemented two techniques to run massive 100B+ parameter MoE models natively on the M5 Pro 64GB MacBook Pro: TurboQuant KV compression: We ported the V3 Lloyd-Max codebooks from the TurboQuant paper (Zandieh et al., ICLR 2026) into nati
14. 14.▲
    TurboQuant KV Compression and SSD Expert Streaming for M5 Pro and IOS(github.com)

    77 points by aegis_camera 6mo ago|47 comments
15. 15.▲
    by aegis_camera 6mo ago

    Thank you for your feedback.
16. 16.▲
    Show HN: SwiftLM – Qwen Chat on iPhone, 100B+ Moe on M5 Pro 64GB (Native Swift)(github.com)

    1 points by aegis_camera 6mo ago|2 comments
17. 17.▲
    by aegis_camera 6mo ago

    I see, so connect to the existing HA will be the priority.
18. 18.▲
    by aegis_camera 6mo ago

    Hi, thanks for your bug report, we had a fix and uploaded to the following GitHub release page, we are working on more testing meanwhile: https://github.com/SharpAI/DeepCamera/releases/download/v202...
19. 19.▲
    by aegis_camera 6mo ago

    I don't know if I can post the email here hopefully hn doesn't filter it out: service at sharpai.org
20. 20.▲
    by aegis_camera 6mo ago

    The comments are actually done by me... The benchmark suit is here: https://github.com/SharpAI/DeepCamera/tree/master/skills/ana...
21. 21.▲
    by aegis_camera 6mo ago

    This is used for middle man attack detection usually... And thanks a lot for reviewing the benchmark.
22. 22.▲
    by aegis_camera 6mo ago

    We do have multiple platform tested, like AMD , Nvidia , Windows / MAC. Will get better user experience on the landing page soon.
23. 23.▲
    by aegis_camera 6mo ago

    Oh, sorry about that, will optimize it.
24. 24.▲
    by aegis_camera 6mo ago

    Mac version is up 5 mins ago, let me know if team breaks anything, ... Weekend will be on call. LOL.
25. 25.▲
    by aegis_camera 6mo ago

    We managed a fix to loosen the validation, the version number is 0.2.7. Mac version is released, waiting for Windows' release.
26. 26.▲
    by aegis_camera 6mo ago

    I just received one report that UniFi is using RTSPs, one fix is to loosen the RTSP string pattern, a release version is uploading ( 0.2.7 ). I'll find one UniFi camera to test secure RTSP streaming.
27. 27.▲
    by aegis_camera 6mo ago

    Yes, we are working on that. HA integration will be published as an open sourced skill. https://github.com/SharpAI/DeepCamera/tree/master/skills/int... Do you want to have connect to your existing
28. 28.▲
    by aegis_camera 6mo ago

    After the temp setting fix, I didn't run mini gpt5. Sorry, my bad.
29. 29.▲
    by aegis_camera 6mo ago

    Oh, sorry about that. I didn't test RTSPS stream, what model is it? I'll go by one and test. Before then, I'll check the flow to loosen the validation. Let's prepare a release for this ...
30. 30.▲
    by aegis_camera 6mo ago

    I see, I think the bar is really hight, right?