AndrewLiu96

7 ms·

1.
by AndrewLiu96 2mo ago
No worries! Thank you for checking it out. The cache-aware concurrency was a ton of fun to implement
2.
Show HN: Millwright – Rust-based, self-hosted LLM router(github.com)
10 points by AndrewLiu96 2mo ago|7 comments
3.
by AndrewLiu96 2mo ago
I assume you're referencing Sakana Fugu? Similar in the sense that there's multiple models involved, but from what I understand Fugu is kind of a black box in terms of what model is used for what. This project is more deterministi
4.
by AndrewLiu96 2mo ago
Thanks for checking it out!
5.
by AndrewLiu96 2mo ago
That's awesome! I'd love to check it out and give it a try
6.
by AndrewLiu96 2mo ago
Noted!
7.
by AndrewLiu96 2mo ago
That was actually one of my naming inspirations, the george foreman grill is a s tier invention
8.
by AndrewLiu96 2mo ago
Could you point out where you see the slop in the codebase? I'm more than happy to address it and make the tool better and more useful :)
9.
Show HN: Foreman, a self-hosted LLM gateway for cost aware model routing(github.com)
15 points by AndrewLiu96 2mo ago|16 comments
10.
Show HN: An opinionated ranking of 21 open-weight LLMs, filterable by your GPU(northwoodsystems.ai)
3 points by AndrewLiu96 3mo ago|1 comments
11.
Cheaper LLM tokens led to bigger AI bills (Jevons paradox)(northwoodsystems.ai)
3 points by AndrewLiu96 3mo ago|0 comments
12.
by AndrewLiu96 4y ago
Centro | Senior Full-Stack Engineer | Remote First (Canada) or Toronto | Canada | Full-time | https://www.centrocommerce.com/ Centro is hiring a Senior Full Stack Engineer to join on our engineering team. We're a ventu
13.
by AndrewLiu96 4y ago
Centro | Senior Full-Stack Engineer | Toronto or Remote (Canada) | Canada | Full-time | https://www.centrocommerce.com/ Centro is hiring a Senior Full Stack Engineer to join on our engineering team. We're a venture bac