karimf

5 ms·

1.
by karimf 7d ago
While this is very impressive benchmark-wise, GPT-6 Astra showed us that benchmarks don't always correlate 1:1 to intelligence of a model. When Astra launched, I think Artifical Analysis showed that it was on par with GPT-5.6 Sol and l
2.
K2 Horizon: A connected fleet of six open models(ifm.ai)
335 points by karimf 13d ago|131 comments
3.
by karimf 23d ago
I think a curriculum like this is neat and might help with interviews since you go wide and have a checklist of things that you need to learn. I'm on a totally different path for learning inference engineering. I self-host a voice AI a
4.
by karimf 29d ago
Yes. Please seriously try other models. See relevant thread here: https://news.ycombinator.com/item?id=49296740
5.
by karimf 1mo ago
This 100%. I was Anthropic-pilled. I had a $200/mo subscription and I only used Anthropic models. I was frustrated by the verbose output and the writing style. I tried ASD-STE-100, it helped a bit, but it's still too verbose for m
6.
by karimf 1mo ago
Not sure why it's on the front page now, but I highly recommend using llama.cpp for running AI model locally vs using other inference framework, unless you have a very specific requirement. ggerganov and the team have done a stellar jo
7.
We built a realtime system for responsive voice AI in six months(openai.com)
1 points by karimf 1mo ago|0 comments
8.
by karimf 1mo ago
Yes, and also waiting for the next iteration of Gemma. Muse or Qwen are optimized for coding, while IMO Gemma is still better for non-coding tasks. https://x.com/osanseviero/status/2086107547535122767
9.
by karimf 1mo ago
Practically ~20GB with KV cache > We quantize weights to ~4-bit, bringing the LM under 20 GB. We validated minimal to no degradation on agentic tasks under compression. https://www.reddit.com/r/LocalLLaMA/commen
10.
Nvidia NemotronLabs VoiceChat 11B – real-time full duplex with tool calling(huggingface.co)
2 points by karimf 1mo ago|0 comments
11.
by karimf 2mo ago
Most people are going under identity crisis right now because of recent LLM advancements. This post is a good example that shows that it's not only happening at the individual level, but also on the company/organization level. Is
12.
Turn and Face the Strange(fly.io)
4 points by karimf 2mo ago|0 comments
13.
by karimf 2mo ago
This repo is a good starting point for comparing TTS models https://github.com/5uck1ess/tts-bench Kokoro is a really good model, considered it’s released 1.5 years ago. It’s punching above its weight https:/&#x2F
14.
Why WebRTC beats WebSockets for realtime voice AI(livekit.com)
5 points by karimf 3mo ago|0 comments
15.
by karimf 4mo ago
I've been using Zed for a few weeks now and these two are also my main complaints as well.
16.
Unsloth Joins PyTorch Ecosystem(unsloth.ai)
8 points by karimf 4mo ago|2 comments
17.
Denial of Service Vulnerability in React Server Components(github.com)
2 points by karimf 4mo ago|0 comments
18.
by karimf 5mo ago
Oh yeah for sure. At that point, using SES is probably a better option compared to running a VPS just for SMTP. I posted that to let them know that SMTP support is a requirement for some developers.
19.
by karimf 5mo ago
Ok I just tried the service since I want to migrate from Resend. Seems like you can only send email via the worker or REST API for now? Can I send via SMTP? I'm using Supabase and it needs the SMTP credentials. I can't find anythi
20.
by karimf 5mo ago
Related: Gemma 4 on iPhone (254 comments) - https://news.ycombinator.com/item?id=47652561
21.
by karimf 5mo ago
This is an interesting approach. > How does this compare to Next.js App Router? > Next.js App Router is server-first: your component tree lives on the server by default, and you opt into client interactivity with 'use client&#x27
22.
by karimf 5mo ago
Well, on my demo it's around 2.5s and I already consider it as a "real-time". One way to improve it is to disable the image input.
23.
by karimf 5mo ago
What's your average response time with M1 max and what's the target?
24.
by karimf 5mo ago
Is this the problem? https://news.ycombinator.com/item?id=47669954
25.
by karimf 5mo ago
In the /r/macapps subreddit, they have huge influx of new apps posts, and the "whisper dictation" is one of the most saturated category. [0] >“Compare” - This is the most important part. Apps in the most saturated cat
26.
by karimf 5mo ago
During my limited testing, it works better than I expected at handling multiple languages in a single session. Perhaps I just had a low expectation since I've mostly worked with English-only STT models.
27.
by karimf 5mo ago
Nothing unique, it's just taking a snapshot when it's processing the input. Even processing a single image will increase the TTFT by ~0.5s on my machine, so for now, it seems to be impossible for feeding a live video and expecting
28.
by karimf 5mo ago
Huh that's weird. I just tried it and it works on my machine. Could you perhaps create a GitHub issue and share the reproduction steps and any relevant logs?
29.
by karimf 5mo ago
This. I posted this on my other comment, but there's a meme that "Gen Z Kids Don't Understand How File Systems Work" [0]. There seems to be a disconnect between some developers and the younger folks. [0] https:/&#x
30.
by karimf 5mo ago
This is my stance as well, but keep in mind that a lot of people have the opposite preference. They didn't grow up with the world wide web. They only started using technology when Android and iPhone was popular. They only know Whatsapp

More ›