Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
yahavthehackern
searching Neon…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
5 ms
·
1.
▲
by
yahavthehackern
3mo ago
How bad is the token-per-second drop-off on the Mac once you scale up the context window? Does it hit a wall at 32K or 64k tokens?