Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
guess__who
searching Neon…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
6 ms
·
1.
▲
by
guess__who
2mo ago
Some harness (cc) injects system messages in the middle, this kills the cache as the model provider moves the system to the top and concatenate them together. Use homemade proxy, you will get same 99% hot rate with even cc.