theoli

6 ms·

1. 1.▲
   by theoli 2mo ago

   I have two products in the wild with PIN entry for kiosk users that have a regular text input field. I have been asked if it could be the typical single digit boxes thing like this, but _never_ by the actual kiosk users. The kiosk users don
2. 2.▲
   by theoli 3mo ago

   Exactly this, it’s the loops. The first 50k tokens of a task is by far the most valuable. But when left to run independently, the agent will consume millions of tokens of error messages from running tests and discovering a minor syntax erro
3. 3.▲
   by theoli 5mo ago

   There was this ROCm bug I was watching for awhile: https://github.com/ROCm/ROCm/issues/5706 - This is about the GPU clock remaining at max frequency, but that can drive the fan speed to increase. It doesn&#x2
4. 4.▲
   by theoli 5mo ago

   I have a dual R9700 machine, with both cards on PCIe gen4 x8 slots. The 256bit GDDR6 memory bandwidth is the main limiting factor and makes dense models above 9b fairly slow. The model that is currently loaded full time for all workloads o
5. 5.▲
   by theoli 9mo ago

   I am doing this with good success parsing receipts with ministral3:14b. The first prompt describes the data being sought, and asks for it to be put at the end of the response. The format tends to vary between json, bulleted lists, and name:
6. 6.▲
   by theoli 9mo ago

   Epoch shift with 48-bit timestamp that has >12,000 years of range to get another 50 years of range is an amusing choice.