reflectiveattn

7 ms·

1. 1.▲
   by reflectiveattn 1y ago

   This is the complete opposite of how LLMs are trained. LLMs are most effectively prompted (for instruct/chat finetunes anyway, i.e. chatbots) through the same kind of language patterns (natural or formal/programming) that they lea
2. 2.▲
   by reflectiveattn 1y ago

   This. This is the most important thing to consider: the available corpus the model was trained on. Remember that LLMs are inferring code. They don't "know" anything at all about its axiomatic workings. They just know what &
3. 3.▲
   by reflectiveattn 1y ago

   The language using the fewest punctuation tokens is going to be the safest from most categories of hallucination, and give each context window the greatest usable space for vector manipulation headed into self-attention before the model suf