7 ms·
High level it's basically: 1. Generate a lot of text examples that look like this: https://gist.githubusercontent.com/davidhershey/f57d0b19563fef86b117751dcbe6d
by dmakian 3y ago
High level it's basically:
1. Generate a lot of text examples that look like this: https://gist.githubusercontent.com/davidhershey/f57d0b19563fef86b117751dcbe6de20/raw/7bba77a61f6b698563157efe2a772954456cfe5e/full_draft_prompt_chatml.txt https://gist.githubusercontent.com/davidhershey/f57d0b19563f...
2. The model is effectively trained to predict the next token based on the previous tokens in each of these examples, which has the side effect here of teaching it to make a draft pick based on the contents of a pack.
Nothing too fancy, just next word prediction more or less
- sdenton4 3y agoCurious how different the performance would be if instead of a 'Hall of Famer' we tell the bot that it is decently-good, but will be deactivated if it can't achieve human-level performance...