DGoettlich

6 ms·

1. 1.▲
   by DGoettlich 9mo ago

   data is 100% public domain.
2. 2.▲
   by DGoettlich 9mo ago

   very interesting observation!
3. 3.▲
   by DGoettlich 9mo ago

   well put.
4. 4.▲
   by DGoettlich 9mo ago

   thanks. i think this just took on a weird dynamic. we never said we'd lock the model away. not sure how this impression seems to have emerged for some. that aside, it was an announcement of a release, not a release. the main purpose wa
5. 5.▲
   by DGoettlich 9mo ago

   i think we (whole section) are just talking past each other - we never said we'll lock it away. it was an announcement of a release, not a release. main purpose for us was getting feedback on the methodological aspects, as we clearly s
6. 6.▲
   by DGoettlich 9mo ago

   Thanks for the comment. Could you elaborate on what you find iffy about our approach? I'm sure we can improve!
7. 7.▲
   by DGoettlich 9mo ago

   valid point. its more of a stepping stone towards larger models. we're figuring out what the best way to do this is before scaling up.
8. 8.▲
   by DGoettlich 9mo ago

   we're on the same page.
9. 9.▲
   by DGoettlich 9mo ago

   exactly
10. 10.▲
    by DGoettlich 9mo ago

    Also one of our fears. What we've done so far is to drop docs where the datasource was doubtful about the date of publication, if there are multiple possible dates we take the latest to be conservative. During training, we validate tha
11. 11.▲
    by DGoettlich 9mo ago

    what makes you think we trained on only a few gigabytes? https://github.com/DGoettlich/history-llms/blob/main/ranke-4...
12. 12.▲
    by DGoettlich 9mo ago

    fully understand you. we'd like to provide access but also guard against misrepresentations of our projects goals by pointing to e.g. racist generations. if you have thoughts on how we should do that, perhaps you could reach out at his
13. 13.▲
    by DGoettlich 9mo ago

    understand your frustration. i trust you also understand the models have some dark corners that someone could use to misrepresent the goals of our project. if you have ideas on how we could make the models more broadly accessible while avoi
14. 14.▲
    by DGoettlich 9mo ago

    thanks. we'll be more precise in the future. ultimately, we took whatever we could get our hands on, that includes newspapers, periodicals, books. its multilingual (including italian, french, spanish etc) though majority is english.
15. 15.▲
    by DGoettlich 9mo ago

    that is simply how we display the questions, its not what the model sees - we show the chat-template in the SFT section of the prerelease notes https://github.com/DGoettlich/history-llms/blob/main/ranke-4
16. 16.▲
    by DGoettlich 9mo ago

    we were considering doing that but ultimately it struck us as too sensitive wrt the exact in context examples, their ordering etc.
17. 17.▲
    by DGoettlich 9mo ago

    We tell it that its a person (no gender) living in <cutoff>: we show the chat template in the prerelease notes https://github.com/DGoettlich/history-llms/blob/main/ranke-4...