jzsfg

6 ms·

1. 1.▲
   by jzsfg 2mo ago

   Thanks!
2. 2.▲
   by jzsfg 2mo ago

   Not yet in its current state. Right now, this is purely a pre-trained base model. It has learned the statistical distribution and vocabulary from seismology research papers, but it only knows how to predict the next token. Without Supervise
3. 3.▲
   I trained a 113M-parameter earthquake LLM from absolute scratch(github.com)

   12 points by jzsfg 2mo ago|5 comments
4. 4.▲
   by jzsfg 2mo ago

   Hi HN, I am a geophysics researcher and PI making a transition into the ML/AI space. Over the past year, I noticed that while many students and researchers use LLMs, the actual pretraining lifecycle remains a black box to them. Most tu