9 ms·
UAE's IFM / LLM360 MO is indeed "fully open source" LLMs: https://www.llm360.ai/reports/LLM360-Towards-Fully-Transparent-Open-Source-LLMs.pdf https://www.llm36
by ignoramous 13d ago
UAE's IFM / LLM360 MO is indeed "fully open source" LLMs: https://www.llm360.ai/reports/LLM360-Towards-Fully-Transparent-Open-Source-LLMs.pdf https://www.llm360.ai/reports/LLM360-Towards-Fully-Transpare...
- yorwba 12d agoThey do not appear to have published the training data yet, but if they do it like Olmo https://huggingface.co/datasets/allenai/dolma3_pool https://huggingface.co/datasets/allenai/dolma3_pool you get a license to the database, but not to its content, which they cannot license to you because it was scraped from the internet. E.g. have a look at the preamble of the ODC-By license https://opendatacommons.org/licenses/by/1-0/ https://opendatacommons.org/licenses/by/1-0/ which makes this distinction.