6 ms·
This simply is not true! NASA and IBM need to do further literature review and rely less on press releases. There are larger foundation models for geospatial i
by ritwikgupta 3y ago
This simply is not true! NASA and IBM need to do further literature review and rely less on press releases.
There are larger foundation models for geospatial imagery available. Our pre-training method, Scale-MAE [0], has 323M parameters, makes encoders robust to changes in satellite imagery resolution, and is therefore trained on satellite imagery of all resolutions. Work out of SI Analytics [1] presents a 2.4B parameter transformers for satellite imagery.
[0] https://arxiv.org/abs/2212.14532 https://arxiv.org/abs/2212.14532
[1] https://arxiv.org/abs/2304.05215 https://arxiv.org/abs/2304.05215
- deleted 3y ago[deleted]
- jafo1989 3y agoI'm interested. Are your models open sourced like the IBM model, and are they easily accessible on HuggingFace?
- ritwikgupta 3y agoThey are open sourced (code and weights) [0], but not accessible on HuggingFace. [0] https://ai-climate.berkeley.edu/scale-mae-website/ https://ai-climate.berkeley.edu/scale-mae-website/
- jafo1989 3y agoYou might want to think about adding them to HuggingFace, and making them HuggingFace API compliant to lower the barrier to entry. The IBM offering is appealing not because it is "first" or the "best", but because it is accessible. A lot of institutions / enterprises (including my own) are able to leverage transformer models because HF has done so much to lower the barrier to entry with their hub, documentation (model cards) and API. How else would I have found your models but for an IBM press release?
- RosanaAnaDana 3y agoIf the models aren't available in a repo for download do they actually exist?