Mar, 2026
Conference Paper
OReole-FM: successes and challenges toward billion-parameter foundation models for high-resolution satellite imagery
While the pretraining of Foundation Models (FMs) for remote sensing (RS) imagery is on the rise, models remain restricted to a few hundred million parameters. Scaling models to billions of parameters has been shown to yield unprecedented benefits including emergent abilities, but requires data scaling and computing resources typically not available outside industry R&D lab…