Portrait of Francis Pelletier

Francis Pelletier

Developer, AI data infrastructure, Innovation, Development and Technologies

Publications

SnowGalileo: A Pre-trained Earth Observation Transformer for Daily, 100 m Fractional Snow Cover Mapping
Donovan J. M. Allum
Sebastian Roessler
Samip Shrestha
Zhibang Lv
J Truckenbrodt
Gabriele Schwaizer
Thomas Nägler
John W. Pomeroy
Christopher B. Marsh
Benoît Montpetit
Tobias Jonas
A.J. Dietz
Celia A. Baumhoer
Abstract. Mountain snow is an important component of the cryosphere that directly affects downstream livelihoods. Accurate monitoring of mou… (see more)ntain snow is crucial, yet remains challenging due to complex topography and frequent cloud cover. Although combining data from multiple Earth Observation (EO) satellites can improve spatial and temporal coverage, extracting Fractional Snow Cover (FSC) from sensors with different spatial and temporal resolutions remains difficult. AI-based Earth foundation models can process diverse sensor inputs and have been successfully applied to various remote sensing tasks; however, they often lack snow-specific design considerations. This paper presents SnowGalileo, a pre-trained transformer model designed to integrate EO data to map snow-covered areas. We evaluated SnowGalileo's potential for generating daily, gap-free FSC maps at 100m resolution in mountainous regions. SnowGalileo combines one week of satellite time-series data from multiple sensors, including Sentinel-1, Sentinel-2, Landsat, Sentinel-3, MODIS, and VIIRS, with topographic, land cover, and meteorological information to predict FSC for a given day. The model was pre-trained using masked autoencoding and fine-tuned using labeled data from various mountain ranges across the Northern Hemisphere. In addition to clear-sky conditions, SnowGalileo is evaluated under a wider variety of conditions than was previously possible, including cloud cover and lack of high-resolution (~10–30 m) satellite imagery. For the Canadian Rockies and the Swiss Alps, respectively, SnowGalileo achieves RMSEs of 0.099 and 0.124 on clear days, 0.144 and 0.209 on cloudy days, 0.185 and 0.262 on days without high-resolution imagery, and 0.200 and 0.299 on cloudy days without high-resolution imagery. SnowGalileo also consistently outperforms random forests, support vector regressors, and multi-layer perceptrons. While the current product is a proof of concept that has undergone limited validation across geographic regions, operates on 1km × 1km tiles rather than full maps, and has restricted capabilities in challenging conditions, this approach could ultimately enable the continuous, gap-free operational generation of FSC time series for mountain regions worldwide.
Benchmarking the geographic generalization of deep learning models for precipitation downscaling
Luca Schmidt
Nicole Ludwig
Matthew Chantry
Christian Lessig
Earth System Models (ESM) are our main tool for projecting the impacts of climate change. However, running these models at sufficient resolu… (see more)tion for local-scale risk-assessments is not computationally feasible. Deep learning-based super-resolution models offer a promising solution to downscale ESM outputs to higher resolutions by learning from data. Yet, due to regional variations in climatic processes, these models typically require retraining for each geographical area–demanding high-resolution observational data, which is unevenly available across the globe. This highlights the need to assess how well these models generalize across geographic regions. To address this, we introduce RainShift, a dataset and benchmark for evaluating downscaling under geographic distribution shifts. We evaluate state-of-the-art downscaling approaches including GANs and diffusion models in generalizing across data gaps between the Global North and Global South. Our findings reveal substantial performance drops in out-of-distribution regions, depending on model and geographic area. While expanding the training domain generally improves generalization, it is insufficient to overcome shifts between geographically distinct regions. We show that addressing these shifts through, for example, domain adaptation can improve spatial generalization. Our work advances the global applicability of downscaling methods and represents a step toward reducing inequities in access to high-resolution climate information.
Causal Climate Emulation with Bayesian Filtering
Traditional models of climate change use complex systems of coupled equations to simulate physical processes across the Earth system. These … (see more)simulations are highly computationally expensive, limiting our predictions of climate change and analyses of its causes and effects. Machine learning has the potential to quickly emulate data from climate models, but current approaches are not able to incorporate physically-based causal relationships. Here, we develop an interpretable climate model emulator based on causal representation learning. We derive a novel approach including a Bayesian filter for stable long-term autoregressive emulation. We demonstrate that our emulator learns accurate climate dynamics, and we show the importance of each one of its components on a realistic synthetic dataset and data from two widely deployed climate models.
On Global Applicability and Location Transferability of Generative Deep Learning Models for Precipitation Downscaling
Christian Lessig
Matthew Chantry
RainShift: A Benchmark for Precipitation Downscaling Across Geographies
Luca Schmidt
Nicole Ludwig
Matthew Chantry
Christian Lessig
Earth System Models (ESM) are our main tool for projecting the impacts of climate change. However, running these models at sufficient resolu… (see more)tion for local-scale risk-assessments is not computationally feasible. Deep learning-based super-resolution models offer a promising solution to downscale ESM outputs to higher resolutions by learning from data. Yet, due to regional variations in climatic processes, these models typically require retraining for each geographical area-demanding high-resolution observational data, which is unevenly available across the globe. This highlights the need to assess how well these models generalize across geographic regions. To address this, we introduce RainShift, a dataset and benchmark for evaluating downscaling under geographic distribution shifts. We evaluate state-of-the-art downscaling approaches including GANs and diffusion models in generalizing across data gaps between the Global North and Global South. Our findings reveal substantial performance drops in out-of-distribution regions, depending on model and geographic area. While expanding the training domain generally improves generalization, it is insufficient to overcome shifts between geographically distinct regions. We show that addressing these shifts through, for example, data alignment can improve spatial generalization. Our work advances the global applicability of downscaling methods and represents a step toward reducing inequities in access to high-resolution climate information.