Portrait of Arthur Ouaknine

Arthur Ouaknine

Collaborating Alumni - McGill University
Supervisor
Co-supervisor
Research Topics
Computer Vision
Deep Learning
Multimodal Learning

Publications

SelvaBox: A high‑resolution dataset for tropical tree crown detection
Mélisande Teng
Thomas R. Walla
Christopher Pal
Detecting individual tree crowns in tropical forests is essential to study these complex and crucial ecosystems impacted by human interventi… (see more)ons and climate change. However, tropical crowns vary widely in size, structure, and pattern and are largely overlapping and intertwined, requiring advanced remote sensing methods applied to high-resolution imagery. Despite growing interest in tropical tree crown detection, annotated datasets remain scarce, hindering robust model development. We introduce SelvaBox, the largest open‑access dataset for tropical tree crown detection in high-resolution drone imagery. It spans three countries and contains more than
SelvaMask: Segmenting Trees in Tropical Forests and Beyond
Helene Muller-Landau
Gonzalo Rivas-Torres
Tropical forests harbor most of the planet's tree biodiversity and are critical to global ecological balance. Canopy trees in particular pla… (see more)y a disproportionate role in carbon storage and functioning of these ecosystems. Studying canopy trees at scale requires accurate delineation of individual tree crowns, typically performed using high-resolution aerial imagery. Despite advances in transformer-based models for individual tree crown segmentation, performance remains low in most forests, especially tropical ones. To this end, we introduce SelvaMask, a new tropical dataset containing over 8,800 manually delineated tree crowns across three Neotropical forest sites in Panama, Brazil, and Ecuador. SelvaMask features comprehensive annotations, including an inter-annotator agreement evaluation, capturing the dense structure of tropical forests and highlighting the difficulty of the task. Leveraging this benchmark, we propose a modular detection-segmentation pipeline that adapts vision foundation models (VFMs), using domain-specific detection-prompter. Our approach reaches state-of-the-art performance, outperforming both zero-shot generalist models and fully supervised end-to-end methods in dense tropical forests. We validate these gains on external tropical and temperate datasets, demonstrating that SelvaMask serves as both a challenging benchmark and a key enabler for generalized forest monitoring. Our code and dataset will be released publicly.
MillionTrees: A global benchmark for tree detection across geography, sensor, and annotation geometry
Ben G. Weinstein
Josh Veitch-Michaelis
Matt J. Allen
Adison Altamirano
Sarah Anacleto
Rasmus Astrup
James Ball
Sara Beery
Stephanie Bohlman
John Brandt
Myriam Cloutier
Jessica Ertel
Zhengpeng Feng
Adnan Firoze
Julian Frey
Geoffrey A. Fricker
Dimitri Gominski
Sarah Graves … (see 39 more)
Stuart Grieve
Sander de Haas
Sebastian H. M. Hickman
Toby Jackson
Andrew Jansen
Teja Kattenborn
Taimur Khan
Ryoungseob Kwon
Kyaw Kyaw Htoo
Isabelle Lefebvre
Emily Rebecca Lines
Moritz Lucas
Alejandro Miranda
Blas Mola‐Yudego
Maurice Mugabowindekwe
Jaylen Nicholson
Masanori Onishi
Yusuke Onoda
Harry Jon Foord Owen
Camille C. Pawlak
Stefano Puliti
Md. Farhadur Rahman
David J. Russell
Oliver Schütte
Henry Senyondo
Yihang She
Ying Sun
Ryuichi Takeshige
Jonas Troles
Vicente Vasquez
Jonathan Ventura
Benjamin Wagner
Qinchuan Xin
Qiue Xu
Derek J. N. Young
Pedro Zamboni
Ethan P. White
Abstract Airborne tree monitoring using remotely sensed data, combined with the growth of computer vision models for object detection and se… (see more)gmentation, can facilitate broad scale assessment of tree health, ecology and ecosystem function. However, datasets for airborne tree detection have been largely limited to a single geography, resolution, or annotation approach, making it difficult to develop general models and benchmark their utility for broad applications. We compile existing and newly published annotation datasets to create a comprehensive dataset for training and evaluating airborne tree detection in RGB imagery. The MillionTrees dataset has over a million individual trees from a broad range of forest types, tree species, and geographic locations. In addition, it has six million weakly supervised annotations from a range of sources including airborne LiDAR and photogrammetry, arborist surveys, and simulated landscapes. An evaluation standard is provided to facilitate rapid model development. We benchmark several existing tree detection algorithms and demonstrate that while current open-source models do not generalize across the diverse datasets in the benchmark, training on MillionTrees improves both within-domain and out-of-domain performance. Held-out validation datasets using ground truth derived from terrestrial LiDAR paired with overhead RGB show that overfitting to test data is common and hyperparameter tuning is an underappreciated challenge towards a global zero shot tree detection method. We discuss the limitations of the currently available data for airborne RGB tree detection, how to create more robust evaluation data and the need for better understanding of the uncertainty and utility of tree detection from airborne remote sensing.
Towards Consistent Geospatial Representations: Aligning One Encoder to Many Foundation Models
Geospatial foundation models (GFMs) differ widely in pretraining objective, modality and resolution, and none leads across benchmarks. We as… (see more)k whether their representations are complementary, and whether a single encoder can inherit that complementarity. We introduce Pangaea-Latents, an extension of the Pangaea benchmark providing frozen embeddings of
A Blueprint for Integrated Climate Intelligence
Carlos Rodriguez-Pardo
Guido Ascenso
Cindy Giselle Azuero Pedraza
Marie‐Lou Bachèlery
Manuela Balzarolo
Sara Beery
Vitus Benson
Laure Berti‐Équille
Annalisa Bracco
Momme Momme Butenschön
Gustau Camps-Valls
Andrea Castelletti
Melissa Chapman
Ioana Colfescu
Italo Epicoco
Chaneil James
Konstantin Klemmer
Raphaela Kotsch
Dr Vipin Kumar
Christian Lessig … (see 10 more)
Amirpasha Mozaffari
S. Karthik Mukkavilli
Quentin Paletta
María Pérez‐Ortiz
Esther Rolf
Mary Sanford
Soheil Shayegh
Kasia Tokarksa
Massimo Tavoni
Climate information is advancing faster than the decision systems designed to use it. Emergency response operates on timescales of hours, wh… (see more)ereas societal adaptation unfolds over decades. Yet climate science, impact assessment and policy remain poorly integrated, limiting coherent action across timescales. We argue that artificial intelligence should be developed not only as a domain-specific tool, but as an integration layer linking fragmented physical, social and institutional systems. This Perspective outlines a blueprint for Integrated Climate Intelligence built on three pillars: fairness, which prioritizes vulnerability alongside data availability; speed, which reduces the latency between assessment and action; and robustness, which quantifies uncertainty under extrapolation and high-stakes decision-making. We further propose a Climate AI Trust Index as an evaluation framework for assessing whether climate AI systems are sufficiently rigorous, equitable and decision-relevant for operational use.
Estimating Individual Tree Height and Species from UAV Imagery
Accurate estimation of forest biomass, a major carbon sink, relies heavily on tree-level traits such as height and species. Unoccupied Aeria… (see more)l Vehicles (UAVs) capturing high-resolution imagery from a single RGB camera offer a cost-effective and scalable approach for mapping and measuring individual trees. We introduce BIRCH-Trees, the first benchmark for individual tree height and species estimation from tree-centered UAV images, spanning three datasets: temperate forests, tropical forests, and boreal plantations. We also present DINOvTree, a unified approach using a Vision Foundation Model (VFM) backbone with task-specific heads for simultaneous height and species prediction. Through extensive evaluations on BIRCH-Trees, we compare DINOvTree against commonly used vision methods, including VFMs, as well as biological allometric equations. We find that DINOvTree achieves top overall results with accurate height predictions and competitive classification accuracy while using only 54% to 58% of the parameters of the second-best approach.
Understanding Representation Gaps across Scales in Tropical Tree Species Classification from Drone Imagery
Sulagna Saha
Evan M. Gora
Adriane Esquivel Muelbert
Ian R. McGregor
César Gutiérrez
Vanessa E. Rubio
Accurate classification of tropical tree species from unoccupied aerial vehicle (UAV) imagery remains challenging due to high species divers… (see more)ity and strong visual similarity among species at typical image resolutions (centimeters per pixel). In contrast, models trained on close-up citizen science photographs captured with smartphones achieve strong plant species classification performance. Recent advances in UAV data acquisition now enable the collection of close-up images that are spatially registered with top-view aerial imagery and approach the level of visual detail found in smartphone photographs, with the trade-off that such high-resolution photos cannot be acquired for many trees. In this work, we evaluate the performance of existing methods using paired top-view and close-up UAV imagery collected in a species-rich tropical forest. Through fine-tuning experiments, we quantify the performance gap between vision foundation models and in-domain generalist plant recognition models across both image types (high-resolution close-up versus coarser-resolution top-view imagery). We show that classification performance is consistently higher on close-up images than on top-view aerial imagery, and that this performance gap widens for rare species. Finally, we propose that self-supervised representation alignment across these two spatial scales offers a promising approach for integrating fine-grained visual information into canopy-level species classification models based on top-view UAV imagery. Leveraging high-resolution close-up UAV imagery to enhance canopy-level species classification could substantially improve large-scale monitoring of tropical forest biodiversity.
Bringing SAM to new heights: Leveraging elevation data for tree crown segmentation from drone imagery
Information on trees at the individual level is crucial for monitoring forest ecosystems and planning forest management. Current monitoring … (see more)methods involve ground measurements, requiring extensive cost, time and labor. Advances in drone remote sensing and computer vision offer great potential for mapping individual trees from aerial imagery at broad-scale. Large pre-trained vision models, such as the Segment Anything Model (SAM), represent a particularly compelling choice given limited labeled data. In this work, we compare methods leveraging SAM for the task of automatic tree crown instance segmentation in high resolution drone imagery in three use cases: 1) boreal plantations, 2) temperate forests and 3) tropical forests. We also study the integration of elevation data into models, in the form of Digital Surface Model (DSM) information, which can readily be obtained at no additional cost from RGB drone imagery. We present BalSAM, a model leveraging SAM and DSM information, which shows potential over other methods, particularly in the context of plantations. We find that methods using SAM out-of-the-box do not outperform a custom Mask R-CNN, even with well-designed prompts. However, efficiently tuning SAM end-to-end and integrating DSM information are both promising avenues for tree crown instance segmentation models.
GreenHyperSpectra: A multi-source hyperspectral dataset for global vegetation trait prediction
Luke A. Brown
Phuong D. Dao
Kyle R. Kovach
Bing Lu
Daniel Mederer
Hannes Feilhauer
Teja Kattenborn
Plant traits such as leaf carbon content and leaf mass are essential variables in the study of biodiversity and climate change. However, con… (see more)ventional field sampling cannot feasibly cover trait variation at ecologically meaningful spatial scales. Machine learning represents a valuable solution for plant trait prediction across ecosystems, leveraging hyperspectral data from remote sensing. Nevertheless, trait prediction from hyperspectral data is challenged by label scarcity and substantial domain shifts (\eg across sensors, ecological distributions), requiring robust cross-domain methods. Here, we present GreenHyperSpectra, a pretraining dataset encompassing real-world cross-sensor and cross-ecosystem samples designed to benchmark trait prediction with semi- and self-supervised methods. We adopt an evaluation framework encompassing in-distribution and out-of-distribution scenarios. We successfully leverage GreenHyperSpectra to pretrain label-efficient multi-output regression models that outperform the state-of-the-art supervised baseline. Our empirical analyses demonstrate substantial improvements in learning spectral representations for trait prediction, establishing a comprehensive methodological framework to catalyze research at the intersection of representation learning and plant functional traits assessment. All code and data are available at: https://github.com/echerif18/HyspectraSSL.
Tree semantic segmentation from aerial image time series
Earth's forests play an important role in the fight against climate change, and are in turn negatively affected by it. Effective monitoring … (see more)of different tree species is essential to understanding and improving the health and biodiversity of forests. In this work, we address the challenge of tree species identification by performing semantic segmentation of trees using an aerial image dataset spanning over a year. We compare models trained on single images versus those trained on time series to assess the impact of tree phenology on segmentation performances. We also introduce a simple convolutional block for extracting spatio-temporal features from image time series, enabling the use of popular pretrained backbones and methods. We leverage the hierarchical structure of tree species taxonomy by incorporating a custom loss function that refines predictions at three levels: species, genus, and higher-level taxa. Our findings demonstrate the superiority of our methodology in exploiting the time series modality and confirm that enriching labels using taxonomic information improves the semantic segmentation performance.
FoMo: Multi-Modal, Multi-Scale and Multi-Task Remote Sensing Foundation Models for Forest Monitoring
Forests are vital to ecosystems, supporting biodiversity and essential services, but are rapidly changing due to land use and climate change… (see more). Understanding and mitigating negative effects requires parsing data on forests at global scale from a broad array of sensory modalities, and using them in diverse forest monitoring applications. Such diversity in data and applications can be effectively addressed through the development of a large, pre-trained foundation model that serves as a versatile base for various downstream tasks. However, remote sensing modalities, which are an excellent fit for several forest management tasks, are particularly challenging considering the variation in environmental conditions, object scales, image acquisition modes, spatio-temporal resolutions, etc. With that in mind, we present the first unified Forest Monitoring Benchmark (FoMo-Bench), carefully constructed to evaluate foundation models with such flexibility. FoMo-Bench consists of 15 diverse datasets encompassing satellite, aerial, and inventory data, covering a variety of geographical regions, and including multispectral, red-green-blue, synthetic aperture radar and LiDAR data with various temporal, spatial and spectral resolutions. FoMo-Bench includes multiple types of forest-monitoring tasks, spanning classification, segmentation, and object detection. To enhance task and geographic diversity in FoMo-Bench, we introduce TalloS, a global dataset combining satellite imagery with ground-based annotations for tree species classification across 1,000+ categories and hierarchical taxonomic levels. Finally, we propose FoMo-Net, a pre-training framework to develop foundation models with the capacity to process any combination of commonly used modalities and spectral bands in remote sensing.
Assessing SAM for Tree Crown Instance Segmentation from Drone Imagery