Paper details

Title: Generalizability of Foundation Models: A Case Study on Cocoa Mapping Across Countries Using Sparse Labels

Authors: Ruslan Mammadov , Paul Walther , Julius Fricke , Martin Werner

Abstract: Obtained from CrossRef

Abstract. Remote Sensing Foundation Models (RSFMs), which are deep neural networks pre-trained on large-scale Earth observation datasets, have become increasingly popular in remote sensing in recent years. Meanwhile, regulatory changes such as the European Union’s Deforestation Regulation require a mapping of agricultural activities worldwide to ensure deforestation-free supply chains. In this context, we conduct a case study on the application of Foundation Models (FMs), such as CROMA and AlphaEarth, for the mapping of cocoa production in agroforestry systems in western Africa. In our study we show, that the pre-training of FMs does not improve the performance in data-rich conditions and that the pre-training only has limited advantage in zero-shot transfer applications. Still, the FMs show a higher sensitivity towards distribution shifts when fine-tuned in new environments. Based on our experiments, we comprehend insights for the selection and application of traditional convolutional neural network-based models and FMs in sparse-label remote sensing tasks.  Reproducibility review available at: https://doi.org/10.17605/OSF.IO/YH8F6

OpenAlex: https://openalex.org/W7164194149

CODECHECK details

Certificate identifier: 2026-008

Codechecker name: Joseph Shingleton

Time of check: 2026-03-31 12:00:00

Repository: https://github.com/reproducible-agile/reviews-2026|reports/013

Full certificate: https://doi.org/10.17605/OSF.IO/YH8F6

Type: conference

Venue: AGILEGIS

Summary:

Partial reproduction of the foundation-model cocoa-mapping study. The provided code and data allowed the workflow to be run, though some files in the repository were differentiated only by path rather than filename, complicating the reproduction.

Cite this certificate: Citation metadata retrieved from data.crosscite.org

Loading citation…
Copied!

View certificate data as JSON

https://codecheck.org.uk/ | codecheckers | Zenodo Community

© team@cdchck.science | Published under CC BY-SA 4.0

DOI of Zenodo Deposit

CODECHECK is a process for independent execution of computations underlying scholarly research articles.