Earth AI: Unlocking Geospatial Insights with Foundation Models and Cross-Modal Reasoning

Understanding signals from our planet and reasoning about their effect on our livelihoods has inspired human curiosity and innovation for millennia, from the earliest origins of folklore as a guide to natural wisdom, to the first applications of computer science for weather forecasting [lynch2008origins].

Decades of siloed geospatial data from satellites [donlon2012global, drusch2012sentinel], sensors [gorelick2017google, hersbach2020era5, munoz2021era5], and demographic records [DataCommons2025, DataCommons2025b] have posed a significant challenge to cross-domain analysis. To address this, the field of Geospatial AI (GeoAI) [iyer2025harnessing] has evolved from specialized models to general-purpose Foundation Models for Earth Observation [zhu2024foundationsearthclimatefoundation]. This shift, driven by large-scale datasets [jakubik2023foundation, wang2023skyscript] and benchmarks [mai2024opportunities], has culminated in agentic systems where Large Language Models (LLMs) reason over geospatial data, tested by new frameworks [kao2025towards] and reasoning benchmarks [yerramilli2025geochain, dihan2025mapeval].

Our work builds on these foundations to propose a new paradigm for planetary analysis. We introduce “Earth AI”, an interoperable family of geospatial AI models orchestrated by a customizable geospatial reasoning agent to create a holistic, multi-modal view of the Earth. Using Foundation Models (FMs) and LLM based reasoning, we build generalizable systems that surpass the limitations of single-purpose models and are capable of generating novel and actionable insights across a wide spectrum of planetary questions (see Figure 1 for an overview).

Our approach leverages three categories of Earth data: Imagery, Population and Environment. For each category, we developed novel, foundation Earth AI Models that demonstrate state of the art performance in benchmark tasks.

Imagery incorporates satellite, aerial and ground level imagery, sensor observations and related models [gorelick2017google] of the planet, including mapping of urban and agricultural landscapes [sirko2021continentalscalebuildingdetectionhigh, sirko2024highresolutionbuildingroaddetection, goroshin2023estimatingresidentialsolarpotential, dua2024agriculturallandscapeunderstandingcountryscale], classifying global land cover [brown2022dynamic], discovering temporal urban patterns [deng2025visualchroniclesusingmultimodal], producing multi-source compact embeddings [brown2025alphaearth] and the Remote Sensing Foundations vision backbones and multimodal models.

Population encompasses observation and analysis of humans and their impact on the earth, including maps and data about the built environment [weiss2020global], simulation and optimization of mobility patterns and transportation systems (e.g., traffic, migration) [aktay2020googlecovid19communitymobility, cook2025short, zhang2024traffic, choudhury2024towards, haddad2024quantitative], demographic and socioeconomic patterns [DataCommons2025] public health and vectors of disease transmission [wellenius2021impacts] and our Population Dynamics Foundations integrating human behavior and location [agarwal2024general].

Environment relates to spatiotemporal signals capturing dynamics of the Earth, including observations and models of weather, air quality, and climate [agrawal2025operationaldeeplearningsatellitebased, lam2023learning, kochkov2024neural, price2025probabilistic, google2025weather, google2025airquality], forecasts and tracking of natural disasters, such as cyclones [alet2025skillful], floods [nearing2024global], and wildfires [matias2021realtime], and maps of habitat loss and its underlying drivers [sims2023global].

To address real-world, multimodal challenges, we orchestrate these individual Earth AI Models with a Gemini-powered Geospatial Reasoning agent. By uniting natural language interactions and model connectivity across multiple domains that are usually analyzed separately, we expand the ability for non-expert users to analyze important questions without needing to download intermediate elements of answers and join or cross-reference results manually. This paradigm greatly expands the range of users to include anyone who can formulate a well-structured question and assess the resulting response. In this way, Earth AI allows for holistic, multi-faceted analysis and insight generation at a scale that was previously intractable. We demonstrate the power of this approach using a new benchmark of complex, real-world crisis response scenarios, showing how the synthesis of diverse data sources can unlock critical and time-sensitive insights.

The key findings from our evaluation of the Earth AI approach are summarized below:

• •

  State-of-the-Art Earth AI Models: We demonstrate that our Remote Sensing Foundations achieve state-of-the-art (SOTA) performance on tasks such as open-vocabulary object detection and zero-shot cross-modal retrieval. Concurrently, our Population Dynamics Foundations has been independently validated to improve real-world retail and public health applications, and has been extended to provide temporal embeddings at a monthly granularity.

• •

  Leading-edge Predictive Power Through Model Synergy: We provide strong evidence that the integration of models from different modalities yields superior predictive capabilities. By combining signals from our Imagery, Population and Environment models and datasets, we achieve higher predictive accuracy on real-world classification and forecasting tasks versus a single modality analysis.

• •

  Complex Problem-Solving via Agentic Reasoning: We show that the Gemini-powered reasoning agent can effectively deconstruct complex geospatial queries, select the appropriate models and tools in sequence, present transparent reasoning, and synthesize results into a coherent answer, demonstrating a robust capability to automate and scale complex analysis and insight generation across a number of domains, for example, identifying geographic regions with elevated short-term flood risk and high social vulnerability.

We summarize the capabilities of Earth AI in this section. First, we introduce the core foundation Earth AI Models trained on specialized geospatial datasets. Next, we demonstrate how these models can be combined to create powerful predictive applications by leveraging their synergistic strengths. Finally, we describe an approach to orchestrating all of these components to solve complex, multi-step queries using agentic Geospatial Reasoning.

In this section, we present a comprehensive evaluation of the Earth AI capabilities. We first validate the performance of our new foundation models for Imagery and Population individually, demonstrating state-of-the-art results on established benchmarks. We then show the synergistic power of combining these models for complex predictive tasks. Finally, we evaluate the capabilities of our Geospatial Reasoning Agent on a new benchmark of real-world analytical and crisis-response queries.