Building Large Spatial Models

This piece was adapted by AI from an abandoned part of a paper revision about an autonomous geographic information system (GIS) agent. I think it is interesting, so I put it here.

What is a Large Spatial Model?

Large Language Models (LLMs) learn patterns in human language and generate text by predicting what comes next. They are trained on huge amounts of text and sometimes images or videos.

Can we do something similar in GIS (Geographic Information Science)? In geography, nearby places are more connected than distant ones, similar to how words in a sentence relate to each other. The idea is to break down complex geographic patterns into smaller, simpler parts (like tokens in language) and train a model to predict spatial and temporal patterns.

But geographic data is more complicated than text. It comes in many forms (maps, satellite images, networks, and more) and varies by location and scale. Data gaps are also common. While there are models built for specific tasks (e.g., satellite image analysis), a general model for all geographic data, like an LLM for language, hasn’t been fully developed yet.

Simply put, a Large Spatial Model (LSM) is like a multi-, hyper-, or ultra-modal LLM for geospatial science. It would handle many types of geographic data (images, maps, networks, text) and learn patterns across space and time to support a wide range of applications, from environmental monitoring to urban planning.

Geospatial embedding

A key challenge is how to represent geographic data in a way the model can process. This is called geospatial embedding. In language models, the basic unit is a token. For geographic data, it’s more complex.

Some researchers use graphs to represent connections between places based on data like human movement or environmental factors. However, geography isn’t just static connections; many phenomena (like traffic or weather) change over time. Current models often miss this temporal aspect, so more work is needed to capture both space and time in these embeddings.

Challenges to building Large Spatial Models

Training large models requires enormous computing power. GIS researchers often have fewer resources than those working on LLMs, so they may need to focus on specific types of big geospatial data, like satellite images or mobility data.

There are also concerns about privacy and data security, especially when dealing with sensitive location data. Cross-disciplinary collaboration will be key to building responsible and secure LSMs.

In short, there is big potential in building Large Spatial Models, but also major technical and ethical challenges ahead.

Note: the picture was generated by Gemini 2.0 Flash.