A Smart City Digital Twin (SCDT) for disaster management is only as powerful and reliable as the data that fuels it. For the PANTHEON project, creating a realistic, predictive, and effective virtual replica of Athens and Vienna requires managing a continuous and complex flow of information from a multitude of sources.

The entire technical framework for this process is formally defined in our latest project report, Deliverable 4.1: “Integrated Data Model for the SCDT.”

This document serves as the technical blueprint for the PANTHEON data pipeline. It details the complete data lifecycle—from the moment information is captured by a sensor to the second it becomes a high-quality, actionable insight ready for a complex simulation.

This deliverable is highly technical, so to make its core concepts more accessible, we have broken them down into a 4-part blog series. This series will walk you through the PANTHEON data engine, from its foundational architecture to its specific technical components.

Explore the series:

• Blog Post 1: The Data Foundation of PANTHEON’s Digital Twin An overview of the SCDT’s data-centric architecture and the primary goals of our data integration strategy.
• Blog Post 2: Harvesting Big Data for Disaster Resilience – PANTHEON’s Sources A deep dive into the four main categories of data we harvest—in-situ, aerial, satellite, and third-party—and how they are used in our pilot disaster scenarios.
• Blog Post 3: From Raw Data to Actionable Insights – PANTHEON’s Preprocessing Pipeline A detailed look at the critical preprocessing component that cleans, formats, and standardizes raw data to ensure quality and consistency for our simulation engines.
• Blog Post 4: The Technical Backbone: PANTHEON’s Protocols, Storage, and Interoperability A final look at the “engine room” of the SCDT, explaining the technologies we use for data transfer (like REST and Kafka), storage (MinIO), and ensuring all components can communicate seamlessly.

We invite you to explore this series to gain a deeper understanding of the complex data engine that makes the PANTHEON SCDT possible.

The PANTHEON project has received funding from the European Union’s Horizon Europe programme under Grant Agreement N°101074008.