satellite-world-reconstruction technique sourced
ML reconstruction of the planet from aerial imagery
Machine learning classifies buildings, vegetation, and terrain in satellite and aerial imagery and procedural rules rebuild them as 3D scenery, which Microsoft Flight Simulator streams for the whole Earth.
mechanism
Models trained on labeled imagery detect buildings, trees, and land cover in satellite and aerial imagery and map data and extrapolate approximate geometry; offline procedural generation then builds and dresses the buildings and places vegetation, while selected cities use photogrammetry meshes. The reconstruction runs offline in the cloud, and the result is streamed to players on demand as they fly, with procedural filling where imagery is poor.
limitations
- Accuracy is bounded by imagery quality; blurred or pixelated areas fall back to procedural fill.
- Requires cloud streaming of petabyte-scale data and a licensed imagery source.
- Reconstructed buildings are generic from inferred class and height, not modeled individually, except in photogrammetry cities.
relations
5 stored edgesEmbodied skill control
Recognizable real buildings and landmarks across the planet make visual navigation by reference to the ground practicable anywhere, extending hand-flying practice beyond hand-modeled airports and cities.
Procedural terrain
The world is reconstructed from real imagery instead of generated from a seed and noise; the player-facing role of an explorable map is unchanged, but its content is the real planet, with procedural filling only where imagery is missing.
Real-world data feeds
Learned classification of satellite imagery turns real-world map data into simulated scenery at planetary scale (Microsoft Flight Simulator).
claims
3 with sourcesMicrosoft Flight Simulator (2020) used Blackshark.ai's AI on Azure to generate 3D buildings, trees, and terrain from Bing Maps data and photogrammetry, covering about 1.5 billion buildings and 2 trillion trees from over two petabytes of streamed map data.
Blackshark.ai describes its products as turning satellite and aerial imagery into structured models of terrain, buildings, and infrastructure.
Microsoft Flight Simulator 2024 carries over the satellite-derived scenery systems of the 2020 game.