Context: https://www.dokodemo.xyz/projects-p2/sony-xyn-3dgs-virtual-production-workflow-test
Testing out Sony’s new XYN Spatial Scan Navi tool to create 3DGS aimed at virtual production.
https://xyn.sony.net/en/products/xyn_spatial_scan_navi
The app guides the user through the shooting procedures with an AR overlay. The standard shooting layout was used in the first part of the video (the wide entrance to Honen-in) and the narrow/deep shooting options were used for the 2 other parts where space was constrained.
The ability to upload images as you go and to do all the processing online massively speeds up workflow and throughput.
Color grading seems to be designed to be handled at the final rendering point (in Unreal Engine).
Got some great results on my first attempt on location with very little clean up needed afterwards (I’ve only culled a few massive splats that seemed to cause overdraw perf issues). Mostly running at 60fps on M5 Max, perf dips with large field of view.
Particularly impressive with how it captures fine details and textures like little leaves, twigs, gravel, stone etc.
Workflow:
- Sony A7CII 14mm + mounted iPhone running XYN Navi App
- Processing on Sony Spatial Scan cloud service
- Minor cleanup and real-time rendering in Unity using a customized version of Aras P. et.al Gaussian Splatting plug-in.
Shot at Honen-in temple in Kyoto in July 2026.
4K 60fps video on YouTube: https://youtu.be/T9b0vd8IqOc