Humanoid Drone Swarm × Real-time Motion Capture: 'Giants Dancing in the Sky'
NILL Co., Ltd. has launched the 'Swarm Synchronization Project,' which involves thousands of drones flying in human formations, synchronized in real-time with the movements of a ground performer. This is a world-first attempt to respond to human movements in real-time, unlike pre-programmed drone shows, creating an experience of glowing giants dancing in the night sky.
📋 Article Processing Timeline
- 📰 Published: April 1, 2026 at 18:00
- 🔍 Collected: April 1, 2026 at 09:36
- 🤖 AI Analyzed: April 22, 2026 at 05:00 (499h 24m after Collected)
Our company supports April Dream, which aims to make April 1st a day to share dreams. This press release is the dream of 'NILL Co., Ltd.'
NILL Co., Ltd. (Headquarters: Tokyo, hereinafter 'NILL') has launched the 'Swarm Synchronization Project,' which involves thousands of drones flying in human formations, synchronized in real-time with the movements of a ground performer.
## Giants Dance in the Night Sky
In recent years, drone shows have achieved formations of tens of thousands of drones in various parts of the world, greatly expanding the possibilities of the night sky as a canvas. However, the mainstream method of production has been to replay pre-programmed trajectories, and 'drone swarms that respond to human movements in real-time' have not yet been realized globally due to challenges such as collision avoidance and latency control.
The Swarm Synchronization Project steps into this 'never-before-done' domain.
Real-time full-body motion capture of a single ground performer is instantly mapped to thousands of drones in the air. The drones form a formation along the human skeleton; if the performer raises an arm, the drones' 'arm' rises, and if they dance, the drones' 'body' dances—a glowing giant, tens of meters tall, appears in the night sky, replicating human movements in real-time.
## NILL's Motion Capture Technology Connects Sky and Ground
In this project, NILL leads the direction of motion capture and the technological development of real-time motion transmission.
As a creative development studio specializing in VR/MR content development and virtual live development, NILL has extensive experience in real-time 3D technology utilizing Unity and Unreal Engine. Technologies such as motion capture direction for music videos and technical supervision for interactive content, which 'convert human movements into digital data and reflect them in real-time visuals,' are NILL's core strengths.
In the **Swarm Synchronization Project**, this technology is **extended from 'reflection in visuals' to 'control of physical drone swarms.'** A system is currently under development to transmit performer movements to drone swarms with low latency, allowing thousands of drones to safely and smoothly trace human movements.
## Drone Swarms = 3D Point Cloud Data to End 'One-Night-Only' Performances
Drone shows are, by nature, 'one-night-only' performances. The moment a giant of light drawn in the night sky synchronizes and dances with a human was, until now, only for the audience present at the venue.
In this project, thousands of drones dancing in the night sky are treated as 3D point cloud data in 3D space. The position coordinates, luminescence color, and trajectory of each drone are recorded in real-time, and the formation data itself, generated from the performer's movements, is saved as a 3D asset of 3D point cloud data.
The light trails, the three-dimensional formation of the drone swarm—the entire spatial experience that cannot be conveyed by 2D video is completely recorded in 3D, and the performance itself is assetized as intellectual property (IP).
By treating the drone swarm projected into the sky as 'point cloud data' in 3D space and archiving the 'formation trajectory generated in real-time from the performer's movements' as 3D data (IP-ization)—this is a new drone show that goes beyond the scope of video recording.
NILL Co., Ltd. (Headquarters: Tokyo, hereinafter 'NILL') has launched the 'Swarm Synchronization Project,' which involves thousands of drones flying in human formations, synchronized in real-time with the movements of a ground performer.
## Giants Dance in the Night Sky
In recent years, drone shows have achieved formations of tens of thousands of drones in various parts of the world, greatly expanding the possibilities of the night sky as a canvas. However, the mainstream method of production has been to replay pre-programmed trajectories, and 'drone swarms that respond to human movements in real-time' have not yet been realized globally due to challenges such as collision avoidance and latency control.
The Swarm Synchronization Project steps into this 'never-before-done' domain.
Real-time full-body motion capture of a single ground performer is instantly mapped to thousands of drones in the air. The drones form a formation along the human skeleton; if the performer raises an arm, the drones' 'arm' rises, and if they dance, the drones' 'body' dances—a glowing giant, tens of meters tall, appears in the night sky, replicating human movements in real-time.
## NILL's Motion Capture Technology Connects Sky and Ground
In this project, NILL leads the direction of motion capture and the technological development of real-time motion transmission.
As a creative development studio specializing in VR/MR content development and virtual live development, NILL has extensive experience in real-time 3D technology utilizing Unity and Unreal Engine. Technologies such as motion capture direction for music videos and technical supervision for interactive content, which 'convert human movements into digital data and reflect them in real-time visuals,' are NILL's core strengths.
In the **Swarm Synchronization Project**, this technology is **extended from 'reflection in visuals' to 'control of physical drone swarms.'** A system is currently under development to transmit performer movements to drone swarms with low latency, allowing thousands of drones to safely and smoothly trace human movements.
## Drone Swarms = 3D Point Cloud Data to End 'One-Night-Only' Performances
Drone shows are, by nature, 'one-night-only' performances. The moment a giant of light drawn in the night sky synchronizes and dances with a human was, until now, only for the audience present at the venue.
In this project, thousands of drones dancing in the night sky are treated as 3D point cloud data in 3D space. The position coordinates, luminescence color, and trajectory of each drone are recorded in real-time, and the formation data itself, generated from the performer's movements, is saved as a 3D asset of 3D point cloud data.
The light trails, the three-dimensional formation of the drone swarm—the entire spatial experience that cannot be conveyed by 2D video is completely recorded in 3D, and the performance itself is assetized as intellectual property (IP).
By treating the drone swarm projected into the sky as 'point cloud data' in 3D space and archiving the 'formation trajectory generated in real-time from the performer's movements' as 3D data (IP-ization)—this is a new drone show that goes beyond the scope of video recording.