I am the controller now: MIT engineers have created a ‘second skin’ that could one day track whole bodies in VR

MIT engineers have developed a flexible sheet composed of optical fibers capable of digitally reconstructing its own shape as it bends and folds. This breakthrough technology could revolutionize motion capture for virtual reality and gaming applications. Rather than requiring bulky traditional motion capture suits, the fiber-based system could potentially be fashioned into a garment that accurately tracks real-world body movements and translates them into digital VR environments.

The innovation represents a significant advancement over current motion capture technology used in film and game production. While existing solutions require restrictive suits and external tracking systems, this optical fiber “second skin” could offer greater flexibility and comfort for extended wear. The technology’s ability to self-reconstruct its shape makes it uniquely suited for tracking complex body movements and gestures.

The implications extend beyond traditional gaming into emerging platforms like VR experiences and virtual content creation. Content creators and Vtubers could benefit from improved full-body tracking without the constraints of current motion capture systems. According to MIT News, the research team believes this technology could eventually enable seamless full-body motion tracking for both entertainment and potential applications in other fields.

Sources