Immersive and mixed-reality environments for industrial operator training, augmented scenic performances, folk dance motion capture, and AR-based field inspection systems across energy and cultural heritage domains.
The Virtual & Augmented Reality group at NCA-UFMA bridges cutting-edge immersive technologies with practical applications in industrial safety, cultural preservation, and the performing arts.
Industrial Applications: The AGITO project delivered a 3D game-engine-based simulation platform for electrical system operators at CHESF, featuring immersive (head-mounted display), semi-immersive, and desktop modes with gamified scoring and ranking systems. A complementary panoramic image-based AR system overlays real-time SCADA data onto 360° photographs of substations, enabling remote inspection and teleoperation without physical presence.
Cultural & Artistic Applications: In collaboration with LabTecDrama (Laboratory of Dramatic Technologies), the group pioneered the Solos Maranhenses project — a system that digitizes movement from Maranhão folk dances using motion capture technology and re-integrates them into augmented scenic performances. The authoring tool maps virtual props onto a performer’s body without requiring programming knowledge or physical markers, presented at JIT 2022 in Lyon.
Heat Exchanger Management: The HTM system uses AR to guide field technicians through heat exchanger inspection, overlaying tube status maps onto the physical equipment via mobile devices.
CHESF / ANEEL P&D
VR and game-engine-based simulation platform for electrical system operators. Features immersive, semi-immersive, and desktop modes with gamified scoring, fault-scenario scripting, and 3D substations reconstructed from real CHESF installations.
CHESF
Panoramic image-based visualization system that overlays real-time SCADA equipment data onto 360° photographs of industrial environments, enabling remote inspection and teleoperation of electrical substations without physical presence.
LabTecDrama — Laboratory of Dramatic Technologies
Motion capture and augmented reality project that digitizes Maranhão folk dance movements and integrates them into augmented scenic performances. Features a marker-free, programming-free authoring tool for mapping virtual props to performer bodies.