Online System
Partner Band
CANN
Agency Partnership
Social Inclusion
Music accessible for everyone
Together with agency WMcCANN, we built an online system that recognized when people showed their hands to the camera.
The system automatically transformed the Melim music video into a Brazilian Sign Language (LIBRAS) version, making music accessible for all.
The system was hosted on the Chevrolet website, available for access at any time.
Solutions developed
- Playful experience
- Social inclusion
- Connection between technology and music
- Engagement with the hearing-impaired audience
Project Details
Project highlights
How the experience was built
Hand Recognition
Computer vision system that detected hand gestures in real time to trigger the sign language translation.
Sign Language Video
Automatic transformation of the Melim music video into a version with full LIBRAS (Brazilian Sign Language) translation.
Social Inclusion
Chevrolet's concrete first step toward making entertainment accessible for people with hearing impairments.
Always Online
System hosted on the Chevrolet website, ensuring continuous access even after the event.
Innovative Technology
Integration of gesture recognition AI with real-time video processing.
Social Impact
Action that generated positive repercussion and showed Chevrolet's commitment to diversity and inclusion.
Chevrolet Hands Talk
What was Chevrolet Hands Talk?
An online system created by XR Studio with the agency WMcCANN for Chevrolet. When people showed their hands, the Melim band music video automatically switched to a Brazilian Sign Language (Libras) version.
How did the system recognize hands?
A computer vision system detected hand gestures in real time and triggered the version of the video with full Brazilian Sign Language translation.
Where was the system available?
On Chevrolet's website, accessible at any time, including after the campaign.
Why did the campaign matter?
Besides being a playful experience, it included deaf and hard-of-hearing audiences and made Melim's music accessible to everyone.
Next project
Let's create something
amazing together?
Tell us your challenge. We'll create the right activation for your brand.
We respond within 2 hours on business days
From this case to your next project
Discover the expertise behind this project and other work by XR Studio.
Solutions: 360° virtual tours · Virtual reality training · Virtual reality content · Interactive games for brands · AR or VR for events