uCue: An Interactive Musical Interface to Enhance Formative Listening Experiences for Children with ASD

This technology is an interactive music system that lets children with ASD customize songs by controlling musical layers, logs their choices, and provides visual feedback and data analysis to support personalized music therapy and help clinicians and composers understand user preferences.

Technology

Music therapy has become a valuable intervention for children with Autism Spectrum Disorder (ASD), promoting emotional expression, sensory regulation, and social interaction. Given their unique auditory sensitivities, personalized music experiences are crucial for children with ASD. However, achieving effective outcomes requires tailored musical content and interactions. Current tools often struggle to customize musical elements like melody and rhythm on an individual level, and many lack intuitive interfaces that suit the sensory and cognitive needs of children with ASD, which can lead to sensory overload. Additionally, existing solutions generally do not provide adequate mechanisms for tracking and analyzing user interactions, making it challenging for clinicians and composers to assess preferences and therapeutic progress. The lack of real-time feedback and data analytics limits the impact of music therapy in this population. This technology is an interactive musical system designed to enhance music engagement for children with ASD through a customizable audio control device and a comprehensive data analysis platform. The core device features a multi-button interface, where each button corresponds to a distinct audio layer—such as melody, percussion, or ambient sounds—within a multi-layer musical track. Users can cycle through various playback modes for each layer, including adjustments to timbre, pitch, tempo, and a mute option, with color-coded LEDs providing immediate visual feedback and synchronizing with the music’s tempo. The device communicates wirelessly with a device monitor-controller (DMC), which stores musical tracks, displays a real-time graphical user interface that mirrors the device’s settings, and manages session controls. All user interactions, including button presses and playback mode changes, are logged with timestamps, enabling detailed tracking of engagement and preferences. What differentiates this technology is its integration of real-time interactivity, sensory-friendly design, and robust data analytics tailored specifically for children with ASD. The system not only empowers users to personalize their listening experience—fostering autonomy and emotional expression—but also captures granular data on every interaction. This data is transformed into visual analytics, such as bar graphs and Sankey diagrams, allowing clinicians, therapists, and composers to identify patterns in musical preferences and engagement. The modular musical content, composed at accessible tempos and structured for sensory sensitivities, further supports individualized therapeutic interventions. The system’s portability, intuitive interface, and ability to generate actionable insights for both therapy and music composition make it a uniquely comprehensive solution for supporting socio-emotional learning and formative listening experiences in diverse settings.

Benefits

  • Enables personalized music interaction by allowing users to customize multi-layer musical tracks through selectable playback modes.
  • Provides real-time visual feedback with color-coded LEDs synchronized to music tempo, enhancing sensory engagement.
  • Logs detailed user interaction data, including timestamps and playback modes, for comprehensive analysis of musical preferences and engagement.
  • Generates diverse visual data representations and interactive dashboards to support clinicians, composers, and caregivers in understanding user behavior and tailoring interventions.
  • Facilitates socio-emotional learning and autonomy for children with Autism Spectrum Disorder by enabling expressive musical choices.
  • Supports therapeutic and compositional practices through data-driven insights tailored to individual sensory and emotional needs.
  • Offers a portable, user-friendly system suitable for various settings such as homes, schools, and therapy centers.

Applications

  • Personalized music therapy for ASD
  • Interactive music education tools
  • Data-driven music composition analysis
  • Clinical engagement monitoring dashboards
  • Home-based sensory music systems

Additional info

From seed funding to Innovation Ambassador Learning to love music