With its close proximity to Hollywood, it was inevitable that behavioral signal processing techniques developed at SAIL would be applied to the big data of movies and television. Working with the Geena Davis Institute and Google, SAIL researchers led the development of the Geena Davis Inclusion Quotient (GD-IQ), a novel software that measures the screen and speaking time of female and male characters. The research found that male characters have twice the screen time (from video signal processing) and speaking time (from audio signal processing) as their female counterparts. From the computational side, it is interesting to note that the audio provides critical information (i.e., speaking time) that can’t be determined from the video. Tremendous new opportunities arise with the introduction of emotion and behavioral analytics in movies and media.
“This is our very first [application] of our tool and its analysis,” said USC engineering professor Shri Narayanan. “Our bigger roadmap that we’ve been dreaming up is to look at different representations in media.”
–Washington Post (September 20, 2016)
Whitepaper on Behavioral Signal Processing
“This is our very first [application] of our tool and its analysis,” said USC engineering professor Shri Narayanan. “Our bigger roadmap that we’ve been dreaming up is to look at different representations in media.”
–Washington Post (September 20, 2016)
Discover more on Behavioral Signals Processing in
- Measuring the “how”
- Healthcare
- Media & Movie Analytics
- Home Assistants & Robotics
- Contact Center Applications
- Organizational Behavior
Read more
PAGES:
1 – Behavioral & Emotional Analytics | 2 – BSP in Healthcare | 3 – BSP for Media & Movie Analytics | 4 – BSP for Home Assistants & Robotics | 5 – BSP for Contact Centers | 6 – BSP for Organizational Behavior | 7 – Behavioral Signal Processing Pipeline: How it all works | 8 – Our Platform: callER & textER | 9 -The Challenges of Quantifying Behavior from Signals