Say hello!    Twitter  LinkedIn  Facebook  Instagram  Flipboard    

Behavioral Signal Processing for Media and Movie Analytics

With its close proximity to Hollywood, it was inevitable that behavioral signal processing techniques developed at SAIL would be applied to the big data of movies and television. Working with the Geena Davis Institute and Google, SAIL researchers led the development of the Geena Davis Inclusion Quotient (GD-IQ), a novel software that measures the screen and speaking time of female and male characters. The research found that male characters have twice the screen time (from video signal processing) and speaking time (from audio signal processing) as their female counterparts. From the computational side, it is interesting to note that the audio provides critical information (i.e., speaking time) that can’t be determined from the video. Tremendous new opportunities arise with the introduction of emotion and behavioral analytics in movies and media.

“This is our very first [application] of our tool and its analysis,” said USC engineering professor Shri Narayanan. “Our bigger roadmap that we’ve been dreaming up is to look at different representations in media.”

Washington Post (September 20, 2016)

Whitepaper on Behavioral Signal Processing

“This is our very first [application] of our tool and its analysis,” said USC engineering professor Shri Narayanan. “Our bigger roadmap that we’ve been dreaming up is to look at different representations in media.”

Washington Post (September 20, 2016)

Discover more on Behavioral Signals Processing in

Read more

Sign up for our newsletter (Once a month, at most. Promise)