Title:
Decoding Children’s Social Behavior
Decoding Children’s Social Behavior
Author(s)
Rehg, James M.
Abowd, Gregory D.
Rozga, Agata
Romero, Mario
Clements, Mark A.
Sclaroff, Stan
Essa, Irfan
Ousley, Opal Y.
Li, Yin
Kim, Chanho
Rao, Hrishikesh
Kim, Jonathan C.
Presti, Liliana Lo
Zhang, Jianming
Lantsman, Denis
Bidwell, Jonathan
Ye, Zhefan
Abowd, Gregory D.
Rozga, Agata
Romero, Mario
Clements, Mark A.
Sclaroff, Stan
Essa, Irfan
Ousley, Opal Y.
Li, Yin
Kim, Chanho
Rao, Hrishikesh
Kim, Jonathan C.
Presti, Liliana Lo
Zhang, Jianming
Lantsman, Denis
Bidwell, Jonathan
Ye, Zhefan
Advisor(s)
Editor(s)
Collections
Supplementary to
Permanent Link
Abstract
We introduce a new problem domain for activity recognition:
the analysis of children’s social and communicative
behaviors based on video and audio data. We specifically
target interactions between children aged 1–2 years
and an adult. Such interactions arise naturally in the diagnosis
and treatment of developmental disorders such as
autism. We introduce a new publicly-available dataset containing
over 160 sessions of a 3–5 minute child-adult interaction.
In each session, the adult examiner followed a semistructured
play interaction protocol which was designed to
elicit a broad range of social behaviors. We identify the key
technical challenges in analyzing these behaviors, and describe
methods for decoding the interactions. We present
experimental results that demonstrate the potential of the
dataset to drive interesting research questions, and show
preliminary results for multi-modal activity recognition.
Sponsor
Date Issued
2013-06
Extent
Resource Type
Text
Resource Subtype
Post-print
Proceedings
Proceedings