Title:
Clustering Social Event Images using Kernel Canonical Correlation Analysis
Clustering Social Event Images using Kernel Canonical Correlation Analysis
Author(s)
Ahsan, Unaiza
Essa, Irfan
Essa, Irfan
Advisor(s)
Editor(s)
Collections
Supplementary to
Permanent Link
Abstract
Sharing user experiences in form of photographs, tweets, text, audio and/or video has become commonplace in social networking websites. Browsing through large collections of social multimedia remains a cumbersome task. It
requires a user to initiate textual search query and manually go through a list of resulting images to find relevant information. We propose an automatic clustering algorithm,
which, given a large collection of images, groups them into
clusters of different events using the image features and related metadata. We formulate this problem as a kernel canonical correlation clustering problem in which data samples from different modalities or ‘views’ are projected
to a space where correlations between the samples’ projections are maximized. Our approach enables us to learn a
semantic representation of potentially uncorrelated feature sets and this representation is clustered to give unique social events. Furthermore, we leverage the rich information associated with each uploaded image (such as usernames,
dates/timestamps, etc.) and empirically determine which combination of feature sets yields the best clustering score for a dataset of 100,000 images.
Sponsor
Date Issued
2014-06
Extent
Resource Type
Text
Resource Subtype
Proceedings