Machine Learning based Procedural Content Generation in Semantic Choreography

Thumbnail Image
Xiao, Kyle Phillip
Associated Organizations
Organizational Unit
Organizational Unit
Organizational Unit
Supplementary to
BeatMania is a rhythm-action game where players press buttons in response to keysound events to generate music. Rhythm-action game charts (the sequence of keysound events) have traditionally been human authored, since each song level must be creatively organized and correspond an overall pattern or theme. A deep neural network approach is proposed for rhythm-action game chart creation, and a method of level evaluation for co-creative AI is defined. That is, given an arbitrary piece of music, human users can generate BeatMania charts as well as give input to an AI collaborator. The problem is divided into two parts: autonomous chart generation and design interaction. For the chart generation process, a combination of features that include grouping information and audio sample labels are incorporated into an artificial neural network. For the design interaction, principal component analysis is utilized for a proposed reinforcement learning model. The co-creative tool is tested against Markov Chain and LSTM baselines via human trials.
Date Issued
Resource Type
Resource Subtype
Undergraduate Thesis
Rights Statement
Rights URI