Sound Source Localization in Videos
Undergraduate Research Assistant, Since Fall 2018
Champaign, IL
The project is mainly about teaching coumputers to associate visual features with audio features by training a two-stream convolutional neural network. I enhance performance by providing the model with prior knowledge: utilizing image segmentation network to improve consistency among pixels and audio separation algorithms to separate mixed audios.