Deep learning models for EEG-based rapid serial visual presentation event classification

We consider deep learning (DL) for event classification using electroencephalogram (EEG) measurements of brain activities. We proposed HDNN or hierarchical deep neural network, and CNN4EEG, a new convolution neural network (CNN). Both DL models are designed to improve the representation of spatial and local temporal correlations inherent in EEG data. These models were tested for image target prediction in a time-locked rapid serial visual presentation (RSVP) experiment. The performances were compared with the state-of-the-art RSVP classification algorithms including HDCA and XDAWN and with other popular machine learning algorithms. The results show that global spatial local temporal CNN (CNN4EEG) achieved a 13% improvement over the best competing non-DL algorithm and a 9% improvement over canonical CNN for image processing, and a 6% over deep neural network (DNN). Our results suggest that the unique design of temporal and spatial filters in CNN4EEG can improve the representation of EEG data, hence the prediction performance.