research
∙
10/09/2022
Fine-Tuning Pre-trained Transformers into Decaying Fast Weights
Autoregressive Transformers are strong language models but incur O(T) co...
share
research
∙
07/01/2020
A Survey on Self-supervised Pre-training for Sequential Transfer Learning in Neural Networks
Deep neural networks are typically trained under a supervised learning f...
research
∙
05/16/2020
Speech Recognition and Multi-Speaker Diarization of Long Conversations
Speech recognition (ASR) and speaker diarization (SD) models have tradit...
research
∙
03/10/2020
ReZero is All You Need: Fast Convergence at Large Depth
Deep networks have enabled significant performance gains across domains,...
research
∙
08/26/2019
Improving Neural Story Generation by Targeted Common Sense Grounding
Stories generated with neural language models have shown promise in gram...
research
∙
07/10/2019
LakhNES: Improving multi-instrumental music generation with cross-domain pre-training
We are interested in the task of generating multi-instrumental music sco...
research
∙
06/12/2018
The NES Music Database: A multi-instrumental dataset with expressive performance attributes
Existing research on music generation focuses on composition, but often ...
research
∙
01/03/2018
