research
∙
05/23/2023
Towards A Unified View of Sparse Feed-Forward Network in Pretraining Large Language Model
Large and sparse feed-forward networks (S-FFN) such as Mixture-of-Expert...
share
research
∙
07/14/2022
Learning to translate by learning to communicate
We formulate and test a technique to use Emergent Communication (EC) wit...
research
∙
10/16/2020
