Parameter-Efficient Sparsity Crafting from Dense to Mixture-of-Experts for Instruction Tuning on General Tasks

Sep 20, 2024·
Haoyuan Wu
Haoyuan Wu
,
Haisheng Zheng
,
Zhuolun He
,
Bei Yu
· 0 min read
Type
Publication
The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP 2024 Main)