GQE: 半量Query头,全量KV缓存,注意力也能MoE
Grouped Query Experts: Mixture-of-Experts on GQA Self-Attention 作者:Vishesh Tripathi, Abhay Kumar 核心发表机构:FrontiersMind 论文链接:arXiv:2606.20945v2 发布于:arXiv 预印本(cs.LG) | :— | :…
2026/8/11 3:50:24