## MLPs can learn in-context （刚才看到一个帖子一个standford phd提到的，手一滑就不见了） One of the most under-rated empirical results of this year was the fact that MLPs can learn in-context [14]. This is surprising becaus

#MLP #in-context learning #memorization #attention mechanism #generalization

𝙩𝙮≃𝙛{𝕩}^A𝕀²·ℙarad𝕚g𝕞

2周前

腾讯AI lab最近好像对in-context learning很关注 ICPO-In Context Steered Policy Optimization

𝙩𝙮≃𝙛{𝕩}^A𝕀²·ℙarad𝕚g𝕞

1个月前

旧时代：假以时日，这都不是事新纪元：in-context learning，could be everything

𝙩𝙮≃𝙛{𝕩}^A𝕀²·ℙarad𝕚g𝕞

3个月前

阶跃星辰stepfun可以的，这个step3的部署架构把attention和MLP分开，效率更高！ LLM的下一个突破是啥？attention+MLP+？