论文2:Finding Function in Form: Compositional Character Models for Open Vocabulary Word Representation

Finding Function in Form: Compositional Character Models for Open Vocabulary Word Representation

从字符中生成嵌入:用于开放词表示的组合字符模型

论文复现代码:https://github.com/lyj157175/NLP_paper_reproduction

论文2:Finding Function in Form: Compositional Character Models for Open Vocabulary Word Representation

背景介绍

论文2:Finding Function in Form: Compositional Character Models for Open Vocabulary Word Representation

词向量的两个问题

  • 无法进行词推理
  • OOV(不在词标的词无法表示)

摘要论文2:Finding Function in Form: Compositional Character Models for Open Vocabulary Word Representation

C2W模型

论文2:Finding Function in Form: Compositional Character Models for Open Vocabulary Word Representation
论文2:Finding Function in Form: Compositional Character Models for Open Vocabulary Word Representation

两种训练任务

论文2:Finding Function in Form: Compositional Character Models for Open Vocabulary Word Representation
论文2:Finding Function in Form: Compositional Character Models for Open Vocabulary Word Representation
论文2:Finding Function in Form: Compositional Character Models for Open Vocabulary Word Representation