Magia Book (II)

memorandum

Referring expression(参照表現)など

referring expression(参照表現)とは何か?

  • A Joint Speaker-Listener-Reinforcer Model for Referring Expressionsより Referring expressions are natural language constructions used to identify particular objects within a scene.(あるシーン中の物体を特定するために用いられる,自然言語構造のことである)

  • referring expressionは文脈を含むためword embeddingだけで実現することは難しいと考えられる

Word embeddingとは何か?

  • Wikipediaより Word embedding is the collective name for a set of language modeling and feature learning techniques in natural language processing (NLP) where words or phrases from the vocabulary are mapped to vectors of real numbers. (単語やフレーズを数値として写像する自然言語処理(NLP)の名称である)

  • ... There are many branches and many research groups working on word embeddings. In 2013, a team at Google led by Tomas Mikolov created word2vec, a word embedding toolkit which can train vector space models faster than the previous approaches. Most new word embedding techniques rely on a neural network architecture instead of more traditional n-gram models and unsupervised learning.(近年ではword2vecなどがあり,従来的なn-gramモデルや教師なし学習が置きかわりつつある)