Transformer
BackgroundThe goal of reducing sequential computation also forms the foundation of the Extended Neural GPU, ByteNet and ConvS2S, all of which use conv
...
Subword Models
Character-Level Models
Word embeddings can be composed from character embeddings
Generates embeddings for unknown words
Similar spellings share simila
...
Attention
General definition of attentionGiven a set of vector values, and a vector query, attention is a technique to compute a weighted sum of the values, dep
...
Gated RNN Units
GRURNNs have been found to perform better with the use of more complex units for activation. Here, we discuss the use of a gated activation function t
...
Human Factor
Course Description This course provides an introduction to human factors research and applications with emphasis on mature areas such as sensation and
...
Dependency Parsing and Assignment3 of CS224n
the course note of deependency parsing and the details of assignment 3
Composition
What is Composition?
组合是指将不同的部分结合成一个整体的行为。使用面向对象的组合技术，可以将简单的、独立的对象组合成更大更复杂的整体。
从本质上讲，参与组合的那些对象都很小，他们在结构上都是独立的。这使得他们能够无缝低转换为可插入、可互换的组件。
重构创建零件12345678
...