Transformer Architecture · Chapter 09
Residual Connections
LayerNorm(x + Sublayer(x)) — the gradient highway
This chapter is part of the Pro track. Pro beta members receive the complete self-paced architecture sequence.
Architecture context: Transformer Architecture