Residual connection
Also called residual connections
Adding a sub-layer's output back onto its input, so each block refines the token vectors instead of replacing them.
Also called residual connections
Adding a sub-layer's output back onto its input, so each block refines the token vectors instead of replacing them.