Feed-forward network

A small two-layer neural network applied independently to each token's vector after attention, expanding it to a larger dimension, applying a non-linearity, then projecting it back down.

See it explained in full