Recurrent neural network (RNN)

An older architecture that processes a sequence one token at a time, carrying a running hidden state forward, which makes it hard to parallelize and prone to forgetting distant tokens, the problem transformers were designed to solve.